00010000:00010000:2.0F:1780996896.489006:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00080000:2.0:1780996896.538450:0:80062:0:(debug.c:457:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1780996896.79679 00010000:02000000:3.0F:1780996896.538581:0:79679:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:05, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:2.0:1780996896.603444:0:79679:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8c8c7e93e10 00100000:10000000:2.0:1780996896.603460:0:79679:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0F:1780996896.605390:0:79668:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x90:0x0] 00000100:00100000:1.0:1780996896.605453:0:79668:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:79668:1867507126773248:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1780996896.606364:0:79668:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996896.606403:0:79668:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc993c0 going to sleep for 20 seconds 00000004:00080000:2.0:1780996896.606734:0:79666:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x282:0x0] 00000100:00100000:2.0:1780996896.606761:0:79666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:79666:1867507126773376:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1780996896.606792:0:79666:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996896.606819:0:79666:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689ba64d480 going to sleep for 20 seconds 00000100:00100000:3.0:1780996896.606880:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126773248 00000100:00100000:3.0:1780996896.606888:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126773248 00000100:00100000:3.0:1780996896.606947:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126773376 00000100:00100000:3.0:1780996896.606951:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126773376 00000100:00100000:3.0:1780996896.606977:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5890 00000100:00100000:3.0:1780996896.606986:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:79668:x1867507126773248:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:3.0:1780996896.606992:0:9596:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1780996896.607019:0:9596:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 673 -> diff = -529 00002000:02000040:3.0:1780996896.607024:0:9596:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:145 to 0x2c0000401:673) 00000100:00100000:0.0F:1780996896.607606:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5891 00000100:00100000:0.0:1780996896.607635:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:79666:x1867507126773376:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:0.0:1780996896.607641:0:25174:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1780996896.607661:0:25174:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 673 -> diff = -31 00002000:02000040:0.0:1780996896.607664:0:25174:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:643 to 0x280000400:673) 00002000:00010000:2.0:1780996896.620263:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.620295:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153755d4/0x30fd811c03059157 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.620311:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.620313:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.620319:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000153755d4/0x30fd811c03059157 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.620346:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000153755d4/0x30fd811c03059157 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.620365:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153755d4/0x30fd811c03059157 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.620374:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000153755d4/0x30fd811c03059157 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.620394:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780996896.620406:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780996896.620412:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000153755d4/0x30fd811c03059157 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.620433:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996896.620438:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000153755d4/0x30fd811c03059157 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.620448:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000153755d4/0x30fd811c03059157 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.620465:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000153755d4/0x30fd811c03059157 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.620473:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000153755d4/0x30fd811c03059157 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.621378:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996896.621382:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996896.621384:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780996896.621513:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.621521:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a58eadef/0x30fd811c0305915e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.621531:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.621533:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.621536:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a58eadef/0x30fd811c0305915e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.621547:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a58eadef/0x30fd811c0305915e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.621564:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a58eadef/0x30fd811c0305915e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.621571:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a58eadef/0x30fd811c0305915e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.626320:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780996896.626636:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.626646:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cecfec95/0x30fd811c03059165 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.626663:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.626666:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.626672:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cecfec95/0x30fd811c03059165 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.626687:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cecfec95/0x30fd811c03059165 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.626698:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cecfec95/0x30fd811c03059165 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.626706:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cecfec95/0x30fd811c03059165 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.626766:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780996896.626838:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.626844:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c0305916c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.626852:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.626853:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.626856:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c0305916c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.626866:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c0305916c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.626874:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c0305916c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.626881:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c0305916c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627331:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780996896.627340:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a58eadef/0x30fd811c0305915e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627350:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.627355:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a58eadef/0x30fd811c0305915e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627364:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a58eadef/0x30fd811c0305915e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627381:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a58eadef/0x30fd811c0305915e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627389:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a58eadef/0x30fd811c0305915e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627414:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780996896.627425:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cecfec95/0x30fd811c03059165 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627432:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.627435:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cecfec95/0x30fd811c03059165 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627442:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cecfec95/0x30fd811c03059165 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627452:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cecfec95/0x30fd811c03059165 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627458:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cecfec95/0x30fd811c03059165 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627598:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996896.627602:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c0305916c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627610:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.627613:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c0305916c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627621:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c0305916c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627641:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c0305916c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.627649:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.627651:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.627653:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996896.630439:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780996896.630560:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.630571:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e39d904/0x30fd811c03059173 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630587:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.630589:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.630594:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e39d904/0x30fd811c03059173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630607:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e39d904/0x30fd811c03059173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630618:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e39d904/0x30fd811c03059173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630626:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e39d904/0x30fd811c03059173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630649:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996896.630746:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.630751:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305917a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630758:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.630771:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.630774:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305917a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630783:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305917a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630791:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305917a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630797:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305917a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630815:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780996896.630848:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x29f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.630852:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c03059181 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630858:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.630860:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.630863:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c03059181 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630871:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c03059181 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630878:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c03059181 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630897:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c03059181 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.630898:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780996896.630908:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e39d904/0x30fd811c03059173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630916:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780996896.630919:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.630925:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e39d904/0x30fd811c03059173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.630936:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e39d904/0x30fd811c03059173 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.630955:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e39d904/0x30fd811c03059173 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780996896.630962:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x29e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780996896.630963:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e39d904/0x30fd811c03059173 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630972:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c03059188 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.630982:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.630983:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.630986:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c03059188 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.630987:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780996896.630994:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305917a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631000:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c03059188 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.631022:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996896.631024:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c03059188 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.631028:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305917a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631039:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c03059188 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.631043:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305917a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631057:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780996896.631058:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305917a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631067:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780996896.631069:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305917a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631073:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c03059181 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.631089:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996896.631096:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c03059188 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631100:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996896.631106:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c03059181 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.631109:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.631115:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c03059188 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631134:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c03059181 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.631137:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c03059188 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.631154:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c03059188 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.631169:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c03059188 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.631181:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.631183:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.631184:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.631200:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.631215:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996896.631305:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c03059181 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631313:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c03059181 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631325:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996896.631327:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996896.631329:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780996896.631450:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x29d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.631455:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305918f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631463:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.631465:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.631467:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305918f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631476:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305918f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631558:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305918f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631565:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305918f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631580:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996896.631620:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.631625:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c03059196 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631633:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.631635:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.631638:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c03059196 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631646:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c03059196 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631655:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c03059196 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631663:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c03059196 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631675:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780996896.631717:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.631723:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c0305919d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631731:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.631733:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.631736:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c0305919d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631745:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c0305919d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631753:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c0305919d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631760:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c0305919d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631771:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1780996896.631804:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.631809:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c030591a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631816:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.631817:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.631820:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c030591a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631829:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c030591a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631843:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c030591a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631850:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c030591a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631862:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1780996896.631870:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1780996896.631874:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305918f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631883:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6da400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996896.631887:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305918f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631895:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305918f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631905:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305918f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631912:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305918f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631928:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780996896.631937:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c03059196 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631943:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dae00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996896.631945:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c03059196 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631953:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c03059196 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631963:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c03059196 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631970:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c03059196 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631982:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780996896.631986:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c0305919d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.631992:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996896.631995:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c0305919d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632002:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c0305919d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632022:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c0305919d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632030:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c0305919d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632043:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780996896.632046:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c030591a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632052:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996896.632055:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c030591a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632062:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c030591a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632071:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c030591a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632078:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c030591a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632090:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996896.632092:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996896.632100:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.632417:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.632424:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.632428:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780996896.632464:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.632470:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c030591ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632479:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.632548:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.632552:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c030591ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632561:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c030591ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632568:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c030591ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632575:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c030591ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632600:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996896.632637:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x298:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.632642:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c030591b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632650:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.632652:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.632655:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c030591b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632676:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c030591b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632685:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c030591b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632692:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c030591b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632704:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780996896.632739:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x297:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.632744:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c030591b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632752:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.632754:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.632757:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c030591b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632765:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c030591b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632773:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c030591b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632782:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c030591b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632798:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1780996896.632834:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x296:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.632839:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c030591c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632845:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.632847:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.632849:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c030591c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632858:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c030591c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632866:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c030591c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632873:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c030591c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632884:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1780996896.632917:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x295:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.632922:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c030591c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632929:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.632930:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.632939:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c030591c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632947:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c030591c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632955:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c030591c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632963:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c030591c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.632971:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1780996896.633008:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x294:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.633013:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c030591ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.633021:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.633022:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.633025:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c030591ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.633033:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c030591ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.633041:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c030591ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.633060:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c030591ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.633068:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1780996896.633103:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x293:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.633108:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c030591d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.633129:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.633131:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.633134:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c030591d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.633143:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c030591d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633302:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1780996896.633310:0:9596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c0305916c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780996896.633603:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.633611:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c030591dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633621:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.633622:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.633632:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c030591dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633643:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c030591dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633651:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c030591dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633658:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c030591dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633667:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1780996896.633703:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.633708:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c030591e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633715:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.633717:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.633720:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c030591e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633729:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c030591e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633737:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c030591e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633756:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c030591e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633766:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1780996896.633800:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.633805:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c030591ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633813:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.633814:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.633818:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c030591ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633827:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c030591ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633835:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c030591ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633842:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c030591ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633850:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1780996896.633885:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.633890:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c030591f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633906:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.633907:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.633910:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c030591f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633919:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c030591f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633927:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c030591f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633934:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c030591f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633942:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1780996896.633979:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.633984:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c030591f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.633991:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.633992:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.633995:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c030591f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634004:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c030591f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634023:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c030591f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634029:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c030591f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634036:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1780996896.634072:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x298:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.634076:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c030591ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634083:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.634085:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.634087:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c030591ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634096:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c030591ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634103:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c030591ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634109:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c030591ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634117:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1780996896.634642:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x297:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.634649:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059206 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634658:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.634660:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.634663:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059206 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634674:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059206 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634682:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059206 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634690:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059206 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634701:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1780996896.634744:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x296:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.634750:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305920d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634758:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.634759:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.634762:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305920d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634772:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305920d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634787:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305920d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634795:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305920d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634804:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1780996896.634838:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x295:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.634843:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059214 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634850:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.634852:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.634855:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059214 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634863:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059214 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634870:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059214 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634877:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059214 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634885:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1780996896.634933:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x294:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.634938:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c0305921b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634944:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.634945:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.634948:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c0305921b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634955:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c0305921b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634962:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c0305921b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634968:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c0305921b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.634975:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:2.0:1780996896.635004:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x293:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.635009:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c03059222 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.635015:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.635016:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.635019:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c03059222 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.635026:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c03059222 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.635039:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c03059222 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.635045:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c03059222 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.635052:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:2.0:1780996896.635087:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x292:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.635092:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c03059229 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.635098:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.635099:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.635102:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c03059229 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.635110:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c03059229 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.635116:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c03059229 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.635122:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c03059229 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.635130:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00010000:00010000:3.0:1780996896.636541:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:3.0:1780996896.636553:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c030591ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636565:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.636571:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c030591ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636581:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c030591ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636600:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c030591ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636608:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c030591ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636653:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:3.0:1780996896.636657:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c030591b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636664:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.636668:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c030591b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636676:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c030591b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636686:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c030591b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636694:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c030591b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636705:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:3.0:1780996896.636709:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c030591b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636716:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.636720:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c030591b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636738:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c030591b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636748:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c030591b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636757:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c030591b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636770:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1780996896.636774:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c030591c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636781:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.636784:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c030591c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636792:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c030591c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636802:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c030591c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636810:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c030591c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636834:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1780996896.636838:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c030591c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636845:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.636849:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c030591c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636857:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c030591c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636867:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c030591c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636875:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c030591c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636886:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1780996896.636889:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c030591ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636895:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.636898:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c030591ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636916:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c030591ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636927:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c030591ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636933:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c030591ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636945:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1780996896.636949:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c030591dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636956:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.636960:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c030591dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636967:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c030591dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636976:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c030591dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.636983:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c030591dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637009:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1780996896.637013:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c030591e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637020:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.637023:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c030591e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637030:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c030591e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637040:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c030591e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637048:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c030591e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637058:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1780996896.637062:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c030591ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637069:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.637072:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c030591ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637090:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c030591ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637100:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c030591ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637108:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c030591ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637137:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1780996896.637140:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c030591f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637147:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.637159:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c030591f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637167:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c030591f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637177:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c030591f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637185:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c030591f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637216:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780996896.637220:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c030591f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637227:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.637231:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c030591f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637239:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c030591f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637249:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c030591f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637256:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c030591f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637267:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1780996896.637293:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c030591ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637300:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.637304:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c030591ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637325:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c030591ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637336:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c030591ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637345:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c030591ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637371:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1780996896.637375:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059206 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637383:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.637386:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059206 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637394:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059206 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637404:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059206 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637412:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059206 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637436:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780996896.637439:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305920d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637446:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.637449:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305920d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637456:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305920d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637465:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305920d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637473:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305920d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637484:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780996896.637487:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059214 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637494:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.637498:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059214 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637516:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059214 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637527:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059214 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637535:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059214 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637548:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780996896.637553:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c0305921b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637560:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.637563:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c0305921b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637571:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c0305921b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637581:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c0305921b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637589:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c0305921b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637612:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780996896.637616:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c03059222 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637624:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.637627:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c03059222 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637635:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c03059222 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637646:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c03059222 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637653:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c03059222 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637664:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996896.637668:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c03059229 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637675:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.637678:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c03059229 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637696:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c03059229 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637707:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c03059229 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637716:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c03059229 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.637729:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.637731:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.637734:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.637745:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.637752:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.637757:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996896.638100:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c030591d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.638213:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c030591d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.638242:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996896.638430:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x292:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.638437:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c03059230 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.638456:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.638459:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.638464:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c03059230 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.638476:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c03059230 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780996896.638608:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x291:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.638614:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c03059237 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638623:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.638625:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.638628:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c03059237 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638638:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c03059237 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638646:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c03059237 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638654:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c03059237 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638669:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780996896.638711:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x290:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.638716:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305923e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638724:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.638726:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.638729:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305923e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638737:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305923e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638752:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305923e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638760:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305923e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638771:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1780996896.638807:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.638812:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c03059245 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638820:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.638821:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.638824:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c03059245 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638834:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c03059245 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638842:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c03059245 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638851:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c03059245 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638862:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1780996896.638920:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.638925:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305924c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638932:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.638934:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.638936:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305924c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638944:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305924c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638951:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305924c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638958:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305924c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.638967:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1780996896.639003:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.639008:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c03059253 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.639015:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.639016:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.639019:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c03059253 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.639028:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c03059253 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.639042:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c03059253 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.639050:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c03059253 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.639058:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1780996896.639094:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.639099:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305925a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.639106:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.639108:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.639111:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305925a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.639135:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305925a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.639144:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305925a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640435:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c03059230 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640446:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c03059230 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640460:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1780996896.640617:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x291:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.640623:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c03059261 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640633:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.640635:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.640639:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c03059261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640651:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c03059261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640676:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c03059261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640685:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c03059261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640694:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1780996896.640729:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x290:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.640734:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c03059268 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640742:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.640743:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.640746:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c03059268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640755:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c03059268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640762:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c03059268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640768:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c03059268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640776:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1780996896.640818:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x28f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.640823:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c0305926f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640830:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.640831:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.640834:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c0305926f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640842:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c0305926f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640849:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c0305926f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640856:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c0305926f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640864:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1780996896.640899:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x28e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.640904:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c03059276 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640911:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.640912:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.640915:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c03059276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640924:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c03059276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640940:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c03059276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640946:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c03059276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.640954:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1780996896.640989:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x28d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.640994:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c0305927d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.641000:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.641002:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.641004:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c0305927d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.641012:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c0305927d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.641019:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c0305927d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.641027:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c0305927d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.641035:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1780996896.641077:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x28c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.641082:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c03059284 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.641089:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.641091:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.641094:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c03059284 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.641101:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c03059284 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.641106:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c03059284 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.641112:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c03059284 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.641119:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00010000:00010000:3.0:1780996896.641553:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1780996896.641562:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c030591d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641570:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.641574:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c030591d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641583:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c030591d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641615:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c030591d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641623:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c030591d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641646:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1780996896.641650:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c03059237 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641657:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.641660:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c03059237 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641666:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c03059237 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641676:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c03059237 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641684:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c03059237 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641698:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1780996896.641702:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305923e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641714:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.641716:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305923e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641723:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305923e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641734:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305923e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641740:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305923e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641753:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1780996896.641757:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c03059245 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641763:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.641765:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c03059245 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641772:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c03059245 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641779:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c03059245 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641794:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c03059245 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641806:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1780996896.641810:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305924c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641817:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.641820:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305924c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641828:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305924c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641838:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305924c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641845:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305924c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641856:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780996896.641860:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c03059253 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641867:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.641876:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c03059253 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641884:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c03059253 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641895:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c03059253 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641902:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c03059253 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641915:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1780996896.641919:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c03059230 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641926:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.641928:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c03059230 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641935:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c03059230 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641945:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c03059230 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641952:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c03059230 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641972:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1780996896.641976:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c03059261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641983:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.641986:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c03059261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.641995:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c03059261 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.642005:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c03059261 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.642012:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c03059261 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.642023:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780996896.642026:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c03059268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.642033:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.642037:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c03059268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.642056:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c03059268 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.642066:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c03059268 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.642075:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c03059268 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.642088:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780996896.642092:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c0305926f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.642099:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.642102:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c0305926f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.642110:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c0305926f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.642120:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c0305926f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.642127:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c0305926f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.642346:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305925a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643343:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1780996896.643631:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.643639:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305928b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643651:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.643652:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.643657:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305928b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643669:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305928b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643678:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305928b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643686:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305928b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643694:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1780996896.643725:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.643730:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c03059292 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643737:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.643739:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.643741:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c03059292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643750:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c03059292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643767:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c03059292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643775:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c03059292 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643783:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1780996896.643818:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.643823:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c03059299 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643830:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.643831:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.643834:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c03059299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643843:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c03059299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643851:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c03059299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643859:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c03059299 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643868:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1780996896.643913:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.643918:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c030592a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643926:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.643928:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.643931:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c030592a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643941:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c030592a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643949:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c030592a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643957:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c030592a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.643966:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1780996896.643998:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.644003:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c030592a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.644011:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.644013:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.644016:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c030592a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.644025:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c030592a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.644039:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c030592a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.644047:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c030592a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.644056:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1780996896.644093:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.644099:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c030592ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.644108:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.644109:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780996896.644290:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1780996896.644297:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c03059276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644306:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.644310:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c03059276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644320:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c03059276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644336:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c03059276 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644344:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c03059276 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644636:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780996896.644641:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c0305927d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644650:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.644653:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c0305927d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644688:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c0305927d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644700:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c0305927d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644708:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c0305927d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644721:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1780996896.644725:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c03059284 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644731:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.644735:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c03059284 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644742:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c03059284 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644752:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c03059284 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644760:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c03059284 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644785:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1780996896.644789:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305925a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644796:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.644800:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305925a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644808:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305925a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644819:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305925a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644827:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305925a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644842:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780996896.644845:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305928b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644852:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.644856:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305928b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644875:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305928b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644886:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305928b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644894:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305928b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644908:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780996896.644911:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c03059292 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644918:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.644922:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c03059292 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644930:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c03059292 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644940:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c03059292 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644948:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c03059292 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644976:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780996896.644980:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c03059299 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644987:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.644990:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c03059299 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.644998:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c03059299 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.645008:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c03059299 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.645016:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c03059299 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.645027:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780996896.645030:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c030592a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.645036:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.645040:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c030592a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.645058:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c030592a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.645068:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c030592a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.645075:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c030592a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.645088:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996896.645091:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c030592a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.645099:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.645102:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c030592a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.645110:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c030592a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780996896.645401:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.645409:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c030592b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645419:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.645421:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.645425:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c030592b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645436:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c030592b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645451:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c030592b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645459:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c030592b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645469:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996896.645664:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.645670:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c030592bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645678:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.645680:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.645683:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c030592bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645692:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c030592bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645700:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c030592bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645707:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c030592bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645716:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780996896.645759:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.645764:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c030592c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645772:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.645774:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.645777:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c030592c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645787:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c030592c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645795:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c030592c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645803:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c030592c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645812:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1780996896.645844:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.645849:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c030592ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645857:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.645858:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.645861:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c030592ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645870:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c030592ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645884:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c030592ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645890:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c030592ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645899:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1780996896.645934:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.645940:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c030592d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645947:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.645949:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.645952:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c030592d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645962:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c030592d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645970:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c030592d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645978:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c030592d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.645986:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1780996896.646026:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.646031:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c030592d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646039:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.646041:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.646044:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c030592d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646053:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c030592d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646060:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c030592d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646067:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c030592d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646075:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1780996896.646109:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.646286:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c030592ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.646298:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c030592ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.646306:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c030592ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.646313:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c030592ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.646325:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1780996896.646614:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c030592df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646625:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.646626:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.646630:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c030592df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646640:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c030592df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646654:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c030592df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646663:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c030592df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646672:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1780996896.646713:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.646719:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c030592e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646727:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.646729:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.646731:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c030592e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646741:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c030592e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646749:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c030592e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646757:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c030592e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646766:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1780996896.646806:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x283:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996896.646811:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c030592ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646820:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.646822:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996896.646825:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c030592ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646834:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c030592ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646843:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c030592ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646850:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c030592ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996896.646859:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00080000:1.0:1780996896.646880:0:25174:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:642 00000100:00100000:1.0:1780996896.646984:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:79666:x1867507126773376:12345-0@lo:5:osp-pre-0-0.0 Request processed in 39350us (40187us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996896.646994:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5891 00000100:00100000:1.0:1780996896.647058:0:79666:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:79666:1867507126773376:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1780996896.647073:0:79666:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x2a1:0x0] from OST, last_created [0x280000400:0x2a1:0x0]last_used is [0x280000400:0x282:0x0] 00000100:00100000:1.0:1780996896.647177:0:79666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba150700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:79666:1867507126773632:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1780996896.647230:0:79666:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996896.647252:0:79666:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888ba6e40 going to sleep for 20 seconds 00000100:00100000:1.0:1780996896.647283:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780996896.647295:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126773504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780996896.647318:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996896.647363:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126773632 00000100:00100000:1.0:1780996896.647369:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126773632 00000100:00100000:1.0:1780996896.647408:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5892 00000100:00100000:1.0:1780996896.647416:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:79666:x1867507126773632:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:1.0:1780996896.647422:0:25170:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:1.0:1780996896.647455:0:25170:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 674 00010000:00010000:3.0:1780996896.647671:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c030592a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647680:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c030592a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647721:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1780996896.647727:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c030592b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647735:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.647739:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c030592b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647748:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c030592b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647757:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c030592b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647764:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c030592b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647776:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1780996896.647779:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c030592bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647785:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.647789:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c030592bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647805:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c030592bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647814:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c030592bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647820:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c030592bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647830:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780996896.647833:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c030592c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647838:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.647840:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c030592c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647845:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c030592c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647853:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c030592c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647860:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c030592c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647882:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1780996896.647886:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c030592ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647892:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.647896:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c030592ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647903:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c030592ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647914:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c030592ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647920:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c030592ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647931:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1780996896.647935:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c030592d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647941:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.647945:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c030592d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647963:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c030592d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647974:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c030592d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647981:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c030592d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.647993:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780996896.647996:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c030592d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648002:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.648006:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c030592d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648014:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c030592d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648022:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c030592d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648029:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c030592d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648049:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780996896.648053:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c030592ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648059:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.648062:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c030592ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648068:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c030592ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648076:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c030592ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648083:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c030592ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648095:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780996896.648098:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c030592df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648104:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.648107:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c030592df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648123:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c030592df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648132:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c030592df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.648138:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c030592df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780996896.648376:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.648383:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c030592f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648393:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.648395:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.648400:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c030592f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648410:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c030592f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648419:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c030592f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648427:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c030592f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648436:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1780996896.648479:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.648588:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c030592fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648597:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.648599:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.648602:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c030592fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648612:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c030592fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648629:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c030592fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648636:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c030592fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648645:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1780996896.648681:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x283:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.648686:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c03059302 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648694:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.648696:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.648699:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c03059302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648708:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c03059302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648717:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c03059302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648726:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c03059302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648733:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1780996896.648776:0:9596:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x282:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996896.648781:0:9596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c03059309 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648789:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.648791:0:9596:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996896.648794:0:9596:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c03059309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648803:0:9596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c03059309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648811:0:9596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c03059309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648819:0:9596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c03059309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996896.648828:0:9596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1780996896.660295:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1780996896.660308:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c030592e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660324:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.660328:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c030592e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660339:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c030592e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660372:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c030592e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660381:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c030592e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660425:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780996896.660429:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c030592ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660435:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.660438:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c030592ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660446:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c030592ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660456:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c030592ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660463:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c030592ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660476:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780996896.660492:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c030592f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660499:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.660503:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c030592f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660520:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c030592f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660532:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c030592f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660539:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c030592f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660559:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780996896.660563:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c030592fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660570:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.660572:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c030592fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660580:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c030592fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660588:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c030592fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660596:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c030592fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660619:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780996896.660623:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c03059302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660630:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.660633:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c03059302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660641:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c03059302 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660650:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c03059302 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660658:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c03059302 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660670:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996896.660673:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c03059309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660680:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996896.660683:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c03059309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660701:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c03059309 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660712:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c03059309 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660719:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c03059309 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996896.660734:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.660735:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.660738:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.660769:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.660775:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.660778:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.660779:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996896.660784:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996896.660853:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126773504 00000100:00100000:3.0:1780996896.660863:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126773504 00000100:00100000:3.0:1780996896.660923:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00100000:3.0:1780996896.660934:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126773504:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:3.0:1780996896.660942:0:8235:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1780996896.660972:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8654144 pending 896 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996896.661063:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126773504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (13743us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996896.661070:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00000100:00100000:1.0:1780996896.663381:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126773504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780996896.665729:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:79666:x1867507126773632:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18306us (18491us total) trans 4294969447 rc 0/0 00000100:00100000:1.0:1780996896.665743:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5892 00002000:00080000:2.0:1780996896.667110:0:9596:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:144 00000100:00100000:2.0:1780996896.667761:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:79668:x1867507126773248:12345-0@lo:5:osp-pre-1-0.0 Request processed in 60770us (61404us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996896.667774:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5890 00000100:00100000:1.0:1780996896.667931:0:79668:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:79668:1867507126773248:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1780996896.667952:0:79668:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2a1:0x0] from OST, last_created [0x2c0000401:0x2a1:0x0]last_used is [0x2c0000401:0x90:0x0] 00000100:00100000:1.0:1780996896.668041:0:79668:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba151180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:79668:1867507126773888:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1780996896.668081:0:79668:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996896.668124:0:79668:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888ba66c0 going to sleep for 20 seconds 00000100:00100000:1.0:1780996896.668144:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126773888 00000100:00100000:1.0:1780996896.668159:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126773888 00000100:00100000:1.0:1780996896.668208:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5893 00000100:00100000:1.0:1780996896.668218:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:79668:x1867507126773888:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:1.0:1780996896.668225:0:25179:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:1.0:1780996896.668294:0:25179:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 674 00000100:00100000:3.0:1780996896.668767:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780996896.668780:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126773760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780996896.668817:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996896.668876:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126773760 00000100:00100000:3.0:1780996896.668881:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126773760 00000100:00100000:3.0:1780996896.668907:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887 00000100:00100000:3.0:1780996896.668914:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126773760:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:3.0:1780996896.668918:0:8234:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1780996896.668929:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 216384 pending 896 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996896.668967:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126773760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996896.668974:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887 00000100:00100000:3.0:1780996896.669016:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126773760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780996896.672994:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:79668:x1867507126773888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4771us (4907us total) trans 4294969448 rc 0/0 00000100:00100000:1.0:1780996896.673006:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5893 00000100:00100000:0.0:1780996896.673247:0:79666:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba150700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:79666:1867507126773632:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1780996896.673263:0:79666:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x2a1:0x0]-[0x280000400:0x2c1:0x0] 00000100:00100000:2.0:1780996896.674023:0:79668:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba151180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:79668:1867507126773888:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1780996896.674035:0:79668:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2a1:0x0]-[0x2c0000401:0x2c1:0x0] 00010000:00080000:0.0:1780996897.190978:0:23042:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff96888917a300 x1867507126771968/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1780996906 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780996897.191098:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888917a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126771968:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1008527us (1010985us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996897.191110:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00080000:1.0:1780996897.192671:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1780996897.192683:0:3495:0:(client.c:3253:ptlrpc_resend_req()) @@@ going to resend req@ffff968889179500 x1867507126771968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780996926 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780996897.192693:0:3495:0:(client.c:3262:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff968889179500 x1867507126771968/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780996926 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780996897.192702:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780996897.192721:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1780996897.194646:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780996897.194668:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126774016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780996897.194744:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996897.195704:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126774016 00000100:00100000:0.0:1780996897.195714:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126774016 00000100:00100000:0.0:1780996897.195772:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:0.0:1780996897.195782:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126774016:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:0.0:1780996897.195789:0:80061:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1780996897.195820:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445269504 avail 1299030016 00000100:00100000:0.0:1780996897.195887:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126774016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996897.195895:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00100000:3.0:1780996897.196942:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126774016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780996897.204546:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126771968:0@lo:400:ptlrpcd_rcv.0 00010000:00010000:3.0:1780996897.509802:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996898.537041:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996899.240096:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780996899.240121:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126774144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780996899.240222:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996899.240352:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126774144 00000100:00100000:1.0:1780996899.240361:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126774144 00000100:00100000:1.0:1780996899.240409:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:1.0:1780996899.240419:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126774144:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:1.0:1780996899.240427:0:8242:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1780996899.240472:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1780996899.240520:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126774144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996899.240527:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00100000:2.0:1780996899.240849:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126774144:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1780996899.557625:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996900.262244:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780996900.262267:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126774272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780996900.262356:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996900.262523:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126774272 00000100:00100000:1.0:1780996900.262531:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126774272 00000100:00100000:1.0:1780996900.262585:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:1.0:1780996900.262594:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126774272:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:1.0:1780996900.262601:0:14235:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1780996900.262640:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996900.262700:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126774272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996900.262708:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00000100:00100000:1.0:1780996900.262757:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126774272:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1780996900.263119:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780996900.263320:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780996900.263333:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126774400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780996900.263369:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996900.263504:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126774400 00000100:00100000:0.0:1780996900.263510:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126774400 00000100:00100000:0.0:1780996900.263561:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889 00000100:00100000:0.0:1780996900.263569:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126774400:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:0.0:1780996900.263574:0:8235:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1780996900.263599:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780996900.263638:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126774400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996900.263645:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889 00000100:00080000:3.0:1780996900.263921:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780996900.263953:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126774400:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1780996900.581638:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996901.285692:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968886b88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126774912:0@lo:400:kworker.0 00000100:00100000:1.0:1780996901.285771:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996901.285806:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126775424:0@lo:400:kworker.0 00000100:00100000:1.0:1780996901.285832:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996901.285848:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126775936:0@lo:400:kworker.0 00000100:00100000:1.0:1780996901.285868:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996901.285890:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1780996901.285895:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968886b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126774784:0@lo:400:kworker.0 00000100:00100000:1.0:1780996901.285917:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996901.285933:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126775296:0@lo:400:kworker.0 00000100:00100000:1.0:1780996901.285990:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996901.286012:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126775808:0@lo:400:kworker.0 00000100:00100000:1.0:1780996901.286034:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996901.286065:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126775424 00000100:00100000:1.0:1780996901.286072:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126775424 00000100:00100000:1.0:1780996901.286115:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126775936 00000100:00100000:1.0:1780996901.286119:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126775936 00000100:00100000:1.0:1780996901.286143:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126775296 00000100:00100000:1.0:1780996901.286146:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126775296 00000100:00100000:1.0:1780996901.286158:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126775808 00000100:00100000:1.0:1780996901.286175:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126775808 00000100:00100000:1.0:1780996901.286197:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373 00000100:00100000:1.0:1780996901.286213:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126775424:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780996901.286220:0:25178:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780996901.286307:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126775424:12345-0@lo:400:kworker.0 Request processed in 95us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996901.286314:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373 00000100:00100000:1.0:1780996901.286330:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374 00000100:00100000:1.0:1780996901.286336:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126775936:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780996901.286340:0:25178:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780996901.286366:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126775936:12345-0@lo:400:kworker.0 Request processed in 31us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996901.286371:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374 00000100:00100000:1.0:1780996901.286381:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375 00000100:00100000:1.0:1780996901.286386:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126775296:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780996901.286389:0:25178:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780996901.286412:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126775296:12345-0@lo:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996901.286417:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375 00000100:00100000:1.0:1780996901.286427:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376 00000100:00100000:1.0:1780996901.286433:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126775808:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780996901.286436:0:25178:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780996901.286457:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126775808:12345-0@lo:400:kworker.0 Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996901.286463:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376 00000100:00100000:1.0:1780996901.286507:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126775296:0@lo:400:kworker.0 00000100:00100000:1.0:1780996901.286518:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126775808:0@lo:400:kworker.0 00000100:00100000:1.0:1780996901.286546:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126775424:0@lo:400:kworker.0 00000100:00100000:1.0:1780996901.286556:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126775936:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.286651:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126774912 00000100:00100000:2.0:1780996901.286656:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126774912 00000100:00100000:2.0:1780996901.286693:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126774784 00000100:00100000:2.0:1780996901.286697:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126774784 00000100:00100000:2.0:1780996901.286720:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1780996901.286728:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126774912:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1780996901.286732:0:63418:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780996901.286771:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126774912:12345-0@lo:400:kworker.0 Request processed in 45us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996901.286778:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1780996901.286790:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:2.0:1780996901.286796:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126774784:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1780996901.286800:0:63418:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780996901.286824:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126774784:12345-0@lo:400:kworker.0 Request processed in 29us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996901.286830:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:2.0:1780996901.286857:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126774528:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.286886:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996901.286911:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968886b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126775040:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.286932:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996901.286947:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126775552:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.286977:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996901.286998:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126776064:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.287020:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996901.287038:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1780996901.287044:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968886b88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507126774656:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.287066:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996901.287082:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968886b89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126775168:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.287119:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996901.287138:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126775680:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.287169:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996901.287197:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126775168 00000100:00100000:2.0:1780996901.287203:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126775168 00000100:00100000:2.0:1780996901.287226:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126775680 00000100:00100000:2.0:1780996901.287229:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126775680 00000100:00100000:2.0:1780996901.287244:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:2.0:1780996901.287250:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126775168:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1780996901.287254:0:8241:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780996901.287327:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126775168:12345-0@lo:400:kworker.0 Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996901.287334:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00100000:2.0:1780996901.287345:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:2.0:1780996901.287351:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126775680:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1780996901.287354:0:8241:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780996901.287378:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126775680:12345-0@lo:400:kworker.0 Request processed in 28us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996901.287383:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00100000:2.0:1780996901.287418:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126775040 00000100:00100000:2.0:1780996901.287422:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126775040 00000100:00100000:2.0:1780996901.287442:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126775552 00000100:00100000:2.0:1780996901.287444:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126775552 00000100:00100000:2.0:1780996901.287454:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126776064 00000100:00100000:2.0:1780996901.287456:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126776064 00000100:00100000:2.0:1780996901.287468:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126774656 00000100:00100000:2.0:1780996901.287470:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126774656 00000100:00100000:2.0:1780996901.287483:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1780996901.287488:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126775040:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1780996901.287492:0:65272:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780996901.287522:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126775040:12345-0@lo:400:kworker.0 Request processed in 34us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996901.287528:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1780996901.287539:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:2.0:1780996901.287544:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b80a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126775552:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1780996901.287548:0:65272:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780996901.287571:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b80a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126775552:12345-0@lo:400:kworker.0 Request processed in 27us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996901.287577:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:2.0:1780996901.287588:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1780996901.287594:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126776064:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1780996901.287597:0:65272:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780996901.287620:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126776064:12345-0@lo:400:kworker.0 Request processed in 26us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996901.287625:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1780996901.287635:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1780996901.287641:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507126774656:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1780996901.287652:0:65272:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780996901.287679:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507126774656:12345-0@lo:400:kworker.0 Request processed in 38us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996901.287685:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1780996901.287725:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968886b88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507126774656:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.287735:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968886b89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126775168:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.287743:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126775680:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.287752:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968886b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126775040:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.287761:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126775552:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.287770:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126776064:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.287809:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968886b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126774784:0@lo:400:kworker.0 00000100:00100000:2.0:1780996901.287819:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968886b88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126774912:0@lo:400:kworker.0 00000100:00080000:3.0:1780996901.287919:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780996901.287934:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780996901.287937:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780996901.287939:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780996901.287952:0:79655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126774528 00000100:00100000:3.0:1780996901.287955:0:79655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126774528 00000100:00100000:3.0:1780996901.287994:0:79655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1780996901.288001:0:79655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfe59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126774528:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1780996901.288006:0:79655:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1780996901.288044:0:79655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfe59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126774528:12345-0@lo:400:kworker.0 Request processed in 44us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996901.288050:0:79655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1780996901.288088:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126774528:0@lo:400:kworker.0 00010000:00010000:0.0:1780996901.605861:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996901.636935:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996901.636986:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996901.637025:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996901.637058:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996901.637124:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110316800 00000100:00100000:3.0:1780996901.637134:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110316800 00000100:00100000:3.0:1780996901.637224:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2377 00000100:00100000:3.0:1780996901.637235:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110316800:12345-192.168.206.51@tcp:400:kworker.0 00000020:02000000:3.0:1780996901.637243:0:25173:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1780996901.637348:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110316800:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 114us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996901.637356:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2377 00000100:00080000:1.0:1780996901.637560:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780996901.637811:0:79654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110316416 00000100:00100000:0.0:1780996901.637817:0:79654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110316416 00000100:00100000:0.0:1780996901.637850:0:79654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:0.0:1780996901.637857:0:79654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfe58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110316416:12345-192.168.206.51@tcp:400:kworker.0 00000020:02000000:0.0:1780996901.637862:0:79654:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1780996901.637888:0:79654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfe58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110316416:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996901.637895:0:79654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:2.0:1780996901.638050:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110316544 00000100:00100000:2.0:1780996901.638055:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110316544 00000100:00100000:2.0:1780996901.638082:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110316672 00000100:00100000:2.0:1780996901.638085:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110316672 00000100:00100000:2.0:1780996901.638124:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1006 00000100:00100000:2.0:1780996901.638132:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110316672:12345-192.168.206.51@tcp:400:kworker.0 00000020:02000000:2.0:1780996901.638153:0:65272:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780996901.638197:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110316672:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 59us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996901.638206:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1006 00000100:00100000:2.0:1780996901.638219:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1021 00000100:00100000:2.0:1780996901.638237:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110316544:12345-192.168.206.51@tcp:38:kworker.0 00000020:02000000:2.0:1780996901.638242:0:65272:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:2.0:1780996901.638262:0:65272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp t90194313217 exp 0000000000000000 cur 3429 last 0 00000100:00080000:1.0:1780996901.638337:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:2.0:1780996901.638346:0:65272:0:(genops.c:1406:class_connect()) connect: client 285c134c-d3a6-4c01-bb4d-8148c50d5f95, cookie 0x30fd811c03059310 00000004:00100000:2.0:1780996901.638369:0:65272:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1780996901.638645:0:65272:0:(import.c:65:import_set_state_nolock()) ffff9689891ad000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780996901.638692:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110316544:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 453us (1766us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996901.638699:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1021 00000100:00100000:1.0:1780996901.678384:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996901.678605:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110316928 00000100:00100000:0.0:1780996901.678615:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110316928 00000100:00100000:0.0:1780996901.678671:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1022 00000100:00100000:0.0:1780996901.678682:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63410:x1867507110316928:12345-192.168.206.51@tcp:41:lfs.0 00000020:02000000:0.0:1780996901.678689:0:63419:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1780996901.678725:0:63419:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780996901.678800:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63410:x1867507110316928:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 119us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996901.678808:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1022 00000100:00100000:1.0:1780996901.689654:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996901.689761:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110317056 00000100:00100000:3.0:1780996901.689771:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110317056 00000100:00100000:3.0:1780996901.689832:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1890 00000100:00100000:3.0:1780996901.689842:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63410:x1867507110317056:12345-192.168.206.51@tcp:13:lfs.0 00000020:02000000:3.0:1780996901.689848:0:8234:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1780996901.689881:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996901.689952:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63410:x1867507110317056:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 111us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996901.689973:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1890 00000100:00100000:2.0:1780996901.693760:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996901.694767:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110317184 00000100:00100000:1.0:1780996901.694778:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110317184 00000100:00100000:1.0:1780996901.694823:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5894 00000100:00100000:1.0:1780996901.694833:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd01c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1867507110317184:12345-192.168.206.51@tcp:8:lfs.0 00000020:02000000:1.0:1780996901.694841:0:8232:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:1.0:1780996901.694872:0:8232:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp t0 exp 0000000000000000 cur 3429 last 0 00000020:00000080:1.0:1780996901.694908:0:8232:0:(genops.c:1406:class_connect()) connect: client 285c134c-d3a6-4c01-bb4d-8148c50d5f95, cookie 0x30fd811c03059317 00002000:00100000:1.0:1780996901.694920:0:8232:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 285c134c-d3a6-4c01-bb4d-8148c50d5f95/ffff9689ba41f000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1780996901.694937:0:8232:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1780996901.695012:0:8232:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1780996901.695054:0:8232:0:(import.c:65:import_set_state_nolock()) ffff9689ba418000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780996901.696041:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd01c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110317184:12345-192.168.206.51@tcp:8:lfs.0 Request processed in 1204us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996901.696050:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5894 00000001:00100000:3.0:1780996901.704077:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000100:00100000:1.0:1780996901.705802:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996901.705936:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110317312 00000100:00100000:2.0:1780996901.705947:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110317312 00000100:00100000:2.0:1780996901.706015:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1891 00000100:00100000:2.0:1780996901.706038:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63410:x1867507110317312:12345-192.168.206.51@tcp:13:lfs.0 00000020:02000000:2.0:1780996901.706046:0:14235:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1780996901.706071:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996901.706144:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63410:x1867507110317312:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 111us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996901.706152:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1891 00000001:00080000:3.0:1780996901.706765:0:9294:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969448 is committed 00000100:00100000:0.0:1780996901.798213:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780996901.798236:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126776192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780996901.798332:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996901.798572:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126776192 00000100:00100000:2.0:1780996901.798581:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126776192 00000100:00100000:2.0:1780996901.798631:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892 00000100:00100000:2.0:1780996901.798640:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126776192:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:2.0:1780996901.798646:0:8235:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1780996901.798665:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996901.798711:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126776192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996901.798731:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892 00000100:00100000:0.0:1780996901.798869:0:3496:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 2 00000100:00100000:0.0:1780996901.798890:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126776192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780996901.805456:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780996901.805488:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126776320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780996901.805564:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996901.806500:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126776320 00000100:00100000:3.0:1780996901.806512:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126776320 00000100:00100000:3.0:1780996901.806570:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893 00000100:00100000:3.0:1780996901.806581:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126776320:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:3.0:1780996901.806588:0:8234:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1780996901.806616:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996901.806694:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126776320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996901.806702:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893 00000100:00100000:1.0:1780996901.806870:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126776320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780996902.309698:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780996902.309725:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126776448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780996902.309799:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996902.309896:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126776448 00000100:00100000:0.0:1780996902.309905:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126776448 00000100:00100000:0.0:1780996902.309959:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:0.0:1780996902.309967:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126776448:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:0.0:1780996902.309974:0:8241:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1780996902.310012:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:0.0:1780996902.310058:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126776448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996902.310065:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00100000:3.0:1780996902.310217:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126776448:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1780996902.316672:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969447 is committed 00000001:00100000:0.0:1780996902.326956:0:79648:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00010000:00010000:3.0:1780996902.630026:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996903.653525:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780996904.071356:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996904.071528:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110317440 00000100:00100000:1.0:1780996904.071540:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110317440 00000100:00100000:1.0:1780996904.071601:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1023 00000100:00100000:1.0:1780996904.071612:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:63502:x1867507110317440:12345-192.168.206.51@tcp:101:lfs.0 00000020:02000000:1.0:1780996904.071621:0:63584:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:1.0:1780996904.071643:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996904.071666:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305931e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a49 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780996904.073224:0:63584:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1505us 00010000:00010000:0.0:1780996904.145106:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c03059325 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.145130:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c03059325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.145152:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c03059325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780996904.145207:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780996904.145211:0:63584:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1780996904.145246:0:63584:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c03059325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.145307:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305931e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a49 expref: 7 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.145336:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c03059325 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a49 expref: 6 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.145345:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689a5f8f500) 00010000:00010000:0.0:1780996904.145348:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780996904.145351:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02000, rc 0) 00000100:00100000:0.0:1780996904.145414:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63502:x1867507110317440:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 73803us (74065us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996904.145423:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1023 00000100:00100000:1.0:1780996904.151438:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996904.156026:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110317568 00000100:00100000:0.0:1780996904.156042:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110317568 00000100:00100000:0.0:1780996904.156122:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1024 00000100:00100000:0.0:1780996904.156134:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63502:x1867507110317568:12345-192.168.206.51@tcp:41:lfs.0 00000020:02000000:0.0:1780996904.156155:0:63418:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1780996904.156196:0:63418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:0.0:1780996904.156296:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63502:x1867507110317568:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 163us (4867us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996904.156304:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1024 00000100:00100000:1.0:1780996904.160582:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996904.160676:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110317696 00000100:00100000:0.0:1780996904.160686:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110317696 00000100:00100000:0.0:1780996904.160753:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1025 00000100:00100000:0.0:1780996904.160764:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63502:x1867507110317696:12345-192.168.206.51@tcp:41:lfs.0 00000020:02000000:0.0:1780996904.160771:0:63419:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1780996904.160807:0:63419:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00080000:1.0:1780996904.160826:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780996904.160878:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63502:x1867507110317696:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 115us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996904.160898:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1025 00000100:00100000:0.0:1780996904.168765:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996904.168901:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110317824 00000100:00100000:1.0:1780996904.168920:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110317824 00000100:00100000:1.0:1780996904.168990:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1894 00000100:00100000:1.0:1780996904.169000:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63502:x1867507110317824:12345-192.168.206.51@tcp:13:lfs.0 00000020:02000000:1.0:1780996904.169007:0:14235:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1780996904.169036:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1780996904.169361:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996904.171328:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63502:x1867507110317824:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 100us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996904.171342:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1894 00000100:00100000:1.0:1780996904.181804:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996904.181933:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110317952 00000100:00100000:2.0:1780996904.181959:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110317952 00000100:00100000:2.0:1780996904.182012:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1895 00000100:00100000:2.0:1780996904.182022:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:63502:x1867507110317952:12345-192.168.206.51@tcp:13:lfs.0 00000020:02000000:2.0:1780996904.182030:0:8235:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1780996904.182060:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996904.182154:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:63502:x1867507110317952:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 134us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996904.182161:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1895 00000100:00100000:0.0:1780996904.209746:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996904.211674:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110318080 00000100:00100000:2.0:1780996904.211686:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110318080 00000100:00100000:2.0:1780996904.211761:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1026 00000100:00100000:2.0:1780996904.211772:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:63025:x1867507110318080:12345-192.168.206.51@tcp:101:multiop.0 00000020:02000000:2.0:1780996904.211781:0:65272:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1780996904.211801:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780996904.211826:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c0305932c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a50 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996904.211890:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c03059333 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996904.211904:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c03059333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996904.211933:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c03059333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996904.211961:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305933a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996904.211970:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305933a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996904.211977:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305933a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996904.214419:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c03059341 lrc: 3/1,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996904.215192:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c03059341 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996904.215206:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c03059341 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780996904.215268:0:65272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a041:0x1:0x0]: returning size 0 00000004:00200000:3.0:1780996904.216776:0:65272:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1780996904.221890:0:65272:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c03059341 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.221916:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c03059341 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.221929:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c03059333 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.221936:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c03059333 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.221943:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c03059333 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.221951:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c03059333 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.221957:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780996904.221961:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c03059333 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.221969:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c03059333 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.221986:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689a5f8f500) 00010000:00010000:0.0:1780996904.221989:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780996904.221995:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c03059333 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.222016:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c03059333 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.222037:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305933a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.222043:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305933a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.222049:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305933a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.222054:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780996904.222058:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305933a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.222064:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305933a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.222087:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff96898b4c3300) 00010000:00010000:0.0:1780996904.222090:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780996904.222093:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305933a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.222100:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305933a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.222155:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c0305932c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a50 expref: 8 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.222184:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c03059341 lrc: 3/0,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a50 expref: 7 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996904.222191:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9689b110d300) 00010000:00010000:0.0:1780996904.222194:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780996904.222197:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9c00, rc 0) 00000100:00100000:0.0:1780996904.222266:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:63025:x1867507110318080:12345-192.168.206.51@tcp:101:multiop.0 Request processed in 10495us (12528us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996904.222321:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1026 00000100:00100000:2.0:1780996904.359695:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126776576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780996904.359783:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996904.360758:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126776576 00000100:00100000:0.0:1780996904.360769:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126776576 00000100:00100000:0.0:1780996904.360817:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:0.0:1780996904.360825:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126776576:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:0.0:1780996904.360831:0:23042:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1780996904.360858:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780996904.360924:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126776576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996904.360930:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000100:00100000:2.0:1780996904.362264:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126776576:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1780996904.677890:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996905.381576:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126776704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780996905.381650:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996905.381703:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126776704 00000100:00100000:1.0:1780996905.381710:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126776704 00000100:00100000:1.0:1780996905.381770:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896 00000100:00100000:1.0:1780996905.381778:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126776704:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:1.0:1780996905.381785:0:14235:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1780996905.381803:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996905.381845:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126776704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996905.381852:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896 00000100:00080000:1.0:1780996905.381869:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996905.381900:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126776704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780996905.384374:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780996905.384391:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126776832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780996905.384444:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996905.384490:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126776832 00000100:00100000:1.0:1780996905.384496:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126776832 00000100:00100000:1.0:1780996905.384552:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:1.0:1780996905.384560:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126776832:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:1.0:1780996905.384566:0:8234:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1780996905.384585:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996905.384626:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126776832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996905.384633:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00000100:00080000:1.0:1780996905.384651:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780996905.384681:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126776832:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1780996905.710473:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996906.415213:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126776960:0@lo:400:kworker.0 00000100:00100000:1.0:1780996906.415306:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996906.415473:0:79655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126776960 00000100:00100000:3.0:1780996906.415483:0:79655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126776960 00000100:00100000:3.0:1780996906.415537:0:79655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1780996906.415546:0:79655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfe5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126776960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996906.420053:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126777216:0@lo:400:kworker.0 00000100:00100000:0.0:1780996906.420156:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996906.420208:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780996906.420216:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126777088:0@lo:400:kworker.0 00000100:00100000:0.0:1780996906.420241:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996906.420298:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126777216 00000100:00100000:0.0:1780996906.420320:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126777216 00000100:00100000:0.0:1780996906.420371:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126777088 00000100:00100000:0.0:1780996906.420374:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126777088 00000100:00100000:0.0:1780996906.420404:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1780996906.420414:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126777216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996906.420487:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126777216:12345-0@lo:400:kworker.0 Request processed in 75us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996906.420494:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1780996906.420511:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1780996906.420518:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126777088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996906.420562:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126777088:12345-0@lo:400:kworker.0 Request processed in 45us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996906.420569:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1780996906.420636:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126777088:0@lo:400:kworker.0 00000100:00100000:0.0:1780996906.420649:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126777216:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.424138:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126777600:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.424211:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996906.424297:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126777600 00000100:00100000:2.0:1780996906.424304:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126777600 00000100:00100000:2.0:1780996906.424343:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:2.0:1780996906.424351:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126777600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.424402:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126777600:12345-0@lo:400:kworker.0 Request processed in 52us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996906.424410:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00000100:00100000:2.0:1780996906.424473:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126777600:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.424510:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126777728:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.424545:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996906.424577:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126777728 00000100:00100000:2.0:1780996906.424581:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126777728 00000100:00100000:2.0:1780996906.424608:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378 00000100:00100000:2.0:1780996906.424615:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126777728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.424651:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126777728:12345-0@lo:400:kworker.0 Request processed in 37us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996906.424658:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378 00000100:00100000:2.0:1780996906.424684:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126777728:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.424726:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126778112:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.424751:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996906.425792:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126778112 00000100:00100000:2.0:1780996906.425803:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126778112 00000100:00100000:2.0:1780996906.425848:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:2.0:1780996906.425854:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126778112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.425911:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126778112:12345-0@lo:400:kworker.0 Request processed in 57us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996906.425918:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00000100:00100000:2.0:1780996906.425951:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126778112:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.425991:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126778240:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426020:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996906.426109:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126777344:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426147:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996906.426168:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126777856:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426200:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996906.426216:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126778368:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426236:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996906.426252:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1780996906.426259:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126777472:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426299:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996906.426316:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126777984:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426336:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996906.426350:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126778496:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426367:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996906.426390:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126777344 00000100:00100000:2.0:1780996906.426394:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126777344 00000100:00100000:2.0:1780996906.426422:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126777472 00000100:00100000:2.0:1780996906.426438:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126777472 00000100:00100000:2.0:1780996906.426460:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1780996906.426467:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507126777344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426502:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507126777344:12345-0@lo:400:kworker.0 Request processed in 36us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996906.426510:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1780996906.426522:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126777984 00000100:00100000:2.0:1780996906.426525:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126777984 00000100:00100000:2.0:1780996906.426536:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126778496 00000100:00100000:2.0:1780996906.426538:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126778496 00000100:00100000:2.0:1780996906.426549:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:2.0:1780996906.426555:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126777472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426583:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126777472:12345-0@lo:400:kworker.0 Request processed in 28us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996906.426598:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:2.0:1780996906.426610:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1780996906.426615:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126777984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426643:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126777984:12345-0@lo:400:kworker.0 Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996906.426648:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1780996906.426657:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:2.0:1780996906.426662:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886b89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126778496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426685:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886b89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126778496:12345-0@lo:400:kworker.0 Request processed in 22us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996906.426690:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:2.0:1780996906.426706:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126778240 00000100:00100000:2.0:1780996906.426709:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126778240 00000100:00100000:2.0:1780996906.426731:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126777856 00000100:00100000:2.0:1780996906.426733:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126777856 00000100:00100000:2.0:1780996906.426747:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126778368 00000100:00100000:2.0:1780996906.426749:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126778368 00000100:00100000:2.0:1780996906.426767:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379 00000100:00100000:2.0:1780996906.426773:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126778240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426807:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126778240:12345-0@lo:400:kworker.0 Request processed in 34us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996906.426813:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379 00000100:00100000:2.0:1780996906.426824:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:2.0:1780996906.426830:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126777856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426856:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126777856:12345-0@lo:400:kworker.0 Request processed in 27us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996906.426871:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:2.0:1780996906.426881:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381 00000100:00100000:2.0:1780996906.426887:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126778368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426916:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126778368:12345-0@lo:400:kworker.0 Request processed in 29us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996906.426921:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381 00000100:00100000:2.0:1780996906.426960:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126777472:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426970:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126777984:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426979:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126778496:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426988:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126777344:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.426997:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126777856:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.427005:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126778368:0@lo:400:kworker.0 00000100:00100000:2.0:1780996906.427035:0:3497:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969447 gen 2 00000100:00100000:2.0:1780996906.427047:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126778240:0@lo:400:kworker.0 00000100:00080000:2.0:1780996906.427115:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780996906.427120:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780996906.427122:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780996906.427124:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996906.433857:0:79655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfe5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126776960:12345-0@lo:400:kworker.0 Request processed in 18302us (18539us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996906.433873:0:79655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1780996906.441284:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126776960:0@lo:400:kworker.0 00010000:00010000:3.0:1780996906.737050:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996906.767760:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996906.767890:0:79654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110318208 00000100:00100000:0.0:1780996906.767901:0:79654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110318208 00000100:00100000:0.0:1780996906.767965:0:79654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 154 00000100:00100000:0.0:1780996906.767977:0:79654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfe58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110318208:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996906.768070:0:79654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfe58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110318208:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 96us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996906.768078:0:79654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 154 00000100:00100000:1.0:1780996906.769731:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996906.769767:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996906.769795:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996906.769825:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110318464 00000100:00100000:2.0:1780996906.769838:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110318464 00000100:00100000:0.0:1780996906.769861:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110318336 00000100:00100000:0.0:1780996906.769867:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110318336 00000100:00100000:2.0:1780996906.769899:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1013 00000100:00100000:2.0:1780996906.769911:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110318464:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996906.769918:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1014 00000100:00100000:0.0:1780996906.769930:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110318336:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780996906.769975:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110318464:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996906.769985:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110318336:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 56us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996906.769996:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1013 00000100:00080000:1.0:1780996906.770025:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996906.770067:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110318720 00000100:00100000:3.0:1780996906.770072:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110318720 00000100:00100000:3.0:1780996906.770107:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2382 00000100:00100000:2.0:1780996906.770299:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110318720:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780996906.770344:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110318720:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 228us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996906.770352:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2382 00000100:00100000:0.0:1780996906.775506:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1014 00000100:00100000:1.0:1780996906.789261:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996906.790662:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110318592 00000100:00100000:2.0:1780996906.790678:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110318592 00000100:00100000:2.0:1780996906.790774:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2383 00000100:00100000:2.0:1780996906.790784:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110318592:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780996906.790892:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110318592:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 110us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996906.790900:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2383 00000100:00080000:1.0:1780996906.791045:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780996906.924438:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780996906.924477:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126778624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780996906.924578:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996906.924644:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126778624 00000100:00100000:0.0:1780996906.924653:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126778624 00000100:00100000:0.0:1780996906.924713:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:0.0:1780996906.924723:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126778624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780996906.924754:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780996906.924800:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126778624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996906.924808:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00100000:0.0:1780996906.924872:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126778624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780996906.925803:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780996906.925816:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126778752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780996906.925857:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996906.926067:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126778752 00000100:00100000:1.0:1780996906.926074:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126778752 00000100:00100000:1.0:1780996906.926116:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:1.0:1780996906.926124:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886b88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126778752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780996906.926155:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996906.926204:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886b88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126778752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996906.926211:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00100000:3.0:1780996906.926398:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126778752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780996907.429939:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126778880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780996907.430033:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996907.430209:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126778880 00000100:00100000:0.0:1780996907.430217:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126778880 00000100:00100000:0.0:1780996907.430294:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:0.0:1780996907.430303:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126778880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780996907.430337:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:0.0:1780996907.430397:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126778880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996907.430404:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00100000:3.0:1780996907.430564:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126778880:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1780996907.753331:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996908.723934:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996908.724019:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110318976 00000100:00100000:2.0:1780996908.724030:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110318976 00000100:00100000:2.0:1780996908.724139:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1027 00000100:00100000:2.0:1780996908.724151:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:63622:x1867507110318976:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:2.0:1780996908.724205:0:80049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1780996908.724381:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c03059341 lrc: 0/0,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a50 expref: 7 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.724424:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9689b110d300) 00010000:00010000:2.0:1780996908.724446:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c03059325 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a49 expref: 6 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.724454:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689a5f8f500) 00010000:00010000:2.0:1780996908.724461:0:80049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780996908.724487:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c03059348 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.724500:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c03059348 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.724510:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c03059348 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.724523:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305934f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.724531:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305934f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.724538:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305934f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.724626:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c03059356 lrc: 3/0,1 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.724635:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c03059356 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.724652:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c03059356 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1780996908.725000:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1780996908.725411:0:80049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x58:0x0].2, 64 off8320 00000004:00080000:2.0:1780996908.725430:0:80049:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3436271158381ns, next at 3437271154968ns, rc = 0 00010000:00010000:2.0:1780996908.725491:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2600/0x30fd811c0305935d lrc: 3/0,1 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725503:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2600/0x30fd811c0305935d lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725511:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2600/0x30fd811c0305935d lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725518:0:80049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2600/0x30fd811c0305935d lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725524:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2600/0x30fd811c0305935d lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725531:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2600/0x30fd811c0305935d lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725590:0:80049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780996908.725640:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c03059356 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725647:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c03059356 lrc: 2/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725652:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c03059356 lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725667:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780996908.725672:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c03059356 lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725680:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c03059356 lrc: 4/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725690:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff96898b4c3500) 00010000:00010000:2.0:1780996908.725693:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1780996908.725697:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c03059356 lrc: 2/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725702:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c03059356 lrc: 0/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725719:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c03059348 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725724:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c03059348 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725729:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c03059348 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725734:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780996908.725736:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c03059348 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725742:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c03059348 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725761:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3b00) 00010000:00010000:2.0:1780996908.725763:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780996908.725766:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c03059348 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725772:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c03059348 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780996908.725785:0:80049:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bdb573e6 reply state 000000002ad038b6 transno 94489280513 ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305934f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725794:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305934f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.725800:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff96898b4c3e00) 00010000:00010000:2.0:1780996908.725802:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780996908.725804:0:80049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780996908.725903:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:63622:x1867507110318976:12345-192.168.206.51@tcp:36:rm.0 Request processed in 1741us (1965us total) trans 94489280513 rc 0/0 00000100:00100000:2.0:1780996908.725913:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1027 00010000:00010000:3.0:1780996908.727857:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996908.727874:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2600/0x30fd811c0305935d lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996908.727885:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996908.728005:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2600/0x30fd811c0305935d lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996908.728038:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2600/0x30fd811c0305935d lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996908.728766:0:6339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff96898b4c3500) 00010000:00010000:3.0:1780996908.728769:0:6339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1780996908.728775:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2600/0x30fd811c0305935d lrc: 1/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996908.728781:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2600/0x30fd811c0305935d lrc: 0/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996908.729199:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996908.729202:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996908.729204:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996908.776911:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996909.478646:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780996909.478674:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126779008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780996909.478748:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996909.478915:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126779008 00000100:00100000:0.0:1780996909.478923:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126779008 00000100:00100000:0.0:1780996909.478996:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:0.0:1780996909.479004:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126779008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780996909.479052:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780996909.479121:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126779008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996909.479129:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000100:00100000:3.0:1780996909.479417:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126779008:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1780996909.816159:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780996910.501556:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126779264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780996910.502388:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126779136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780996910.502481:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996910.502569:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126779136 00000100:00100000:3.0:1780996910.502578:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126779136 00000100:00100000:3.0:1780996910.502651:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:3.0:1780996910.502661:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126779136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780996910.502699:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996910.502759:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126779136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996910.502769:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00100000:0.0:1780996910.502770:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996910.502789:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126779264 00000100:00100000:3.0:1780996910.502798:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126779264 00000100:00100000:3.0:1780996910.502825:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:3.0:1780996910.502831:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126779264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780996910.502849:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996910.502895:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126779264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996910.502902:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:1.0:1780996910.502902:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126779136:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1780996910.502919:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780996910.502923:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780996910.502993:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126779264:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1780996910.821499:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780996911.528129:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126779776:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.528360:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96898650f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126779648:0@lo:400:kworker.0 00000100:00100000:1.0:1780996911.528424:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96898650c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126779520:0@lo:400:kworker.0 00000100:00100000:3.0:1780996911.528483:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126779392:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.537993:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996911.538083:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126780160:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.538142:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996911.538169:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126780672:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.538214:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996911.538300:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126779648 00000100:00100000:2.0:1780996911.538311:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126779648 00000100:00100000:2.0:1780996911.538385:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1780996911.538396:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126779648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.538460:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126779648:12345-0@lo:400:kworker.0 Request processed in 67us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996911.538467:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1780996911.538495:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126780160 00000100:00100000:2.0:1780996911.538499:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126780160 00000100:00100000:2.0:1780996911.538524:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126780672 00000100:00100000:2.0:1780996911.538526:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126780672 00000100:00100000:2.0:1780996911.538634:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384 00000100:00100000:2.0:1780996911.538644:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126780160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.538701:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126780160:12345-0@lo:400:kworker.0 Request processed in 59us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996911.538708:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384 00000100:00100000:2.0:1780996911.538719:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385 00000100:00100000:2.0:1780996911.538726:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126780672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.538752:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126780672:12345-0@lo:400:kworker.0 Request processed in 26us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996911.538757:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385 00000100:00080000:2.0:1780996911.538778:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780996911.538783:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780996911.538840:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96898650f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126779648:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.538853:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126780160:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.538872:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126780672:0@lo:400:kworker.0 00000100:00100000:1.0:1780996911.540889:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996911.540970:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126780032:0@lo:400:kworker.0 00000100:00100000:1.0:1780996911.541016:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996911.541052:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126780544:0@lo:400:kworker.0 00000100:00100000:3.0:1780996911.541092:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996911.541142:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126779904:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.541148:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126779520 00000100:00100000:2.0:1780996911.541157:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126779520 00000100:00100000:3.0:1780996911.541168:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996911.541189:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126780416:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.541218:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126779904 00000100:00100000:2.0:1780996911.541222:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126779904 00000100:00100000:3.0:1780996911.541224:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996911.541244:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126780928:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.541244:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126780416 00000100:00100000:2.0:1780996911.541246:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126780416 00000100:00100000:2.0:1780996911.541266:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1780996911.541283:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996911.541290:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126779520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996911.541320:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126780928 00000100:00100000:3.0:1780996911.541324:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126780928 00000100:00100000:3.0:1780996911.541344:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1780996911.541350:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126779904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.541650:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126779520:12345-0@lo:400:kworker.0 Request processed in 361us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996911.541658:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:2.0:1780996911.541680:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1780996911.541687:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126780416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.541726:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126780416:12345-0@lo:400:kworker.0 Request processed in 39us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996911.541732:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1780996911.541744:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1780996911.541750:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126780928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.541778:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126780928:12345-0@lo:400:kworker.0 Request processed in 29us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996911.541784:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1780996911.541824:0:79658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126779392 00000100:00100000:2.0:1780996911.541828:0:79658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126779392 00000100:00100000:2.0:1780996911.541857:0:79658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1780996911.541864:0:79658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfe5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126779392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.541931:0:79658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfe5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126779392:12345-0@lo:400:kworker.0 Request processed in 67us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996911.541938:0:79658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1780996911.542073:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996911.542135:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96898650c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126779520:0@lo:400:kworker.0 00000100:00100000:1.0:1780996911.542170:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126780032 00000100:00100000:1.0:1780996911.542175:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126780032 00000100:00100000:1.0:1780996911.542205:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126780544 00000100:00100000:1.0:1780996911.542217:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126780544 00000100:00100000:1.0:1780996911.542240:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:1.0:1780996911.542246:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126780032:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1780996911.542479:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780996911.542486:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780996911.542540:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126779392:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.542554:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126780416:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.542563:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126780928:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.543677:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:2.0:1780996911.543700:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126780544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.543783:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126780544:12345-0@lo:400:kworker.0 Request processed in 94us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996911.543801:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00100000:0.0:1780996911.551782:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996911.551870:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126780288:0@lo:400:kworker.0 00000100:00100000:0.0:1780996911.552856:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996911.553814:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126779904:12345-0@lo:400:kworker.0 Request processed in 12456us (12637us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996911.553835:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1780996911.553909:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126779776 00000100:00100000:3.0:1780996911.553945:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126779776 00000100:00100000:0.0:1780996911.554447:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126780800:0@lo:400:kworker.0 00000100:00100000:0.0:1780996911.554511:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996911.554563:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126780288 00000100:00100000:0.0:1780996911.554568:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126780288 00000100:00100000:3.0:1780996911.555869:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:3.0:1780996911.555886:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126779776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996911.556487:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126780800 00000100:00100000:0.0:1780996911.556498:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126780800 00000100:00100000:0.0:1780996911.556537:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386 00000100:00100000:0.0:1780996911.556544:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126780288:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1780996911.556600:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780996911.556606:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780996911.556658:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126779904:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.556719:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387 00000100:00100000:2.0:1780996911.556729:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126780800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996911.559563:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126780288:12345-0@lo:400:kworker.0 Request processed in 2343us (6034us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996911.559583:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386 00000100:00100000:0.0:1780996911.560213:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126780288:0@lo:400:kworker.0 00000100:00100000:2.0:1780996911.569608:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126780800:12345-0@lo:400:kworker.0 Request processed in 12862us (15077us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996911.569629:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387 00000100:00100000:0.0:1780996911.570187:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126780800:0@lo:400:kworker.0 00000100:00100000:1.0:1780996911.570349:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126780032:12345-0@lo:400:kworker.0 Request processed in 28099us (29328us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996911.570546:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126780032:0@lo:400:kworker.0 00000100:00100000:0.0:1780996911.570563:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126780544:0@lo:400:kworker.0 00000100:00100000:1.0:1780996911.571004:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00100000:3.0:1780996911.578468:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126779776:12345-0@lo:400:kworker.0 Request processed in 22571us (26804us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996911.578489:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1780996911.580004:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126779776:0@lo:400:kworker.0 00010000:00010000:3.0:1780996911.847301:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996911.885084:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996911.885148:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996911.885183:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996911.885207:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996911.885234:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996911.885304:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110319360 00000100:00100000:1.0:1780996911.885320:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110319360 00000100:00100000:1.0:1780996911.885410:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110319232 00000100:00100000:1.0:1780996911.885414:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110319232 00000100:00100000:1.0:1780996911.885448:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1021 00000100:00100000:1.0:1780996911.885461:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110319360:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996911.885579:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110319360:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 120us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996911.885588:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1021 00000100:00100000:1.0:1780996911.885611:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1022 00000100:00100000:1.0:1780996911.885617:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110319232:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996911.885644:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110319232:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996911.885650:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1022 00000100:00100000:1.0:1780996911.885672:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110319616 00000100:00100000:1.0:1780996911.885696:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110319616 00000100:00100000:1.0:1780996911.885730:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110319488 00000100:00100000:1.0:1780996911.885733:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110319488 00000100:00100000:1.0:1780996911.885754:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2388 00000100:00100000:1.0:1780996911.885761:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110319616:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996911.885803:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110319616:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996911.885809:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2388 00000100:00100000:1.0:1780996911.885823:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2389 00000100:00100000:1.0:1780996911.885828:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110319488:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996911.885853:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110319488:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996911.885859:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2389 00000100:00080000:1.0:1780996911.885884:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780996911.885888:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780996911.885892:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780996911.885894:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996911.886807:0:79654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110319104 00000100:00100000:3.0:1780996911.886826:0:79654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110319104 00000100:00100000:3.0:1780996911.886924:0:79654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00100000:3.0:1780996911.886936:0:79654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfe59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110319104:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996911.887363:0:79654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfe59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110319104:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 429us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996911.887371:0:79654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00100000:3.0:1780996912.038561:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126781056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780996912.038653:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996912.040487:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126781056 00000100:00100000:1.0:1780996912.040505:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126781056 00000100:00100000:1.0:1780996912.040567:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00100000:1.0:1780996912.040577:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126781056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780996912.040609:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996912.040696:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126781056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996912.040704:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00100000:3.0:1780996912.040831:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126781056:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1780996912.041167:0:79666:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3439586895209ns, next at 3440586892297ns, rc = 0 00000100:00100000:0.0:1780996912.041235:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126781184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780996912.041303:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996912.041434:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126781184 00000100:00100000:3.0:1780996912.041439:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126781184 00000100:00100000:3.0:1780996912.041476:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:3.0:1780996912.041483:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126781184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780996912.041495:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996912.041532:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126781184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996912.041538:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00100000:3.0:1780996912.041598:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126781184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780996912.551968:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780996912.551991:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126781312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780996912.552057:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996912.552189:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126781312 00000100:00100000:2.0:1780996912.552198:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126781312 00000100:00100000:2.0:1780996912.552253:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:2.0:1780996912.552262:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126781312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780996912.552343:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:2.0:1780996912.552404:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126781312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996912.552412:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00000100:00100000:2.0:1780996912.552468:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126781312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1780996912.876290:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996913.898506:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996914.597825:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780996914.599711:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126781440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780996914.599788:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996914.599870:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126781440 00000100:00100000:2.0:1780996914.599878:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126781440 00000100:00100000:2.0:1780996914.599942:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:2.0:1780996914.599951:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126781440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780996914.599985:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1780996914.600051:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126781440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996914.600059:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000100:00100000:3.0:1780996914.600327:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126781440:0@lo:41:osp-pre-1-0.0 00000004:00080000:2.0:1780996914.604101:0:79648:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1780996914.604136:0:79648:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280513 is committed 00000004:00080000:2.0:1780996914.604141:0:79648:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1780996914.604612:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305934f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996914.604635:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305934f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996914.604642:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305934f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996914.604647:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780996914.604651:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305934f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996914.604659:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305934f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996914.604676:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff96898b4c3e00) 00010000:00010000:1.0:1780996914.604679:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780996914.604684:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305934f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996914.604689:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305934f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996914.604822:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126781568:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1780996914.604901:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996914.605390:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126781568 00000100:00100000:1.0:1780996914.605400:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126781568 00000100:00100000:1.0:1780996914.605464:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5895 00000100:00100000:1.0:1780996914.605475:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126781568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1780996914.605500:0:25178:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:642 count 1 00010000:00010000:1.0:1780996914.605523:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996914.605557:0:25178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c03058f04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a26 expref: 5 pid: 25175 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996914.605565:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996914.605567:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996914.605570:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996914.605601:0:25178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c03058f04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a26 expref: 5 pid: 25175 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996914.605615:0:25178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c03058f04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a26 expref: 5 pid: 25175 timeout: 3542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780996914.605627:0:25178:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25178:1867507126781696:192.168.206.51@tcp:104: 00000100:00080000:2.0:1780996914.605877:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996914.605907:0:25178:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f000 going to sleep for 11 seconds 00000100:00100000:1.0:1780996914.608898:0:25178:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25178:1867507126781696:192.168.206.51@tcp:104: 00010000:00010000:1.0:1780996914.608935:0:25178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780996914.611389:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996914.611517:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110319744 00000100:00100000:2.0:1780996914.611526:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110319744 00010000:00010000:2.0:1780996914.611577:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c03058f04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a26 expref: 6 pid: 25175 timeout: 3542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780996914.611617:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2549 00000100:00100000:2.0:1780996914.611627:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110319744:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780996914.611640:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780996914.611657:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c03058f04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a26 expref: 6 pid: 25175 timeout: 3542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996914.611669:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c03058f04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a26 expref: 6 pid: 25175 timeout: 3542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996914.611707:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c03058f04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a26 expref: 6 pid: 25175 timeout: 3542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996914.611722:0:25183:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996914.611724:0:25183:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996914.611729:0:25183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996914.611738:0:25183:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996914.611769:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780996914.611815:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110319744:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 189us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996914.611822:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2549 00010000:00010000:0.0:1780996914.611930:0:25178:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996914.611941:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996914.611951:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996914.611958:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996914.611982:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1780996914.612161:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126781568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6688us (7259us total) trans 4294969448 rc 0/0 00000100:00100000:0.0:1780996914.612169:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5895 00000004:00080000:0.0:1780996914.612237:0:3499:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9689ba150380/2, rc 0, transno 4294969448 00000100:00100000:0.0:1780996914.612243:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126781568:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1780996914.612407:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780996914.613050:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780996914.613059:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996914.613069:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996914.613073:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996914.613099:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996914.613113:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996914.613120:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c03059364 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996914.613140:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996914.613142:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996914.613143:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996914.923917:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996915.621775:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126781824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780996915.621845:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996915.622054:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126781824 00000100:00100000:1.0:1780996915.622062:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126781824 00000100:00100000:1.0:1780996915.623125:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:1.0:1780996915.623147:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126781824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780996915.623174:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996915.623230:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126781824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996915.623238:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00100000:1.0:1780996915.623303:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126781824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780996915.627474:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126781952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780996915.627546:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996915.630832:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126781952 00000100:00100000:3.0:1780996915.630847:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126781952 00000100:00080000:2.0:1780996915.634463:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780996915.634475:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780996915.642075:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905 00000100:00100000:3.0:1780996915.642103:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126781952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780996915.642139:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996915.642220:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126781952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (14673us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996915.642226:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905 00000100:00100000:0.0:1780996915.642505:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126781952:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1780996915.942996:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996916.645768:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126782464:0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.645836:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996916.645870:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126782976:0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.645896:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996916.645911:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126783488:0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.645927:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996916.645954:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1780996916.645958:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126782336:0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.645978:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996916.645995:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126782848:0@lo:400:kworker.0 00000100:00100000:3.0:1780996916.646141:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126782080:0@lo:400:kworker.0 00000100:00100000:0.0:1780996916.646162:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126782208:0@lo:400:kworker.0 00000100:00100000:3.0:1780996916.646185:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996916.646209:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996916.646220:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126782592:0@lo:400:kworker.0 00000100:00100000:1.0:1780996916.646312:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126782464 00000100:00100000:1.0:1780996916.646321:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126782464 00000100:00100000:1.0:1780996916.646385:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126782336 00000100:00100000:1.0:1780996916.646390:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126782336 00000100:00100000:1.0:1780996916.646408:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126782208 00000100:00100000:1.0:1780996916.646410:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126782208 00000100:00100000:1.0:1780996916.646435:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1780996916.646445:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898650f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126782464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.651778:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996916.651828:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996916.651838:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126783360:0@lo:400:kworker.0 00000100:00100000:3.0:1780996916.651856:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126783104:0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.651886:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996916.651897:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996916.651928:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96898650c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126783616:0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.651937:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126782592 00000100:00100000:2.0:1780996916.651946:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126782592 00000100:00100000:3.0:1780996916.651955:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996916.651991:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126783104 00000100:00100000:2.0:1780996916.651995:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126783104 00000100:00100000:2.0:1780996916.652007:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126783616 00000100:00100000:2.0:1780996916.652009:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126783616 00000100:00100000:2.0:1780996916.652024:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1780996916.652032:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126782336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.652116:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126782336:12345-0@lo:400:kworker.0 Request processed in 84us (6135us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996916.652124:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1780996916.652144:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1780996916.652151:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126782208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.652193:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126782208:12345-0@lo:400:kworker.0 Request processed in 33us (5975us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996916.652199:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1780996916.652211:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1780996916.652226:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126782592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.652285:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126782592:12345-0@lo:400:kworker.0 Request processed in 52us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996916.652292:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1780996916.652303:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1780996916.652309:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126783104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.652342:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126783104:12345-0@lo:400:kworker.0 Request processed in 34us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996916.652348:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1780996916.652357:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1780996916.652362:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126783616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.652380:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126783616:12345-0@lo:400:kworker.0 Request processed in 18us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996916.652385:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1780996916.652401:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126782976 00000100:00100000:2.0:1780996916.652404:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126782976 00000100:00100000:2.0:1780996916.652426:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126783488 00000100:00100000:2.0:1780996916.652428:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126783488 00000100:00100000:2.0:1780996916.652442:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126782848 00000100:00100000:2.0:1780996916.652444:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126782848 00000100:00100000:2.0:1780996916.652456:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126783360 00000100:00100000:2.0:1780996916.652458:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126783360 00000100:00100000:2.0:1780996916.652474:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390 00000100:00100000:2.0:1780996916.652480:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126782976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.652508:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126782976:12345-0@lo:400:kworker.0 Request processed in 29us (6611us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996916.652514:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390 00000100:00100000:2.0:1780996916.652522:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391 00000100:00100000:2.0:1780996916.652527:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126783488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.652563:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126783488:12345-0@lo:400:kworker.0 Request processed in 36us (6635us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996916.652575:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391 00000100:00100000:2.0:1780996916.652586:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392 00000100:00100000:2.0:1780996916.652597:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126782848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.652621:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126782848:12345-0@lo:400:kworker.0 Request processed in 25us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996916.652627:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392 00000100:00100000:2.0:1780996916.652635:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393 00000100:00100000:2.0:1780996916.652640:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126783360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.652658:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126783360:12345-0@lo:400:kworker.0 Request processed in 19us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996916.652664:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393 00000100:00100000:2.0:1780996916.652686:0:79658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126782080 00000100:00100000:2.0:1780996916.652689:0:79658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126782080 00000100:00100000:2.0:1780996916.652709:0:79658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1780996916.652714:0:79658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96899473b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126782080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996916.652738:0:79658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96899473b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126782080:12345-0@lo:400:kworker.0 Request processed in 24us (6555us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996916.652744:0:79658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1780996916.652764:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780996916.652768:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780996916.652771:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780996916.652773:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780996916.652838:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126782080:0@lo:400:kworker.0 00000100:00100000:3.0:1780996916.652853:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126782592:0@lo:400:kworker.0 00000100:00100000:3.0:1780996916.652863:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126783104:0@lo:400:kworker.0 00000100:00100000:3.0:1780996916.652872:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96898650c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126783616:0@lo:400:kworker.0 00000100:00100000:3.0:1780996916.652914:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126782336:0@lo:400:kworker.0 00000100:00100000:3.0:1780996916.652925:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126782848:0@lo:400:kworker.0 00000100:00100000:3.0:1780996916.652936:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126783360:0@lo:400:kworker.0 00000100:00100000:3.0:1780996916.652948:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126782976:0@lo:400:kworker.0 00000100:00100000:3.0:1780996916.652959:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126783488:0@lo:400:kworker.0 00000100:00100000:0.0:1780996916.653213:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126782208:0@lo:400:kworker.0 00000100:00100000:0.0:1780996916.653237:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126782720:0@lo:400:kworker.0 00000100:00100000:0.0:1780996916.653267:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996916.653298:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126783232:0@lo:400:kworker.0 00000100:00100000:0.0:1780996916.653319:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996916.653354:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126782720 00000100:00100000:0.0:1780996916.653358:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126782720 00000100:00100000:0.0:1780996916.653381:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126783232 00000100:00100000:0.0:1780996916.653383:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126783232 00000100:00100000:0.0:1780996916.653401:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:0.0:1780996916.653406:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126782720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996916.653440:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126782720:12345-0@lo:400:kworker.0 Request processed in 33us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996916.653446:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00000100:00100000:0.0:1780996916.653456:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:0.0:1780996916.653461:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126783232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996916.653485:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126783232:12345-0@lo:400:kworker.0 Request processed in 23us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996916.653499:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00000100:00100000:0.0:1780996916.653567:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126782720:0@lo:400:kworker.0 00000100:00100000:0.0:1780996916.653579:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126783232:0@lo:400:kworker.0 00000100:00100000:0.0:1780996916.654146:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126782464:0@lo:400:kworker.0 00000100:00100000:1.0:1780996916.654344:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898650f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126782464:12345-0@lo:400:kworker.0 Request processed in 7899us (8506us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996916.654352:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00010000:00010000:3.0:1780996916.969124:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780996917.008930:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996917.008983:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996917.009017:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996917.009041:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996917.009042:0:79654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110319872 00000100:00100000:3.0:1780996917.009053:0:79654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110319872 00000100:00100000:0.0:1780996917.009068:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996917.009103:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110320384 00000100:00100000:0.0:1780996917.009107:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110320384 00000100:00100000:3.0:1780996917.009114:0:79654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 158 00000100:00100000:3.0:1780996917.009122:0:79654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96899473ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110319872:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996917.009140:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110320256 00000100:00100000:0.0:1780996917.009142:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110320256 00000100:00100000:0.0:1780996917.009160:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2394 00000100:00100000:0.0:1780996917.009165:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110320384:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996917.009189:0:79654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96899473ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110319872:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 67us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996917.009189:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110320384:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996917.009197:0:79654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 158 00000100:00100000:0.0:1780996917.009197:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2394 00000100:00100000:0.0:1780996917.009212:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2395 00000100:00100000:0.0:1780996917.009217:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110320256:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996917.009237:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110320256:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 20us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996917.009242:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2395 00000100:00100000:2.0:1780996917.011599:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110320128 00000100:00100000:2.0:1780996917.011614:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110320128 00000100:00100000:2.0:1780996917.011678:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110320000 00000100:00100000:2.0:1780996917.011682:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110320000 00000100:00100000:2.0:1780996917.011715:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1029 00000100:00100000:2.0:1780996917.011725:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110320128:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996917.011751:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1030 00000100:00100000:3.0:1780996917.011762:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110320000:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780996917.011816:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110320128:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 89us (2828us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996917.011817:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110320000:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 53us (2770us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996917.011824:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1030 00000100:00100000:2.0:1780996917.011837:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1029 00000100:00080000:3.0:1780996917.011965:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780996917.011970:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780996917.011973:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780996917.011975:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780996917.166853:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126783744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780996917.166925:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996917.166981:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126783744 00000100:00100000:2.0:1780996917.166988:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126783744 00000100:00100000:2.0:1780996917.167051:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906 00000100:00100000:2.0:1780996917.167060:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126783744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780996917.167090:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996917.167133:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126783744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996917.167141:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906 00000100:00100000:2.0:1780996917.167188:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126783744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780996917.167412:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780996917.167422:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126783872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780996917.167448:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996917.167472:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126783872 00000100:00100000:1.0:1780996917.167476:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126783872 00000100:00100000:1.0:1780996917.167499:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1907 00000100:00100000:1.0:1780996917.167505:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc638a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126783872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780996917.167516:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996917.167544:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc638a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126783872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996917.167558:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1907 00000100:00100000:1.0:1780996917.167586:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126783872:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1780996917.183423:0:80361:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 05:21:55 (1780996915) 00000100:00100000:2.0:1780996917.669581:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780996917.669603:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126784000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780996917.669667:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996917.670169:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126784000 00000100:00100000:0.0:1780996917.670189:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126784000 00000100:00100000:0.0:1780996917.670239:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:0.0:1780996917.670248:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126784000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780996917.670294:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:0.0:1780996917.670337:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126784000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996917.670344:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00100000:2.0:1780996917.670495:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126784000:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1780996917.989475:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1780996918.119042:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969448 is committed 00000100:00100000:0.0:1780996918.199567:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996918.199639:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110320512 00000100:00100000:3.0:1780996918.199649:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110320512 00000100:00100000:3.0:1780996918.199703:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1028 00000100:00100000:3.0:1780996918.199711:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:64211:x1867507110320512:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1780996918.199729:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780996918.199749:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c0305936b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a57 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.199808:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059372 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.199821:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.199832:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780996918.199873:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1780996918.199876:0:63419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1780996918.199895:0:63419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.199934:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c0305936b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a57 expref: 7 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.200019:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059372 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a57 expref: 6 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.200028:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898962c100) 00010000:00010000:3.0:1780996918.200031:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780996918.200034:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8800, rc 0) 00000100:00100000:3.0:1780996918.200095:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64211:x1867507110320512:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 384us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996918.200102:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1028 00000100:00100000:0.0:1780996918.206201:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996918.206380:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110320640 00000100:00100000:3.0:1780996918.206390:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110320640 00000100:00100000:3.0:1780996918.206442:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1029 00000100:00100000:3.0:1780996918.206451:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc275850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64211:x1867507110320640:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:3.0:1780996918.206481:0:80049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:3.0:1780996918.206554:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc275850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64211:x1867507110320640:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 103us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996918.206562:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1029 00000100:00100000:1.0:1780996918.213419:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996918.216452:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110320768 00000100:00100000:3.0:1780996918.216468:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110320768 00000100:00100000:3.0:1780996918.216547:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1030 00000100:00100000:3.0:1780996918.216558:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64211:x1867507110320768:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:3.0:1780996918.216596:0:63417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1780996918.216683:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64211:x1867507110320768:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 126us (3274us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996918.216690:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1030 00000100:00100000:2.0:1780996918.230436:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996918.230533:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110320896 00000100:00100000:1.0:1780996918.230542:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110320896 00000100:00100000:1.0:1780996918.230599:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1908 00000100:00100000:1.0:1780996918.230609:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:64211:x1867507110320896:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:1.0:1780996918.230640:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996918.230703:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:64211:x1867507110320896:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996918.230710:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1908 00000100:00100000:3.0:1780996918.235397:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996918.235488:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110321024 00000100:00100000:2.0:1780996918.235499:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110321024 00000100:00100000:2.0:1780996918.235557:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1909 00000100:00100000:2.0:1780996918.235568:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:64211:x1867507110321024:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1780996918.235598:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996918.235659:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:64211:x1867507110321024:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 93us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996918.235674:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1909 00000100:00100000:1.0:1780996918.283859:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996918.284151:0:63427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110321152 00000100:00100000:0.0:1780996918.284161:0:63427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110321152 00000100:00100000:0.0:1780996918.284218:0:63427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1780996918.284228:0:63427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64218:x1867507110321152:12345-192.168.206.51@tcp:700:mcreate.0 00000100:00100000:0.0:1780996918.284408:0:63427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64218:x1867507110321152:12345-192.168.206.51@tcp:700:mcreate.0 Request processed in 181us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996918.284415:0:63427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1780996918.287290:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996918.287343:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110321408 00000100:00100000:3.0:1780996918.287353:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110321408 00000100:00100000:3.0:1780996918.287413:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1031 00000100:00100000:3.0:1780996918.287422:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64218:x1867507110321408:12345-192.168.206.51@tcp:36:mcreate.0 00010000:00010000:3.0:1780996918.287472:0:63419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780996918.287500:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059372 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a57 expref: 6 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.287521:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898962c100) 00010000:00010000:3.0:1780996918.287531:0:63419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780996918.287592:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c03059379 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.287606:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c03059379 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.287616:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c03059379 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.287627:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8000/0x30fd811c03059380 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.287634:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8000/0x30fd811c03059380 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.287642:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8000/0x30fd811c03059380 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.288033:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c03059379 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.288042:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c03059379 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.288048:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c03059379 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.288054:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c03059379 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.288060:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996918.288078:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c03059379 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.288086:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c03059379 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.288095:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898962c800) 00010000:00010000:3.0:1780996918.288098:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996918.288102:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c03059379 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.288109:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c03059379 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780996918.288122:0:63419:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9c540db reply state 0000000060d3c661 transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8000/0x30fd811c03059380 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.288132:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8000/0x30fd811c03059380 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.288149:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898962cf00) 00010000:00010000:3.0:1780996918.288152:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780996918.288155:0:63419:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780996918.288296:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:64218:x1867507110321408:12345-192.168.206.51@tcp:36:mcreate.0 Request processed in 874us (1032us total) trans 94489280514 rc 0/0 00000100:00100000:3.0:1780996918.288304:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1031 00000100:00100000:3.0:1780996918.299603:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996918.301152:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110321536 00000100:00100000:0.0:1780996918.301168:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110321536 00000100:00100000:0.0:1780996918.301227:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1032 00000100:00100000:0.0:1780996918.301237:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:64221:x1867507110321536:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1780996918.301260:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780996918.301303:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059387 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a5e expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.301371:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305938e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.301400:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305938e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.301413:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305938e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780996918.301459:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780996918.301463:0:63418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1780996918.301487:0:63418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305938e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.301512:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059387 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a5e expref: 9 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.301528:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305938e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a5e expref: 8 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.301538:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983740b00) 00010000:00010000:0.0:1780996918.301541:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780996918.301544:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02200, rc 0) 00000100:00100000:0.0:1780996918.301610:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:64221:x1867507110321536:12345-192.168.206.51@tcp:101:rm.0 Request processed in 374us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996918.301618:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1032 00000100:00100000:1.0:1780996918.306944:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996918.307024:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110321664 00000100:00100000:3.0:1780996918.307034:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110321664 00000100:00100000:3.0:1780996918.307107:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1033 00000100:00100000:3.0:1780996918.307117:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:64221:x1867507110321664:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:3.0:1780996918.307136:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780996918.307157:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c03059395 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a65 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307233:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305939c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307248:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305939c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307259:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305939c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307303:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9800/0x30fd811c030593a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307312:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9800/0x30fd811c030593a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307333:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9800/0x30fd811c030593a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307432:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c030593aa lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307441:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c030593aa lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307448:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c030593aa lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780996918.307498:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:3.0:1780996918.307502:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1780996918.307537:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c030593aa lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307549:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c030593aa lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307558:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305939c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307564:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305939c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307570:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305939c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307576:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305939c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307592:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996918.307596:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305939c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307604:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305939c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307616:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983740b00) 00010000:00010000:3.0:1780996918.307619:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996918.307625:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305939c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307632:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305939c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307646:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9800/0x30fd811c030593a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307653:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9800/0x30fd811c030593a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307659:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9800/0x30fd811c030593a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307664:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996918.307667:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9800/0x30fd811c030593a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307676:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9800/0x30fd811c030593a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307695:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898962cf00) 00010000:00010000:3.0:1780996918.307697:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996918.307701:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9800/0x30fd811c030593a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307707:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9800/0x30fd811c030593a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307737:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9600/0x30fd811c03059395 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a65 expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307749:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c030593aa lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a65 expref: 9 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.307755:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff96898962c800) 00010000:00010000:3.0:1780996918.307757:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780996918.307759:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9c00, rc 0) 00000100:00100000:3.0:1780996918.307826:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:64221:x1867507110321664:12345-192.168.206.51@tcp:101:rm.0 Request processed in 710us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996918.307833:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1033 00000100:00100000:0.0:1780996918.313489:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996918.313551:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110321920 00000100:00100000:3.0:1780996918.313562:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110321920 00000100:00100000:3.0:1780996918.313629:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1034 00000100:00100000:3.0:1780996918.313640:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:64221:x1867507110321920:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:3.0:1780996918.313698:0:65272:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1780996918.313726:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9c00/0x30fd811c030593aa lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a65 expref: 9 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.313762:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff96898962c800) 00010000:00010000:3.0:1780996918.313782:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305938e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a5e expref: 8 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.313793:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983740b00) 00010000:00010000:3.0:1780996918.313800:0:65272:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780996918.313822:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8400/0x30fd811c030593b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.313833:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8400/0x30fd811c030593b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.313843:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8400/0x30fd811c030593b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.313854:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2200/0x30fd811c030593b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.313862:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2200/0x30fd811c030593b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.313869:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2200/0x30fd811c030593b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.313941:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3a00/0x30fd811c030593bf lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.313950:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3a00/0x30fd811c030593bf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.313968:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3a00/0x30fd811c030593bf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314187:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2600/0x30fd811c030593c6 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314209:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2600/0x30fd811c030593c6 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314217:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2600/0x30fd811c030593c6 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314225:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2600/0x30fd811c030593c6 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314232:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2600/0x30fd811c030593c6 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314238:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2600/0x30fd811c030593c6 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314260:0:65272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780996918.314299:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3a00/0x30fd811c030593bf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314307:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3a00/0x30fd811c030593bf lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314314:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3a00/0x30fd811c030593bf lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314320:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996918.314330:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3a00/0x30fd811c030593bf lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314338:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3a00/0x30fd811c030593bf lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314349:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff96898962ca00) 00010000:00010000:3.0:1780996918.314352:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1780996918.314354:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996918.314357:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3a00/0x30fd811c030593bf lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.314363:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2600/0x30fd811c030593c6 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314365:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3a00/0x30fd811c030593bf lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.314380:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996918.314391:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8400/0x30fd811c030593b1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.314393:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2600/0x30fd811c030593c6 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314408:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8400/0x30fd811c030593b1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.314411:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2600/0x30fd811c030593c6 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314421:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8400/0x30fd811c030593b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314429:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8400/0x30fd811c030593b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314433:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996918.314436:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8400/0x30fd811c030593b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.314439:0:6339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff96898962ca00) 00010000:00010000:3.0:1780996918.314445:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8400/0x30fd811c030593b1 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.314445:0:6339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1780996918.314449:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2600/0x30fd811c030593c6 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.314458:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2600/0x30fd811c030593c6 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314477:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898962c100) 00010000:00010000:3.0:1780996918.314481:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780996918.314483:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996918.314485:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8400/0x30fd811c030593b1 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996918.314486:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996918.314490:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996918.314496:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8400/0x30fd811c030593b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780996918.314517:0:65272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000094dd1047 reply state 00000000478c411d transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2200/0x30fd811c030593b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314528:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2200/0x30fd811c030593b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996918.314534:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898962cf00) 00010000:00010000:3.0:1780996918.314537:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780996918.314539:0:65272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780996918.314608:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:64221:x1867507110321920:12345-192.168.206.51@tcp:36:rm.0 Request processed in 969us (1130us total) trans 94489280515 rc 0/0 00000100:00100000:3.0:1780996918.314616:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1034 00010000:00010000:1.0:1780996919.015621:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996919.717550:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780996919.717575:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126784128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780996919.717663:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996919.717909:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126784128 00000100:00100000:0.0:1780996919.717918:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126784128 00000100:00100000:0.0:1780996919.718182:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:0.0:1780996919.718190:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126784128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780996919.718218:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780996919.718307:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126784128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996919.718315:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000100:00100000:2.0:1780996919.718472:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126784128:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1780996920.042259:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780996920.742379:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126784256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780996920.742453:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996920.742508:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126784256 00000100:00100000:0.0:1780996920.742514:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126784256 00000100:00100000:0.0:1780996920.742568:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:0.0:1780996920.742588:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126784256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780996920.742619:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780996920.742667:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126784256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996920.742675:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00080000:0.0:1780996920.742696:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780996920.742753:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126784256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780996920.744481:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780996920.744499:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126784384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780996920.744546:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996920.744587:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126784384 00000100:00100000:0.0:1780996920.744594:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126784384 00000100:00100000:0.0:1780996920.744644:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:0.0:1780996920.744656:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126784384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780996920.744680:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780996920.744727:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126784384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996920.744735:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00080000:0.0:1780996920.744758:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780996920.744802:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126784384:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780996921.065553:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996921.765613:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126784768:0@lo:400:kworker.0 00000100:00100000:3.0:1780996921.765678:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996921.765711:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126785280:0@lo:400:kworker.0 00000100:00100000:3.0:1780996921.765736:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996921.765752:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126785792:0@lo:400:kworker.0 00000100:00100000:3.0:1780996921.765773:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996921.765798:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1780996921.765819:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126784640:0@lo:400:kworker.0 00000100:00100000:3.0:1780996921.765843:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996921.765860:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126785152:0@lo:400:kworker.0 00000100:00100000:3.0:1780996921.765883:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996921.765898:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126785664:0@lo:400:kworker.0 00000100:00100000:3.0:1780996921.765916:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996921.765943:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126784768 00000100:00100000:3.0:1780996921.765950:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126784768 00000100:00100000:3.0:1780996921.766009:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126784640 00000100:00100000:3.0:1780996921.766013:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126784640 00000100:00100000:3.0:1780996921.766034:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1780996921.766054:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126784768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996921.766196:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126785152 00000100:00100000:2.0:1780996921.766201:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126785152 00000100:00100000:2.0:1780996921.766227:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126785664 00000100:00100000:2.0:1780996921.766230:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126785664 00000100:00100000:2.0:1780996921.766245:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:2.0:1780996921.766251:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126785152:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780996921.766267:0:8242:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968888d7ed80 x1867507126785152/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:252/0 lens 224/224 e 0 to 0 dl 1780996932 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996921.766326:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126785152:12345-0@lo:400:kworker.0 Request processed in 75us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996921.766334:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00100000:2.0:1780996921.766350:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:2.0:1780996921.766356:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126785664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996921.766380:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126785664:12345-0@lo:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996921.766386:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000100:00100000:2.0:1780996921.766402:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1780996921.766409:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688884a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126784640:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780996921.766420:0:63418:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9688884a8380 x1867507126784640/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:252/0 lens 224/224 e 0 to 0 dl 1780996932 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996921.766452:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688884a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126784640:12345-0@lo:400:kworker.0 Request processed in 44us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996921.766459:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1780996921.766482:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126785280 00000100:00100000:2.0:1780996921.766485:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126785280 00000100:00100000:2.0:1780996921.766509:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126785792 00000100:00100000:2.0:1780996921.766511:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126785792 00000100:00100000:2.0:1780996921.766530:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396 00000100:00100000:2.0:1780996921.766536:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126785280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996921.766563:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126785280:12345-0@lo:400:kworker.0 Request processed in 29us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996921.766570:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396 00000100:00100000:2.0:1780996921.766579:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397 00000100:00100000:2.0:1780996921.766585:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126785792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996921.766607:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126785792:12345-0@lo:400:kworker.0 Request processed in 22us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996921.766612:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397 00000100:00080000:2.0:1780996921.766651:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780996921.766655:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780996921.766658:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780996921.766699:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126784640:0@lo:400:kworker.0 00000100:00100000:2.0:1780996921.766710:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126785152:0@lo:400:kworker.0 00000100:00100000:2.0:1780996921.766718:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126785664:0@lo:400:kworker.0 00000100:00100000:2.0:1780996921.766727:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126785280:0@lo:400:kworker.0 00000100:00100000:2.0:1780996921.766735:0:3499:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 2 00000004:00080000:2.0:1780996921.766746:0:3499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9689ba150380, transno 4294969448 00000100:00100000:2.0:1780996921.766756:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126785792:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.766971:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507126784896:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767003:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996921.767032:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126785408:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767066:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996921.767092:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126785920:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767113:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996921.767131:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1780996921.767137:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126784512:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767164:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996921.767196:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126785024:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767216:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996921.767231:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126785536:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767250:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996921.767264:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126786048:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767315:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996921.767341:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126785408 00000100:00100000:1.0:1780996921.767345:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126785408 00000100:00100000:1.0:1780996921.767368:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126785920 00000100:00100000:1.0:1780996921.767371:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126785920 00000100:00100000:1.0:1780996921.767395:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:1.0:1780996921.767400:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126785408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767433:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126785408:12345-0@lo:400:kworker.0 Request processed in 33us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996921.767440:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00100000:1.0:1780996921.767453:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399 00000100:00100000:1.0:1780996921.767459:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126785920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767482:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126785920:12345-0@lo:400:kworker.0 Request processed in 23us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996921.767488:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399 00000100:00100000:1.0:1780996921.767504:0:79658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126784512 00000100:00100000:1.0:1780996921.767507:0:79658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126784512 00000100:00100000:1.0:1780996921.767530:0:79658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1780996921.767536:0:79658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968994738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126784512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767563:0:79658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968994738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126784512:12345-0@lo:400:kworker.0 Request processed in 27us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996921.767578:0:79658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1780996921.767608:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126784896 00000100:00100000:1.0:1780996921.767611:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126784896 00000100:00100000:1.0:1780996921.767632:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126785024 00000100:00100000:1.0:1780996921.767635:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126785024 00000100:00100000:1.0:1780996921.767645:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126785536 00000100:00100000:1.0:1780996921.767647:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126785536 00000100:00100000:1.0:1780996921.767657:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126786048 00000100:00100000:1.0:1780996921.767660:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126786048 00000100:00100000:1.0:1780996921.767671:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1780996921.767676:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507126784896:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780996921.767689:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc638380 x1867507126784896/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:252/0 lens 224/224 e 0 to 0 dl 1780996932 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780996921.767717:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507126784896:12345-0@lo:400:kworker.0 Request processed in 40us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996921.767723:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1780996921.767734:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1780996921.767740:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126785024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767763:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126785024:12345-0@lo:400:kworker.0 Request processed in 24us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996921.767770:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1780996921.767779:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1780996921.767784:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126785536:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780996921.767794:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc639180 x1867507126785536/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:252/0 lens 224/224 e 0 to 0 dl 1780996932 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780996921.767815:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126785536:12345-0@lo:400:kworker.0 Request processed in 31us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996921.767827:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1780996921.767839:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1780996921.767845:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126786048:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780996921.767855:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc638000 x1867507126786048/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:252/0 lens 224/224 e 0 to 0 dl 1780996932 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780996921.767878:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126786048:12345-0@lo:400:kworker.0 Request processed in 34us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996921.767884:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00080000:1.0:1780996921.767901:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780996921.767904:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780996921.767906:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780996921.767929:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126784512:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767942:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126785024:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767951:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126785536:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767960:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126786048:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767969:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507126784896:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767978:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126785408:0@lo:400:kworker.0 00000100:00100000:1.0:1780996921.767987:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126785920:0@lo:400:kworker.0 00000100:00100000:2.0:1780996921.768393:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126784768:12345-0@lo:400:kworker.0 Request processed in 2349us (2713us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996921.768401:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1780996921.768488:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126784768:0@lo:400:kworker.0 00010000:00010000:3.0:1780996922.090359:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996922.118599:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996922.118646:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996922.118677:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996922.118703:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996922.118727:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996922.118756:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110322560 00000100:00100000:3.0:1780996922.118766:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110322560 00000100:00100000:3.0:1780996922.118818:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110322432 00000100:00100000:3.0:1780996922.118820:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110322432 00000100:00100000:3.0:1780996922.118844:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2400 00000100:00100000:3.0:1780996922.118854:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110322560:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996922.118927:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110322560:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 75us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996922.118944:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2400 00000100:00100000:1.0:1780996922.119054:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110322304 00000100:00100000:1.0:1780996922.119059:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110322304 00000100:00100000:1.0:1780996922.119091:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110322176 00000100:00100000:1.0:1780996922.119093:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110322176 00000100:00100000:1.0:1780996922.119115:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1037 00000100:00100000:1.0:1780996922.119129:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110322304:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996922.119164:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110322304:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996922.119170:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1037 00000100:00100000:1.0:1780996922.119187:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1038 00000100:00100000:1.0:1780996922.119194:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:2396:x1867507110322176:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000080:1.0:1780996922.119212:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adb8b800 x1867507110322176/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:253/0 lens 224/224 e 0 to 0 dl 1780996933 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780996922.119235:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:2396:x1867507110322176:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 42us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996922.119241:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1038 00000100:00100000:0.0:1780996922.119374:0:79654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110322048 00000100:00100000:0.0:1780996922.119379:0:79654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110322048 00000100:00100000:0.0:1780996922.119410:0:79654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 160 00000100:00100000:0.0:1780996922.119418:0:79654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689896c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2396:x1867507110322048:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996922.119445:0:79654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689896c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2396:x1867507110322048:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996922.119460:0:79654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 160 00000100:00100000:3.0:1780996922.119730:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2401 00000100:00100000:3.0:1780996922.119738:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110322432:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996922.119766:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110322432:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 31us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996922.119773:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2401 00000100:00080000:3.0:1780996922.119795:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780996922.119799:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780996922.119801:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780996922.119803:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780996922.281539:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126786176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780996922.281618:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996922.283110:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780996922.283126:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126786304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780996922.283171:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996922.283204:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126786176 00000100:00100000:0.0:1780996922.283211:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126786176 00000100:00100000:0.0:1780996922.283258:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126786304 00000100:00100000:0.0:1780996922.283260:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126786304 00000100:00100000:0.0:1780996922.283297:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:0.0:1780996922.283305:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126786176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780996922.283326:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780996922.283374:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126786176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996922.283381:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00100000:0.0:1780996922.283397:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:0.0:1780996922.283403:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126786304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780996922.283411:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780996922.283432:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126786304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996922.283437:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:0.0:1780996922.283485:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126786304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780996922.283499:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126786176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780996922.791418:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126786432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780996922.791487:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996922.795408:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126786432 00000100:00100000:2.0:1780996922.795426:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126786432 00000100:00100000:2.0:1780996922.795532:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:2.0:1780996922.795543:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126786432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780996922.795579:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00010000:00000080:2.0:1780996922.795596:0:8242:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a6794e00 x1867507126786432/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:253/0 lens 224/368 e 0 to 0 dl 1780996933 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996922.797669:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126786432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2123us (6175us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996922.797682:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00100000:0.0:1780996922.798444:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126786432:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1780996923.111394:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996924.139768:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1780996924.589631:0:79648:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280515 is committed 00010000:00010000:3.0:1780996924.591247:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8000/0x30fd811c03059380 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996924.591263:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8000/0x30fd811c03059380 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996924.591297:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8000/0x30fd811c03059380 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996924.591305:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996924.591311:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8000/0x30fd811c03059380 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996924.591320:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8000/0x30fd811c03059380 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996924.591341:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898962cf00) 00010000:00010000:3.0:1780996924.591344:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996924.591358:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8000/0x30fd811c03059380 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996924.591365:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8000/0x30fd811c03059380 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996924.591386:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2200/0x30fd811c030593b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996924.591393:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2200/0x30fd811c030593b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996924.591399:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2200/0x30fd811c030593b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996924.591404:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996924.591407:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2200/0x30fd811c030593b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996924.591414:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2200/0x30fd811c030593b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996924.591433:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898962cf00) 00010000:00010000:3.0:1780996924.591436:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996924.591439:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2200/0x30fd811c030593b8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996924.591446:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2200/0x30fd811c030593b8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780996924.847387:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126786560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780996924.847464:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996924.847840:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126786560 00000100:00100000:1.0:1780996924.847850:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126786560 00000100:00100000:1.0:1780996924.847917:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:1.0:1780996924.847927:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126786560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780996924.847960:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1780996924.848010:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126786560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996924.848018:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00100000:3.0:1780996924.848251:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126786560:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1780996925.159639:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1780996925.757500:0:80759:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1780996925.861992:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126786688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780996925.862070:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996925.862128:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126786688 00000100:00100000:3.0:1780996925.862135:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126786688 00000100:00100000:3.0:1780996925.862186:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1780996925.862196:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126786688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780996925.862225:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996925.862308:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126786688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996925.862514:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00080000:3.0:1780996925.862548:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780996925.862585:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126786688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780996925.863416:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126786816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780996925.863465:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996925.864236:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126786816 00000100:00100000:2.0:1780996925.864245:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126786816 00000100:00100000:2.0:1780996925.864377:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:2.0:1780996925.864389:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126786816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780996925.864420:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996925.864481:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126786816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996925.864495:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:2.0:1780996925.864667:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126786816:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780996925.865141:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780996925.945650:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996925.948686:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110322688 00000100:00100000:2.0:1780996925.948699:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110322688 00000100:00100000:2.0:1780996925.948939:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1035 00000100:00080000:1.0:1780996925.949866:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780996925.950260:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:64298:x1867507110322688:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780996925.950306:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780996925.950330:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2600/0x30fd811c030593cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a6c expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.950397:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c030593d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.950411:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c030593d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.950424:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c030593d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780996925.950468:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780996925.950472:0:63419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1780996925.950495:0:63419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c030593d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.950520:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2600/0x30fd811c030593cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a6c expref: 7 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.950538:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c030593d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a6c expref: 6 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.950562:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3f00) 00010000:00010000:2.0:1780996925.950565:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780996925.950569:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3400, rc 0) 00010000:00000080:2.0:1780996925.950577:0:63419:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adb8b480 x1867507110322688/t0(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:256/0 lens 576/688 e 0 to 0 dl 1780996936 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780996925.950648:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64298:x1867507110322688:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 398us (5007us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996925.950655:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1035 00000100:00100000:3.0:1780996925.954418:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996925.954675:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110322816 00000100:00100000:1.0:1780996925.954688:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110322816 00000100:00100000:1.0:1780996925.954762:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1036 00000100:00100000:1.0:1780996925.954772:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64298:x1867507110322816:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780996925.954809:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996925.954830:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0a00/0x30fd811c030593db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a73 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.954902:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.954919:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.954931:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.954946:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.954963:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.954969:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955200:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955208:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955214:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955221:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955233:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780996925.955237:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955245:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593e2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955258:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3f00) 00010000:00010000:1.0:1780996925.955260:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780996925.955265:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593e2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955303:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955315:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955322:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955327:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955332:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780996925.955334:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955340:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955357:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff968983653f00) 00010000:00010000:1.0:1780996925.955360:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780996925.955362:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955368:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955399:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0a00/0x30fd811c030593db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a73 expref: 7 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955409:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3f00) 00010000:00010000:1.0:1780996925.955411:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780996925.955414:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0a00/0x30fd811c030593db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a73 expref: 7 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.955422:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0a00, rc 0) 00010000:00000080:1.0:1780996925.955430:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adb8a300 x1867507110322816/t0(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:256/0 lens 592/584 e 0 to 0 dl 1780996936 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780996925.955498:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64298:x1867507110322816:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 727us (1088us total) trans 0 rc 301/301 00000100:00100000:1.0:1780996925.955505:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1036 00000100:00100000:3.0:1780996925.966870:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996925.967584:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110323072 00000100:00100000:1.0:1780996925.967596:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110323072 00000100:00100000:1.0:1780996925.967670:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1037 00000100:00100000:1.0:1780996925.967680:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64298:x1867507110323072:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780996925.967703:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996925.967719:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1780996925.967747:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c030593d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a6c expref: 6 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.967768:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3f00) 00010000:00010000:1.0:1780996925.967779:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780996925.967794:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0a00/0x30fd811c030593f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a7a expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.967895:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.967908:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.967918:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.967931:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593fe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.967937:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.967957:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.968905:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c03059405 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.968919:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c03059405 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.968940:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c03059405 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780996925.968962:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00010000:00010000:1.0:1780996925.968994:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593f7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.969008:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593f7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.969014:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.969029:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.969035:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780996925.969040:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.969047:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593f7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.969056:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983653f00) 00010000:00010000:1.0:1780996925.969059:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780996925.969063:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593f7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.969069:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1e00/0x30fd811c030593f7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780996925.969081:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2960245 reply state 000000002d6b8c3d transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.969099:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.969105:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff968983653800) 00010000:00010000:1.0:1780996925.969108:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780996925.969111:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780996925.969419:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0a00/0x30fd811c030593f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a7a expref: 8 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.969440:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c03059405 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a7a expref: 7 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996925.969448:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff968983653600) 00010000:00010000:1.0:1780996925.969450:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780996925.969453:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1400, rc 0) 00010000:00000080:1.0:1780996925.969461:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adb88700 x1867507110323072/t94489280516(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:256/0 lens 536/608 e 0 to 0 dl 1780996936 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780996925.969531:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:64298:x1867507110323072:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1853us (2672us total) trans 94489280516 rc 0/0 00000100:00100000:1.0:1780996925.969540:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1037 00000100:00100000:2.0:1780996925.978365:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996925.978613:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110323328 00000100:00100000:0.0:1780996925.978623:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110323328 00000100:00100000:0.0:1780996925.978681:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1038 00000100:00100000:0.0:1780996925.978692:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:64298:x1867507110323328:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1780996925.978716:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780996925.978739:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059413 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a81 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996925.978849:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996925.978864:0:63419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c03059405 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a7a expref: 9 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996925.978872:0:63419:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996925.978905:0:63419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c03059405 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a7a expref: 9 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996925.978918:0:63419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c03059405 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a7a expref: 9 pid: 63584 timeout: 3553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996925.978931:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6797b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63419:1867507126786944:192.168.206.51@tcp:104: 00000100:00100000:0.0:1780996925.979051:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986030540 going to sleep for 11 seconds 00000100:00100000:0.0:1780996925.984834:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6797b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63419:1867507126786944:192.168.206.51@tcp:104: 00010000:00010000:0.0:1780996925.984874:0:63419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780996925.986136:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996925.986224:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110323456 00000100:00100000:3.0:1780996925.986233:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110323456 00010000:00010000:3.0:1780996925.986308:0:18812:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c03059405 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a7a expref: 10 pid: 63584 timeout: 3553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996925.986357:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2550 00000100:00100000:3.0:1780996925.986367:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2395:x1867507110323456:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780996925.986382:0:18812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780996925.986389:0:18812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c03059405 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a7a expref: 10 pid: 63584 timeout: 3553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996925.986402:0:18812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c03059405 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a7a expref: 10 pid: 63584 timeout: 3553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996925.986441:0:18812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c03059405 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a7a expref: 10 pid: 63584 timeout: 3553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996925.986457:0:18812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff968983653600) 00010000:00010000:3.0:1780996925.986462:0:18812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996925.986473:0:18812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996925.986480:0:18812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996925.986507:0:18812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780996925.986558:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:2395:x1867507110323456:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 192us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996925.986567:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2550 00010000:00010000:2.0:1780996925.987131:0:63419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.987141:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780996925.987161:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00010000:00010000:2.0:1780996925.987413:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.987422:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.987429:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.987435:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780996925.987439:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.987457:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.987468:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff968983653600) 00010000:00010000:2.0:1780996925.987471:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1780996925.987475:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.987482:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c0305941a lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.987540:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059413 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a81 expref: 9 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.987550:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983740700) 00010000:00010000:2.0:1780996925.987552:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780996925.987555:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059413 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a81 expref: 9 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996925.987567:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03e00, rc 0) 00010000:00000080:2.0:1780996925.987575:0:63419:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bff6ca80 x1867507110323328/t94489280517(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:256/0 lens 712/824 e 0 to 0 dl 1780996936 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780996925.987622:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:64298:x1867507110323328:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 8932us (9267us total) trans 94489280517 rc 301/301 00000100:00100000:2.0:1780996925.987629:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1038 00000100:00100000:2.0:1780996925.994704:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996925.994803:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110323712 00000100:00100000:1.0:1780996925.994813:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110323712 00000100:00100000:1.0:1780996925.994870:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 212 00000100:00100000:1.0:1780996925.994881:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:64298:x1867507110323712:12345-192.168.206.51@tcp:35:lfs.0 00010000:00000080:1.0:1780996925.995106:0:63421:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bff6dc00 x1867507110323712/t94489280518(0) o35->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:256/0 lens 392/456 e 0 to 0 dl 1780996936 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780996925.995207:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:64298:x1867507110323712:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 327us (510us total) trans 94489280518 rc 0/0 00000100:00100000:1.0:1780996925.995215:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 212 00000100:00100000:3.0:1780996926.000915:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996926.001299:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110323968 00000100:00100000:1.0:1780996926.001313:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110323968 00000100:00100000:1.0:1780996926.001371:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 213 00000100:00100000:1.0:1780996926.001381:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:64298:x1867507110323968:12345-192.168.206.51@tcp:35:lfs.0 00010000:00000080:1.0:1780996926.001579:0:63421:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adb89880 x1867507110323968/t94489280519(0) o35->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:257/0 lens 392/456 e 0 to 0 dl 1780996937 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780996926.001654:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:64298:x1867507110323968:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 275us (749us total) trans 94489280519 rc 0/0 00000100:00100000:1.0:1780996926.001663:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 213 00010000:00010000:3.0:1780996926.185366:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996926.885537:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126787200:0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.885580:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126787072:0@lo:400:kworker.0 00000100:00100000:3.0:1780996926.885619:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996926.885619:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996926.899687:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126787456:0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.907648:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126787584:0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.907719:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996926.907755:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126788096:0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.907778:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996926.907800:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126788608:0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.907822:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996926.907874:0:79658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126787072 00000100:00100000:1.0:1780996926.907883:0:79658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126787072 00000100:00100000:1.0:1780996926.907925:0:79658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1780996926.907933:0:79658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689896c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126787072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.909563:0:79658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689896c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126787072:12345-0@lo:400:kworker.0 Request processed in 1623us (23936us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996926.909578:0:79658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1780996926.909633:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126787200 00000100:00100000:1.0:1780996926.909640:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126787200 00000100:00100000:1.0:1780996926.909685:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126787584 00000100:00100000:1.0:1780996926.909688:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126787584 00000100:00100000:1.0:1780996926.909707:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126788096 00000100:00100000:1.0:1780996926.909710:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126788096 00000100:00100000:1.0:1780996926.909719:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126788608 00000100:00100000:1.0:1780996926.909721:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126788608 00000100:00100000:1.0:1780996926.909734:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1780996926.909740:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126787200:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780996926.909759:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bb525c00 x1867507126787200/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:257/0 lens 224/224 e 0 to 0 dl 1780996937 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780996926.909796:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126787200:12345-0@lo:400:kworker.0 Request processed in 57us (24179us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996926.909803:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1780996926.909815:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1780996926.909820:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126787584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.909847:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126787584:12345-0@lo:400:kworker.0 Request processed in 26us (2129us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996926.909853:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1780996926.909864:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1780996926.909870:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126788096:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780996926.909880:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc63b800 x1867507126788096/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:257/0 lens 224/224 e 0 to 0 dl 1780996937 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780996926.909914:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126788096:12345-0@lo:400:kworker.0 Request processed in 44us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996926.909920:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1780996926.909932:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1780996926.909938:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126788608:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780996926.909949:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc639f80 x1867507126788608/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:257/0 lens 224/224 e 0 to 0 dl 1780996937 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780996926.909986:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126788608:12345-0@lo:400:kworker.0 Request processed in 39us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996926.909992:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00080000:1.0:1780996926.910029:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780996926.910033:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780996926.910065:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126787072:0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.910082:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126787584:0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.910092:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126788096:0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.910100:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126788608:0@lo:400:kworker.0 00000100:00100000:3.0:1780996926.913878:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126787200:0@lo:400:kworker.0 00000100:00100000:3.0:1780996926.913894:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126787712:0@lo:400:kworker.0 00000100:00100000:3.0:1780996926.913962:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996926.913998:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126788224:0@lo:400:kworker.0 00000100:00100000:3.0:1780996926.914031:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996926.914117:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126787712 00000100:00100000:3.0:1780996926.914123:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126787712 00000100:00100000:3.0:1780996926.914160:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126788224 00000100:00100000:3.0:1780996926.914162:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126788224 00000100:00100000:3.0:1780996926.914180:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:3.0:1780996926.914187:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126787712:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1780996926.914216:0:8242:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bb526d80 x1867507126787712/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:257/0 lens 224/224 e 0 to 0 dl 1780996937 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780996926.914253:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126787712:12345-0@lo:400:kworker.0 Request processed in 66us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996926.914260:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00000100:00100000:3.0:1780996926.914293:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:3.0:1780996926.914300:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126788224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996926.914329:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126788224:12345-0@lo:400:kworker.0 Request processed in 30us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996926.914335:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000100:00100000:3.0:1780996926.914361:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126787712:0@lo:400:kworker.0 00000100:00100000:3.0:1780996926.914370:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126788224:0@lo:400:kworker.0 00000100:00100000:2.0:1780996926.914688:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996926.914764:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126787968:0@lo:400:kworker.0 00000100:00100000:2.0:1780996926.914795:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996926.914825:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126788480:0@lo:400:kworker.0 00000100:00100000:2.0:1780996926.914846:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996926.914869:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1780996926.914876:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126787328:0@lo:400:kworker.0 00000100:00100000:2.0:1780996926.914900:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996926.914946:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126787968 00000100:00100000:3.0:1780996926.914950:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126787968 00000100:00100000:3.0:1780996926.914987:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126788480 00000100:00100000:3.0:1780996926.914989:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126788480 00000100:00100000:3.0:1780996926.915031:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402 00000100:00100000:3.0:1780996926.915038:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126787968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996926.915072:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126787968:12345-0@lo:400:kworker.0 Request processed in 36us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996926.915078:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402 00000100:00100000:3.0:1780996926.915096:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403 00000100:00100000:3.0:1780996926.915101:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126788480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996926.915137:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126788480:12345-0@lo:400:kworker.0 Request processed in 36us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996926.915142:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403 00000100:00100000:2.0:1780996926.920616:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126787840:0@lo:400:kworker.0 00000100:00100000:2.0:1780996926.920678:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996926.920706:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126787840 00000100:00100000:2.0:1780996926.920714:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126787840 00000100:00100000:2.0:1780996926.920760:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404 00000100:00100000:2.0:1780996926.920769:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126787840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996926.920819:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126787840:12345-0@lo:400:kworker.0 Request processed in 51us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996926.920826:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404 00000100:00100000:2.0:1780996926.920878:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126787840:0@lo:400:kworker.0 00000100:00100000:2.0:1780996926.920887:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126788352:0@lo:400:kworker.0 00000100:00100000:2.0:1780996926.920909:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996926.920936:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126787968:0@lo:400:kworker.0 00000100:00100000:2.0:1780996926.920962:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126788480:0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.921786:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126787456 00000100:00100000:1.0:1780996926.921793:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126787456 00000100:00100000:1.0:1780996926.921840:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126787328 00000100:00100000:1.0:1780996926.921844:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126787328 00000100:00100000:1.0:1780996926.921867:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1780996926.921875:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126787456:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780996926.921892:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bff6d880 x1867507126787456/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:257/0 lens 224/224 e 0 to 0 dl 1780996937 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780996926.921963:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126787456:12345-0@lo:400:kworker.0 Request processed in 89us (7274us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996926.921970:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1780996926.921996:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1780996926.922002:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126787328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.922045:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126787328:12345-0@lo:400:kworker.0 Request processed in 43us (7143us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996926.922050:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00080000:1.0:1780996926.922070:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780996926.922074:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780996926.922076:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780996926.922085:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126788352 00000100:00100000:1.0:1780996926.922088:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126788352 00000100:00100000:1.0:1780996926.922130:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405 00000100:00100000:1.0:1780996926.922137:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126788352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.922168:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126788352:12345-0@lo:400:kworker.0 Request processed in 32us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996926.922173:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405 00000100:00080000:1.0:1780996926.922189:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996926.922218:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126787328:0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.922227:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126788352:0@lo:400:kworker.0 00000100:00100000:1.0:1780996926.922237:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126787456:0@lo:400:kworker.0 00010000:00010000:1.0:1780996927.205355:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780996927.251506:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996927.251546:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996927.251571:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996927.251597:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996927.251622:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996927.251652:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110324608 00000100:00100000:0.0:1780996927.251663:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110324608 00000100:00100000:0.0:1780996927.251719:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110324480 00000100:00100000:0.0:1780996927.251722:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110324480 00000100:00100000:0.0:1780996927.251745:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2406 00000100:00100000:0.0:1780996927.251755:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110324608:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996927.251831:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110324608:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 78us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996927.251838:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2406 00000100:00100000:0.0:1780996927.251858:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2407 00000100:00100000:0.0:1780996927.251864:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110324480:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996927.251889:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110324480:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996927.251895:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2407 00000100:00100000:1.0:1780996927.252040:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110324352 00000100:00100000:1.0:1780996927.252046:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110324352 00000100:00100000:1.0:1780996927.252096:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110324224 00000100:00100000:1.0:1780996927.252100:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110324224 00000100:00100000:1.0:1780996927.252123:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1045 00000100:00100000:1.0:1780996927.252130:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110324352:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996927.252159:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110324352:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996927.252165:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1045 00000100:00100000:1.0:1780996927.252177:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1046 00000100:00100000:1.0:1780996927.252182:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2395:x1867507110324224:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000080:1.0:1780996927.252201:0:63419:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a6795180 x1867507110324224/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:258/0 lens 224/224 e 0 to 0 dl 1780996938 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780996927.252224:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2395:x1867507110324224:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 42us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996927.252230:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1046 00000100:00080000:1.0:1780996927.252246:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780996927.252250:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780996927.252253:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780996927.252256:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780996927.252664:0:79654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110324096 00000100:00100000:3.0:1780996927.252670:0:79654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110324096 00000100:00100000:3.0:1780996927.252709:0:79654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:3.0:1780996927.252716:0:79654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689896c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110324096:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996927.252744:0:79654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689896c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110324096:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996927.252750:0:79654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:2.0:1780996927.398369:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780996927.398388:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126788736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780996927.398463:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996927.398509:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126788736 00000100:00100000:2.0:1780996927.398515:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126788736 00000100:00100000:2.0:1780996927.398558:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:2.0:1780996927.398566:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126788736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780996927.398586:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996927.398629:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126788736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996927.398636:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:2.0:1780996927.398684:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126788736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780996927.398832:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780996927.398841:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126788864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780996927.398867:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996927.399082:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126788864 00000100:00100000:2.0:1780996927.399087:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126788864 00000100:00100000:2.0:1780996927.399115:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:2.0:1780996927.399121:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126788864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780996927.399131:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996927.399168:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126788864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996927.399174:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00100000:1.0:1780996927.399229:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126788864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780996927.915531:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780996927.915556:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126788992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780996927.915624:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996927.918798:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126788992 00000100:00100000:3.0:1780996927.918817:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126788992 00000100:00100000:3.0:1780996927.918883:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:3.0:1780996927.918892:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126788992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780996927.918930:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00010000:00000080:3.0:1780996927.918945:0:8242:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b78c1f80 x1867507126788992/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:258/0 lens 224/368 e 0 to 0 dl 1780996938 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780996927.919042:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126788992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (3417us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996927.919049:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:1.0:1780996927.919219:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126788992:0@lo:41:osp-pre-0-1.0 00000020:01000004:3.0:1780996928.062559:0:80856:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1780996928.062613:0:80856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c9400/0x30fd811c03059023 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305902a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996928.062628:0:80856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c9400/0x30fd811c03059023 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305902a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996928.062649:0:80856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c9400/0x30fd811c03059023 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305902a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996928.062657:0:80856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689a56c9400/0x30fd811c03059023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305902a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996928.062684:0:80856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1780996928.062690:0:80856:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1780996928.062718:0:80856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1780996928.062722:0:80856:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1780996928.062728:0:80856:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1780996928.062753:0:80856:0:(import.c:65:import_set_state_nolock()) ffff9689886b2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1780996928.062816:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126789120:0@lo:39:umount.0 00000100:00100000:1.0:1780996928.062885:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780996928.062963:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780996928.066106:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689a56c9400/0x30fd811c03059023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305902a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.066140:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9400 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:0.0:1780996928.066146:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c9400/0x30fd811c03059023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305902a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.066156:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689a56c9400/0x30fd811c03059023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305902a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996928.066163:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c9400/0x30fd811c03059023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305902a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996928.066169:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1780996928.066172:0:14480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1780996928.066176:0:14480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1780996928.066215:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689a56c9400/0x30fd811c03059023 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305902a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.066221:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780996928.066247:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689a56c9400/0x30fd811c03059023 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305902a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.066254:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689a56c9400/0x30fd811c03059023 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305902a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.066285:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996928.066288:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996928.066290:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780996928.066304:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780996928.066324:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126789248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780996928.066390:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996928.066455:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126789248 00000100:00100000:0.0:1780996928.066461:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126789248 00000100:00100000:0.0:1780996928.066508:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1780996928.066517:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b620f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126789248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780996928.066529:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780996928.066543:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03c00/0x30fd811c0305902a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059023 expref: 23 pid: 79653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.066555:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780996928.066590:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b620f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3497:x1867507126789248:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996928.066597:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1780996928.066672:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126789248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780996928.070170:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126789120 00000100:00100000:0.0:1780996928.070186:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126789120 00000100:00100000:0.0:1780996928.070241:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:0.0:1780996928.070250:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1867507126789120:12345-0@lo:39:umount.0 00000020:00000080:0.0:1780996928.070304:0:63584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059142 00000100:00080000:0.0:1780996928.070313:0:63584:0:(import.c:65:import_set_state_nolock()) ffff9689b11bd000 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1780996928.070343:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9688895faa00 x1867507126789120/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:259/0 lens 224/224 e 0 to 0 dl 1780996939 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1780996928.070556:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780996928.070883:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3495:x1867507126789120:12345-0@lo:39:umount.0 Request processed in 634us (7997us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996928.070891:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000020:00000080:0.0:1780996928.070901:0:63584:0:(genops.c:906:class_export_put()) final put ffff9689b11bb800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1780996928.071151:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b11bb800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1780996928.071200:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689b11bd000 for lustre-MDT0000 00000100:00080000:1.0:1780996928.071467:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689886b2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1780996928.071519:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126789120:0@lo:39:umount.0 00000100:00080000:3.0:1780996928.073222:0:80856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1780996928.073230:0:80856:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1780996928.073237:0:80856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1780996928.074880:0:80856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c03058f43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03058f4a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996928.074897:0:80856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c03058f43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03058f4a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996928.074905:0:80856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c03058f43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03058f4a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996928.074912:0:80856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c03058f43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03058f4a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996928.075220:0:80856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780996928.075226:0:80856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6dbc00/0x30fd811c03059046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305904d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996928.075232:0:80856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6dbc00/0x30fd811c03059046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305904d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996928.075238:0:80856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6dbc00/0x30fd811c03059046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305904d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996928.075243:0:80856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff96898d6dbc00/0x30fd811c03059046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305904d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.082198:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780996928.082213:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c03058f43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03058f4a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.082246:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db200 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:0.0:1780996928.082250:0:6339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c03058f43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03058f4a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.082259:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c03058f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c03058f4a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996928.082266:0:6339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c03058f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c03058f4a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996928.082567:0:80856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780996928.082708:0:80856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3400/0x30fd811c03059015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305901c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.082718:0:80856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3400/0x30fd811c03059015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305901c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.082737:0:80856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3400/0x30fd811c03059015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305901c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.082743:0:80856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3400/0x30fd811c03059015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305901c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.082765:0:80856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780996928.082772:0:80856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6da200/0x30fd811c03058f35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03058f3c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.082778:0:80856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6da200/0x30fd811c03058f35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03058f3c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.082784:0:80856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6da200/0x30fd811c03058f35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03058f3c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.082790:0:80856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff96898d6da200/0x30fd811c03058f35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03058f3c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.082805:0:80856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1780996928.082808:0:80856:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1780996928.082846:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780996928.082851:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff96898d6dbc00/0x30fd811c03059046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305904d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.082858:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dbc00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780996928.082861:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff96898d6dbc00/0x30fd811c03059046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305904d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.082878:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96898d6dbc00/0x30fd811c03059046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305904d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780996928.082884:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96898d6dbc00/0x30fd811c03059046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305904d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780996928.082890:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1780996928.082892:0:6340:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1780996928.082894:0:6340:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1780996928.082929:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff96898d6dbc00/0x30fd811c03059046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305904d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.082950:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780996928.082981:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff96898d6dbc00/0x30fd811c03059046 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305904d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.082988:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96898d6dbc00/0x30fd811c03059046 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305904d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.083001:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780996928.083004:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3400/0x30fd811c03059015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305901c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.083018:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3400 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780996928.083021:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3400/0x30fd811c03059015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305901c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.083027:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3400/0x30fd811c03059015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305901c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780996928.083043:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3400/0x30fd811c03059015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305901c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780996928.083049:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1780996928.083051:0:6340:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1780996928.083053:0:6340:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1780996928.083068:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3400/0x30fd811c03059015 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305901c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.083073:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780996928.083086:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3400/0x30fd811c03059015 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305901c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.083092:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3400/0x30fd811c03059015 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305901c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.083100:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780996928.083104:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff96898d6da200/0x30fd811c03058f35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03058f3c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.083109:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6da200 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780996928.083112:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff96898d6da200/0x30fd811c03058f35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03058f3c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.083118:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96898d6da200/0x30fd811c03058f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c03058f3c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780996928.083124:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96898d6da200/0x30fd811c03058f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c03058f3c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780996928.083139:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1780996928.083141:0:6340:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1780996928.083143:0:6340:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1780996928.083158:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff96898d6da200/0x30fd811c03058f35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03058f3c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.083164:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780996928.083170:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff96898d6da200/0x30fd811c03058f35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03058f3c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.083176:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96898d6da200/0x30fd811c03058f35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03058f3c expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996928.083187:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996928.083189:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996928.083191:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996928.083202:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780996928.083220:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126789376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780996928.083307:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1780996928.083361:0:80856:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1780996928.083366:0:80856:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1780996928.083370:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1780996928.083376:0:80856:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1780996928.084127:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996928.084141:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126789504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780996928.084180:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996928.084215:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780996928.084221:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126789632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780996928.084243:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996928.084297:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126789376 00000100:00100000:1.0:1780996928.084304:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126789376 00000100:00100000:1.0:1780996928.084350:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126789504 00000100:00100000:1.0:1780996928.084354:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126789504 00000100:00100000:1.0:1780996928.084370:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126789632 00000100:00100000:1.0:1780996928.084372:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126789632 00000100:00100000:1.0:1780996928.084390:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1780996928.084398:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+24:3496:x1867507126789376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780996928.084411:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780996928.084427:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02400/0x30fd811c0305904d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059046 expref: 24 pid: 79654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996928.084442:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780996928.084479:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126789376:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996928.084486:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1780996928.084503:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1780996928.084510:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3498:x1867507126789504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780996928.084517:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780996928.084536:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb3c00/0x30fd811c0305901c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059015 expref: 22 pid: 79653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996928.084546:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780996928.084573:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3498:x1867507126789504:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996928.084579:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1780996928.084592:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1780996928.084598:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3498:x1867507126789632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780996928.084605:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780996928.084613:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03200/0x30fd811c03058f3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03058f35 expref: 20 pid: 79658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996928.084621:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780996928.084641:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3498:x1867507126789632:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996928.084647:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1780996928.084690:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126789632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780996928.084699:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126789504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780996928.084730:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126789376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780996928.085120:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1780996928.085418:0:6339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1780996928.085421:0:6339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1780996928.085423:0:6339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1780996928.085451:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c03058f43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03058f4a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.085458:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780996928.085477:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c03058f43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03058f4a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.085484:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c03058f43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03058f4a expref: -99 pid: 79647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.085494:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996928.085496:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996928.085497:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780996928.085504:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780996928.085515:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126789760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780996928.085553:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996928.086091:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126789760 00000100:00100000:3.0:1780996928.086098:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126789760 00000100:00100000:3.0:1780996928.086148:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:3.0:1780996928.086157:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb576d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3497:x1867507126789760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780996928.086168:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780996928.086180:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c8e00/0x30fd811c03058f4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03058f43 expref: 19 pid: 79654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996928.086194:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780996928.086230:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb576d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3497:x1867507126789760:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996928.086238:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1780996928.086599:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126789760:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1780996928.090926:0:80856:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:0.0:1780996928.093939:0:79648:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00000020:00000080:2.0:1780996928.094316:0:80856:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1780996928.094328:0:80856:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689891ac800 285c134c-d3a6-4c01-bb4d-8148c50d5f95 192.168.206.51@tcp 5 (0 0 0) 0 0 0 1: ffff9689ae587000 94489280519 stale:0 00000020:00080000:2.0:1780996928.094335:0:80856:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689bd36c000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780996928.094340:0:80856:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff96898d684000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780996928.094352:0:80856:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689b79c9000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780996928.094356:0:80856:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689bc968800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780996928.094360:0:80856:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff968990fe4d40) has exports, disconnecting them 00000020:00080000:2.0:1780996928.094365:0:80856:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.206.51@tcp (ffff9689891ac800), last request at 1780996927 00000020:00000080:2.0:1780996928.094372:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059310 00000100:00080000:2.0:1780996928.094382:0:80856:0:(import.c:65:import_set_state_nolock()) ffff9689891ad000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780996928.094412:0:80856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.206.51@tcp (ffff9689891ac800): rc 0 00000020:00080000:2.0:1780996928.094416:0:80856:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689bd36c000), last request at 1780996714 00000020:00000080:2.0:1780996928.094419:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305913b 00000100:00080000:2.0:1780996928.094423:0:80856:0:(import.c:65:import_set_state_nolock()) ffff9689bca5b800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780996928.094432:0:80856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bd36c000): rc 0 00000020:00000080:2.0:1780996928.094434:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689bd36c000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:0.0:1780996928.094439:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1780996928.094444:0:80856:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96898d684000), last request at 1780996926 00000020:00000080:2.0:1780996928.094446:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059134 00000020:00000080:0.0:1780996928.094449:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bd36c000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00080000:2.0:1780996928.094450:0:80856:0:(import.c:65:import_set_state_nolock()) ffff96898d685000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780996928.094457:0:80856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96898d684000): rc 0 00000020:00000080:2.0:1780996928.094459:0:80856:0:(genops.c:906:class_export_put()) final put ffff96898d684000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1780996928.094540:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996928.096113:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996928.096131:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996928.096140:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996928.096162:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780996928.096166:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996928.096174:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996928.096194:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff968983653800) 00010000:00010000:1.0:1780996928.096197:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780996928.096202:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593fe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996928.096209:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c030593fe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1780996928.096230:0:3482:0:(genops.c:906:class_export_put()) final put ffff9689891ac800/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00080000:2.0:1780996928.098320:0:80856:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689b79c9000), last request at 1780996926 00000020:00000080:2.0:1780996928.098333:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305912d 00000100:00080000:2.0:1780996928.098354:0:80856:0:(import.c:65:import_set_state_nolock()) ffff9689b79cd800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780996928.098454:0:80856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689b79c9000): rc 0 00000020:00000080:2.0:1780996928.098457:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689b79c9000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1780996928.098462:0:80856:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689bc968800), last request at 1780996709 00000020:00000080:2.0:1780996928.098465:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058f97 00000100:00080000:2.0:1780996928.098474:0:80856:0:(import.c:65:import_set_state_nolock()) ffff9689bcd79000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1780996928.098516:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780996928.098736:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bca5b800 for lustre-MDT0000 00000020:00000080:0.0:1780996928.098745:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96898d684000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1780996928.098784:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b79c9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1780996928.098804:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96898d685000 for lustre-MDT0000 00000020:00000080:0.0:1780996928.098809:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689b79cd800 for lustre-MDT0000 00000020:00000080:1.0:1780996928.104366:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689891ac800/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-MDT0000 00000020:00000080:1.0:1780996928.104428:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689891ad000 for lustre-MDT0000 00000020:00080000:2.0:1780996928.104468:0:80856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bc968800): rc 0 00000020:00000080:2.0:1780996928.104472:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689bc968800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:2.0:1780996928.104505:0:80856:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa8c8c16bfae0 00000100:00080000:2.0:1780996928.104528:0:80856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780996928.104532:0:80856:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378728 gen 3 00000100:00080000:2.0:1780996928.105513:0:80856:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1780996928.105546:0:80856:0:(import.c:65:import_set_state_nolock()) ffff9689a67f3000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:1.0:1780996928.105709:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc968800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1780996928.105748:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bcd79000 for lustre-MDT0000 00000100:00100000:1.0:1780996928.105770:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126789888:0@lo:39:umount.0 00000100:00100000:1.0:1780996928.105837:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996928.105874:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126789888 00000100:00100000:1.0:1780996928.105882:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126789888 00000100:00100000:1.0:1780996928.105950:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:1.0:1780996928.105961:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126789888:12345-0@lo:39:umount.0 00000020:00000080:1.0:1780996928.106125:0:8241:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058fd6 00000100:00080000:1.0:1780996928.106135:0:8241:0:(import.c:65:import_set_state_nolock()) ffff9689bcc16800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1780996928.112592:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996928.114438:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780996928.115117:0:80856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780996928.115123:0:80856:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 3 00000004:00080000:2.0:1780996928.115149:0:80856:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:2.0:1780996928.115214:0:80856:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1780996928.115248:0:80856:0:(import.c:65:import_set_state_nolock()) ffff96898616c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1780996928.115295:0:80856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780996928.115297:0:80856:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 3 00000004:00080000:2.0:1780996928.115307:0:80856:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:2.0:1780996928.115379:0:80856:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1780996928.115388:0:80856:0:(import.c:65:import_set_state_nolock()) ffff968990f70800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1780996928.115429:0:80856:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff968990fe4d40) has no exports 00000100:00100000:3.0:1780996928.115510:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126790016:0@lo:9:umount.0 00000100:00100000:3.0:1780996928.115577:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996928.115618:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126790144:0@lo:9:umount.0 00000100:00100000:3.0:1780996928.115640:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996928.115768:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126790016 00000100:00100000:2.0:1780996928.115776:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126790016 00000100:00100000:2.0:1780996928.115832:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126790144 00000100:00100000:2.0:1780996928.115835:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126790144 00000100:00100000:2.0:1780996928.115856:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5896 00000100:00100000:2.0:1780996928.115865:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126790016:12345-0@lo:9:umount.0 00000020:00000080:2.0:1780996928.115888:0:25179:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058ff2 00000100:00080000:2.0:1780996928.115896:0:25179:0:(import.c:65:import_set_state_nolock()) ffff9689bd36a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1780996928.115945:0:25179:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:2.0:1780996928.116101:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3495:x1867507126790016:12345-0@lo:9:umount.0 Request processed in 236us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996928.116108:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5896 00000100:00100000:2.0:1780996928.116125:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5897 00000100:00100000:2.0:1780996928.116146:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126790144:12345-0@lo:9:umount.0 00000020:00000080:2.0:1780996928.116159:0:25179:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059000 00000100:00080000:2.0:1780996928.116164:0:25179:0:(import.c:65:import_set_state_nolock()) ffff9689a5876000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1780996928.116186:0:25179:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:2.0:1780996928.116262:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3495:x1867507126790144:12345-0@lo:9:umount.0 Request processed in 117us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996928.116293:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5897 00000100:00080000:3.0:1780996928.116409:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780996928.116414:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1780996928.116425:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996928.116429:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780996928.116457:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898616c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1780996928.116471:0:3495:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:3.0:1780996928.116474:0:3495:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780996928.116478:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126790016:0@lo:9:umount.0 00000100:00080000:3.0:1780996928.116490:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968990f70800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1780996928.116502:0:3495:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:3.0:1780996928.116504:0:3495:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780996928.116507:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126790144:0@lo:9:umount.0 00000020:00080000:3.0:1780996928.118957:0:80856:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff968990fe4d40) has no exports 00010000:00010000:0.0:1780996928.121385:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1780996928.121405:0:8241:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378728 00000100:00100000:1.0:1780996928.121666:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3495:x1867507126789888:12345-0@lo:39:umount.0 Request processed in 15702us (15823us total) trans 81604378729 rc 0/0 00000100:00100000:1.0:1780996928.121679:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00080000:2.0:1780996928.127231:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689a67f3000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1780996928.127249:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126789888:0@lo:39:umount.0 00000020:00000080:3.0:1780996928.192554:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058fac 00000020:00000080:3.0:1780996928.192573:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689bb5a3800/lustre-QMT0000_UUID 00000020:01000000:3.0:1780996928.192645:0:80856:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1780996928.194748:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bb5a3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1780996928.194902:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780996928.194917:0:80856:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1780996928.194923:0:80856:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff968886bd99c0) has no exports 00000020:00000080:0.0:1780996928.195494:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058fa5 00000020:00000080:0.0:1780996928.195504:0:80856:0:(genops.c:906:class_export_put()) final put ffff9688858f0000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780996928.195560:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9688858f0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780996928.195626:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780996928.195635:0:80856:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1780996928.195638:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689bca5e800/lustre-QMT0000_UUID 00000020:00000080:0.0:1780996928.195640:0:80856:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bca5e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1780996928.195648:0:80856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1780996928.195776:0:80856:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968887c77c60 - data ffff9689aee5ca20/ffff968886ebb800 00000020:01000000:0.0:1780996928.195912:0:80856:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9689bb20eae0 - data ffff9689aef60000/ffff9688858b4800 00010000:00010000:0.0:1780996928.246467:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780996928.268934:0:80856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780996928.268944:0:80856:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378728 gen 4 00000100:00100000:2.0:1780996928.268959:0:80856:0:(client.c:3169:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9689b78c1880 x1867507126789888/t81604378729(81604378729) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780996938 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996928.268984:0:80856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1780996928.270457:0:80856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780996928.270464:0:80856:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 4 00000004:00080000:2.0:1780996928.270483:0:80856:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780996928.270486:0:80856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1780996928.271161:0:79665:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1780996928.271167:0:79665:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x58:0x0] index 2 count 1 00000040:00080000:0.0:1780996928.271177:0:79665:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 22 count 2 00000100:00080000:2.0:1780996928.274464:0:80856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780996928.274474:0:80856:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 4 00000004:00080000:2.0:1780996928.274499:0:80856:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780996928.274502:0:80856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1780996928.274762:0:79667:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1780996928.274767:0:79667:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5a:0x0] index 1 count 1 00000040:00080000:3.0:1780996928.274779:0:79667:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 22 count 2 00000020:00000080:2.0:1780996928.276138:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058f5f 00000020:00000080:2.0:1780996928.276150:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689bcb6c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1780996928.276771:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058f74 00000020:00000080:2.0:1780996928.276777:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689bc96f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780996928.276782:0:80856:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1780996928.276788:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780996928.276809:0:80856:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1780996928.276813:0:80856:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff968990fe19c0) has no exports 00000020:00000080:0.0:1780996928.277299:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcb6c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780996928.277311:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1780996928.277739:0:80856:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1780996928.277751:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058ff9 00000020:00000080:2.0:1780996928.277756:0:80856:0:(genops.c:906:class_export_put()) final put ffff96898d685800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780996928.277763:0:80856:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1780996928.277768:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780996928.277774:0:80856:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780996928.277778:0:80856:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff968886bdcd40) has no exports 00000020:00000080:2.0:1780996928.277784:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058feb 00000020:00000080:2.0:1780996928.277787:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689bcdf8800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1780996928.278148:0:80856:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1780996928.278153:0:80856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780996928.278158:0:80856:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 5 00000004:00080000:2.0:1780996928.278165:0:80856:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780996928.278168:0:80856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780996928.278197:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780996928.278203:0:80856:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780996928.278207:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058fdd 00000020:00000080:2.0:1780996928.278212:0:80856:0:(genops.c:906:class_export_put()) final put ffff96888969a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780996928.278216:0:80856:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1780996928.278219:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780996928.278222:0:80856:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780996928.278224:0:80856:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9689bfb3b380) has no exports 00000020:00000080:2.0:1780996928.278228:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058fcf 00000020:00000080:2.0:1780996928.278230:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689bc9e0000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1780996928.278562:0:80856:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1780996928.278566:0:80856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780996928.278568:0:80856:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 5 00000004:00080000:2.0:1780996928.278572:0:80856:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780996928.278573:0:80856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780996928.278597:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780996928.278611:0:80856:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1780996928.278622:0:80856:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1780996928.278627:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058fc1 00000020:00000080:2.0:1780996928.278631:0:80856:0:(genops.c:906:class_export_put()) final put ffff96888969d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780996928.278635:0:80856:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1780996928.278638:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780996928.278642:0:80856:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780996928.278644:0:80856:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff968886bd8000) has no exports 00000020:00000080:2.0:1780996928.278649:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058fba 00000020:00000080:2.0:1780996928.278652:0:80856:0:(genops.c:906:class_export_put()) final put ffff96888969d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780996928.279441:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96898d685800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780996928.279453:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcdf8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780996928.279458:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968990f70800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780996928.279463:0:38:0:(genops.c:906:class_export_put()) final put ffff96888969f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780996928.279465:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96888969f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1780996928.279470:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780996928.279558:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96888969a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780996928.279563:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc9e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780996928.279567:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96898616c000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780996928.279571:0:38:0:(genops.c:906:class_export_put()) final put ffff968889698000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780996928.279573:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff968889698000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1780996928.279576:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780996928.279609:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96888969d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1780996928.279614:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96888969d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1780996928.374443:0:80856:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1780996928.374451:0:80856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780996928.374456:0:80856:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378728 gen 5 00000100:00100000:2.0:1780996928.374465:0:80856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780996928.374554:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780996928.374566:0:80856:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780996928.374594:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780996928.374597:0:80856:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780996928.374603:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689a67f1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780996928.374608:0:80856:0:(genops.c:865:class_export_destroy()) destroying export ffff9689a67f1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1780996928.374625:0:80856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780996928.374731:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058f7b 00000020:00000080:2.0:1780996928.374738:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689bc96a800/lustre-MDD0000_UUID 00000020:00000080:0.0:1780996928.374764:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689a67f3000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1780996928.374771:0:38:0:(genops.c:906:class_export_put()) final put ffff968889699800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780996928.374773:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff968889699800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1780996928.374779:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1780996928.382350:0:80856:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1780996928.382367:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780996928.382379:0:80856:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1780996928.382384:0:80856:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9689bfb38000) has no exports 00000020:00000080:2.0:1780996928.382425:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780996928.382431:0:80856:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1780996928.382438:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058f82 00000020:00000080:2.0:1780996928.382446:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689bc96e000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1780996928.382454:0:80856:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96888b411000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1780996928.382471:0:80856:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96888b411000 3 00000020:01000004:2.0:1780996928.382475:0:80856:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96888b411000 from lustre-MDT0000 00000020:00000080:2.0:1780996928.382494:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780996928.382499:0:80856:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1780996928.382501:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689bcb6b000/lustre-MDT0000_UUID 00000020:00000080:2.0:1780996928.382504:0:80856:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcb6b000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1780996928.382515:0:80856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1780996928.382593:0:80856:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1780996928.382597:0:80856:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1780996928.382600:0:80856:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1780996928.382603:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780996928.382606:0:80856:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1780996928.382615:0:80856:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9689ba419000 5bc603cc-b633-43af-a003-872c004686c8 192.168.206.51@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780996928.382621:0:80856:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9689bcc11800 bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780996928.382625:0:80856:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff96888ac54d40) has exports, disconnecting them 00000020:00080000:2.0:1780996928.382629:0:80856:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.206.51@tcp (ffff9689ba419000), last request at 1780996712 00000020:00000080:2.0:1780996928.382649:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305910a 00000020:00010000:2.0:1780996928.382653:0:80856:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689ba419000: total 2 00000100:00080000:2.0:1780996928.382658:0:80856:0:(import.c:65:import_set_state_nolock()) ffff9689ba41c800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780996928.382675:0:80856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.206.51@tcp (ffff9689ba419000): rc 0 00000020:00080000:2.0:1780996928.382678:0:80856:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9689bcc11800), last request at 1780996709 00000020:00000080:2.0:1780996928.382726:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058f27 00000020:00010000:2.0:1780996928.382729:0:80856:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689bcc11800: total 2 00000100:00080000:2.0:1780996928.382732:0:80856:0:(import.c:65:import_set_state_nolock()) ffff9689bcc11000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780996928.382740:0:80856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bcc11800): rc 0 00000020:00080000:2.0:1780996928.382743:0:80856:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff96888ac54d40) has no exports 00000020:00000080:0.0:1780996928.382975:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1780996928.382981:0:38:0:(genops.c:906:class_export_put()) final put ffff9689bc9e1000/lustre-MDD0000_UUID 00000020:00000080:0.0:1780996928.382984:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc9e1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1780996928.382987:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1780996928.383028:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1780996928.383059:0:79653:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9689b10d2c00:79653] 0 exiting: rc = 1 00000100:00100000:0.0:1780996928.383171:0:79658:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff968990fa2c00:79658] 3 exiting: rc = 0 00000100:00100000:0.0:1780996928.383249:0:79655:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9689ba1bf400:79655] 2 exiting: rc = 0 00000020:00010000:0.0:1780996928.383326:0:14480:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689ba419000: total 0 00010000:00010000:0.0:1780996928.383331:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996928.383357:0:14480:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689ba419000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1780996928.383394:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c8600/0x30fd811c03059126 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a42 expref: 5 pid: 79654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383413:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02c00/0x30fd811c03059111 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a2d expref: 4 pid: 79653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383425:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96898d6dba00/0x30fd811c0305911f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a3b expref: 3 pid: 79658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383436:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c8a00/0x30fd811c03059118 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a34 expref: 2 pid: 79654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383445:0:14480:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689ba419000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1780996928.383464:0:14480:0:(genops.c:906:class_export_put()) final put ffff9689ba419000/5bc603cc-b633-43af-a003-872c004686c8 00000020:00010000:0.0:1780996928.383473:0:14480:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689bcc11800: total 1 00010000:00010000:0.0:1780996928.383488:0:14480:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689bcc11800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1780996928.383504:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2400/0x30fd811c03059077 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059070 expref: 14 pid: 79654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383516:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96898d6dac00/0x30fd811c030590f5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030590ee expref: 13 pid: 79653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383528:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2c00/0x30fd811c03059085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305907e expref: 12 pid: 79653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383539:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c8200/0x30fd811c030590e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030590e0 expref: 11 pid: 79658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383563:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03400/0x30fd811c030590a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305909a expref: 10 pid: 79658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383573:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96898d6db400/0x30fd811c03059103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030590fc expref: 9 pid: 79658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383582:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c9e00/0x30fd811c03059093 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305908c expref: 8 pid: 79654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383593:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02800/0x30fd811c030590af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030590a8 expref: 7 pid: 79655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383602:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c9000/0x30fd811c030590bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030590b6 expref: 6 pid: 79653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383613:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2e00/0x30fd811c030590cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030590c4 expref: 5 pid: 79654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383621:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02a00/0x30fd811c0305905b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059054 expref: 4 pid: 79654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383631:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2a00/0x30fd811c030590d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030590d2 expref: 3 pid: 79653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383641:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb3200/0x30fd811c03059069 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059062 expref: 2 pid: 79654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996928.383650:0:14480:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689bcc11800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1780996928.383665:0:14480:0:(genops.c:906:class_export_put()) final put ffff9689bcc11800/bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 00010000:00010000:0.0:1780996928.383670:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996928.383677:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996928.383679:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780996928.383687:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba419000/5bc603cc-b633-43af-a003-872c004686c8 for MGS 00000020:00000080:0.0:1780996928.383710:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcc11800/bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 for MGS 00000020:00000080:0.0:1780996928.383723:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689ba41c800 for MGS 00000020:00000080:0.0:1780996928.383726:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bcc11000 for MGS 00010000:00010000:0.0:1780996928.383755:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996928.384323:0:79654:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9689ba1bfa00:79654] 1 exiting: rc = 0 00000100:00100000:0.0:1780996928.384438:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384446:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384463:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384470:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384475:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384485:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384491:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384497:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384504:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384509:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384515:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384520:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384525:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384531:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384536:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384541:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384546:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384551:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384556:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384561:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384567:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384573:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384578:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384584:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384588:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384593:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384598:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384613:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384618:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384624:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384631:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384637:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384642:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384647:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384653:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384658:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384662:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384667:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384672:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384677:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384683:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384688:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384694:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384699:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384704:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384709:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384715:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384720:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384725:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384730:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384734:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384741:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384747:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384754:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384759:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384765:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384770:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384775:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384782:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384788:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384794:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384799:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384813:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780996928.384818:0:80856:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1780996928.386817:0:80856:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968888796ea0 - data ffff9689ae122000/ffff9688891c3c00 00000020:01000000:0.0:1780996928.386926:0:80856:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968887c779c0 - data ffff9689ae2fae58/ffff9689bc111400 00000020:00000080:0.0:1780996928.388347:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058f20 00000020:00000080:0.0:1780996928.388358:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689ba673000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1780996928.388413:0:80856:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96888b411000 from MGS, refs=2 00000020:01000004:0.0:1780996928.388417:0:80856:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96888b411000 2 00000020:01000004:0.0:1780996928.388420:0:80856:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96888b411000 from MGS 00000020:00000080:0.0:1780996928.388455:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780996928.388463:0:80856:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1780996928.388466:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689ba672800/MGS 00000020:00000080:0.0:1780996928.388469:0:80856:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba672800/MGS for MGS 00000020:01000000:0.0:1780996928.388476:0:80856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1780996928.388550:0:80856:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1780996928.388554:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780996928.388559:0:80856:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1780996928.388566:0:80856:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9689bfa9f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780996928.388572:0:80856:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff96888ac50000) has exports, disconnecting them 00000020:00080000:0.0:1780996928.388576:0:80856:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9689bfa9f000), last request at 1780996709 00000020:00000080:0.0:1780996928.388580:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059038 00000020:00080000:0.0:1780996928.388589:0:80856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bfa9f000): rc 0 00000020:00000080:0.0:1780996928.388594:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689bfa9f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1780996928.388686:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba673000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1780996928.394167:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bfa9f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1780996928.427332:0:80856:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1780996928.427354:0:80856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1780996928.427358:0:80856:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1780996928.427365:0:80856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780996928.427493:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780996928.427504:0:80856:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1780996928.427511:0:80856:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96888b411000 1 00000020:00000080:2.0:1780996928.427518:0:80856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058f12 00000020:00000080:2.0:1780996928.427525:0:80856:0:(genops.c:906:class_export_put()) final put ffff9689ba676000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1780996928.427530:0:80856:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1780996928.427535:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780996928.427538:0:80856:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1780996928.427542:0:80856:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff968990fe0000) has no exports 00000020:00000080:3.0:1780996928.429754:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689886b2000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1780996928.429768:0:38:0:(genops.c:906:class_export_put()) final put ffff9689b79cb800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1780996928.429771:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b79cb800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1780996928.429782:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1780996928.429874:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba676000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1780996928.603408:0:80856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780996928.603421:0:80856:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1780996928.603427:0:80856:0:(genops.c:906:class_export_put()) final put ffff96888b416800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1780996928.603431:0:80856:0:(genops.c:865:class_export_destroy()) destroying export ffff96888b416800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1780996928.603444:0:80856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1780996928.603559:0:80856:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff96888b411800 00000020:02000400:2.0:1780996928.603635:0:80856:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1780996929.254450:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996930.278456:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996930.983174:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126790272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780996930.983241:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996930.983422:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126790400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780996930.983449:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996930.983484:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126790272 00000100:00100000:3.0:1780996930.983491:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126790272 00000100:00100000:3.0:1780996930.983540:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126790400 00000100:00100000:3.0:1780996930.983544:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126790400 00000100:00100000:3.0:1780996930.983561:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:3.0:1780996930.983569:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126790272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780996930.983597:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996930.983638:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126790272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996930.983645:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00100000:3.0:1780996930.983722:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:3.0:1780996930.983730:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126790400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780996930.983745:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996930.983781:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126790400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996930.983786:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00080000:3.0:1780996930.983806:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780996930.983809:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780996930.983845:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126790400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780996930.983873:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126790272:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1780996931.301603:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996932.005738:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126790528:0@lo:400:kworker.0 00000400:00000100:3.0:1780996932.005819:0:3499:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126790528 offset 0 length 224: 4 00000100:00100000:3.0:1780996932.005858:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126791040:0@lo:400:kworker.0 00000100:00100000:3.0:1780996932.005888:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996932.005918:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126791552:0@lo:400:kworker.0 00000100:00100000:3.0:1780996932.005938:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996932.005962:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1780996932.005968:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126790912:0@lo:400:kworker.0 00000100:00100000:3.0:1780996932.005999:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996932.006017:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126791424:0@lo:400:kworker.0 00000100:00100000:3.0:1780996932.006043:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996932.006070:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507126790656:0@lo:400:kworker.0 00000100:00100000:3.0:1780996932.006118:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996932.006137:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126791168:0@lo:400:kworker.0 00000100:00100000:3.0:1780996932.006163:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996932.006183:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1780996932.006189:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126790784:0@lo:400:kworker.0 00000100:00100000:3.0:1780996932.006211:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996932.006228:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126791296:0@lo:400:kworker.0 00000100:00100000:3.0:1780996932.006247:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996932.006298:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126791040 00000100:00100000:3.0:1780996932.006306:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126791040 00000100:00100000:3.0:1780996932.006353:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126791552 00000100:00100000:3.0:1780996932.006357:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126791552 00000100:00100000:3.0:1780996932.006366:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126790912 00000100:00100000:3.0:1780996932.006368:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126790912 00000100:00100000:3.0:1780996932.006375:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126790656 00000100:00100000:3.0:1780996932.006386:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126790656 00000100:00100000:3.0:1780996932.006396:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126790784 00000100:00100000:3.0:1780996932.006398:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126790784 00000100:00100000:3.0:1780996932.006416:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1780996932.006425:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126791040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996932.006478:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126791040:12345-0@lo:400:kworker.0 Request processed in 53us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996932.006484:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1780996932.006501:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:3.0:1780996932.006507:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126790784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996932.006537:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126790784:12345-0@lo:400:kworker.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996932.006542:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:3.0:1780996932.006555:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1780996932.006558:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3499:x1867507126791552:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1780996932.006563:0:80049:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1780996932.006585:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3499:x1867507126791552:12345-0@lo:400:kworker.0 Request processed in 26us (647us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780996932.006590:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1780996932.006599:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1780996932.006602:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3499:x1867507126790912:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1780996932.006606:0:80049:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1780996932.006627:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3499:x1867507126790912:12345-0@lo:400:kworker.0 Request processed in 23us (628us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780996932.006632:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1780996932.006642:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1780996932.006646:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3496:x1867507126790656:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1780996932.006657:0:80049:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1780996932.006679:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3496:x1867507126790656:12345-0@lo:400:kworker.0 Request processed in 32us (570us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780996932.006685:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1780996932.006709:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126791424 00000100:00100000:3.0:1780996932.006712:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126791424 00000100:00100000:3.0:1780996932.006738:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126791296 00000100:00100000:3.0:1780996932.006741:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126791296 00000100:00100000:3.0:1780996932.006761:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408 00000100:00100000:3.0:1780996932.006767:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126791424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996932.006799:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126791424:12345-0@lo:400:kworker.0 Request processed in 32us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996932.006805:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408 00000100:00100000:3.0:1780996932.006816:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409 00000100:00100000:3.0:1780996932.006822:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126791296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996932.006846:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126791296:12345-0@lo:400:kworker.0 Request processed in 25us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996932.006852:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409 00000100:00100000:3.0:1780996932.006871:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126791168 00000100:00100000:3.0:1780996932.006874:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126791168 00000100:00100000:3.0:1780996932.006892:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:3.0:1780996932.006897:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3496:x1867507126791168:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1780996932.006902:0:8242:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1780996932.006923:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3496:x1867507126791168:12345-0@lo:400:kworker.0 Request processed in 26us (759us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780996932.006929:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00080000:3.0:1780996932.006949:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780996932.006958:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780996932.006961:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996932.007011:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126790784:0@lo:400:kworker.0 00000100:00100000:3.0:1780996932.007024:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126791296:0@lo:400:kworker.0 00000100:00080000:3.0:1780996932.007034:0:3496:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780996932.007039:0:3496:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1780996932.007042:0:3496:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780996932.014398:0:3499:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780996932.014409:0:3499:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780996932.014414:0:3499:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780996932.014421:0:3499:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780996932.014445:0:3499:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3242 00000100:00080000:0.0:1780996932.014454:0:3499:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780996932.014492:0:3499:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7a4e680 x1867507126791680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780996932.014524:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126790912:0@lo:400:kworker.0 00000100:00100000:0.0:1780996932.014547:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126791424:0@lo:400:kworker.0 00000100:00100000:0.0:1780996932.014562:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126791040:0@lo:400:kworker.0 00000100:00080000:0.0:1780996932.014573:0:3499:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780996932.014576:0:3499:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780996932.014579:0:3499:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780996932.014582:0:3499:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780996932.014586:0:3499:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3242 00000100:00080000:0.0:1780996932.014590:0:3499:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780996932.014602:0:3499:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7a4f800 x1867507126791808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780996932.014613:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126791552:0@lo:400:kworker.0 00000100:00100000:2.0:1780996932.014908:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126791680:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1780996932.014969:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996932.015020:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126791808:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1780996932.015043:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996932.015092:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126791680 00000100:00100000:2.0:1780996932.015099:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126791680 00000100:00100000:2.0:1780996932.015136:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126791808 00000100:00100000:2.0:1780996932.015139:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126791808 00000100:00100000:2.0:1780996932.015158:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:2.0:1780996932.015165:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126791680:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1780996932.015184:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996932.015236:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126791680:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 69us (265us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996932.015244:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:2.0:1780996932.015262:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1780996932.015267:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126791808:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1780996932.015301:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996932.015327:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126791808:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 58us (283us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996932.015334:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00080000:2.0:1780996932.015369:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780996932.015373:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780996932.015376:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126791680:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1780996932.015386:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780996932.015389:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780996932.015392:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126791808:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1780996932.051222:0:3496:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996932.051241:0:3496:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3242 00000100:00080000:3.0:1780996932.051251:0:3496:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996932.052563:0:3496:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968986956a00 x1867507126791936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780996932.052599:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507126790656:0@lo:400:kworker.0 00000100:00080000:3.0:1780996932.052635:0:3496:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780996932.052641:0:3496:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1780996932.052644:0:3496:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1780996932.052650:0:3496:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996932.052654:0:3496:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3423 00000100:00080000:3.0:1780996932.052660:0:3496:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996932.052675:0:3496:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968986955880 x1867507126792064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780996932.052686:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126791168:0@lo:400:kworker.0 00000100:00100000:2.0:1780996932.052795:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126791936:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1780996932.052874:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996932.053091:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126791936 00000100:00100000:1.0:1780996932.053099:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126791936 00000100:00100000:1.0:1780996932.053155:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1780996932.053162:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126791936:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1780996932.053184:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780996932.053226:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126791936:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 64us (353us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780996932.053233:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00080000:2.0:1780996932.055160:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780996932.055171:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780996932.055176:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126791936:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1780996932.055186:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126792064:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1780996932.055242:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996932.055454:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126792064 00000100:00100000:1.0:1780996932.055461:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126792064 00000100:00100000:1.0:1780996932.055499:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:1.0:1780996932.055506:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126792064:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1780996932.055526:0:23042:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780996932.055577:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126792064:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 70us (335us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780996932.055584:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00080000:3.0:1780996932.055653:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780996932.055672:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780996932.055675:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126792064:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1780996932.325628:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996932.362245:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996932.362338:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:3.0:1780996932.362359:0:3489:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110324736 offset 0 length 224: 4 00000100:00100000:3.0:1780996932.362374:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996932.362408:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996932.362437:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110325120 00000100:00100000:3.0:1780996932.362447:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110325120 00000100:00100000:3.0:1780996932.362501:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110325248 00000100:00100000:3.0:1780996932.362504:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110325248 00000100:00100000:3.0:1780996932.362524:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2410 00000100:00100000:3.0:1780996932.362533:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110325120:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996932.362594:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110325120:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 63us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996932.362602:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2410 00000100:00100000:3.0:1780996932.362617:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2411 00000100:00100000:3.0:1780996932.362622:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110325248:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996932.362643:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110325248:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 21us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996932.362649:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2411 00000100:00080000:3.0:1780996932.362664:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780996932.362668:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996932.362741:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110324864 00000100:00100000:1.0:1780996932.362746:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110324864 00000100:00100000:1.0:1780996932.362780:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110324992 00000100:00100000:1.0:1780996932.362784:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110324992 00000100:00100000:1.0:1780996932.362814:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1049 00000100:00100000:1.0:1780996932.362835:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110324992:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996932.362866:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110324992:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996932.362873:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1049 00000100:00100000:1.0:1780996932.362887:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1046 00000100:00100000:1.0:1780996932.362892:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1867507110324864:12345-192.168.206.51@tcp:400:kworker.0 00000020:00080000:1.0:1780996932.362897:0:65272:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.206.51@tcp 00000100:00100000:1.0:1780996932.362920:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1867507110324864:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (684us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780996932.362927:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1046 00000100:00080000:1.0:1780996932.362941:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996932.370703:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996932.370979:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110325376 00000100:00100000:1.0:1780996932.370999:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110325376 00000100:00100000:1.0:1780996932.371050:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1047 00000100:00100000:1.0:1780996932.371058:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110325376:12345-192.168.206.51@tcp:38:ptlrpcd_01_00.0 00010000:00020000:1.0:1780996932.371083:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780996932.371155:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110325376:12345-192.168.206.51@tcp:38:ptlrpcd_01_00.0 Request processed in 96us (462us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780996932.371163:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1047 00010000:00010000:0.0:1780996933.354471:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1780996933.548472:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1780996933.548578:0:72364:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378729 is committed 00000020:00000080:2.0:1780996933.548585:0:72364:0:(genops.c:906:class_export_put()) final put ffff9689bcc12000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780996933.548774:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcc12000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:3.0:1780996933.554096:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1780996933.554106:0:8226:0:(genops.c:906:class_export_put()) final put ffff9689bcc14000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780996933.554354:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bcc16800 for lustre-MDT0001 00000020:00000080:1.0:1780996933.554364:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcc14000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:2.0:1780996933.554491:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780996933.554496:0:9294:0:(genops.c:906:class_export_put()) final put ffff96898616d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780996933.554564:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bd36a800 for lustre-OST0000 00000020:00000080:1.0:1780996933.554663:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96898616d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1780996933.554806:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689a5876000 for lustre-OST0001 00010000:00010000:0.0:1780996934.373964:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996935.398351:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996936.102083:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780996936.102108:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126792192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780996936.102198:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996936.102354:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126792192 00000100:00100000:0.0:1780996936.102363:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126792192 00000100:00100000:0.0:1780996936.102423:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:0.0:1780996936.102434:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126792192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780996936.102481:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780996936.102524:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126792192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996936.102531:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00080000:1.0:1780996936.102824:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780996936.102837:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126792320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780996936.102868:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996936.102916:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126792192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780996936.103050:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126792320 00000100:00100000:3.0:1780996936.103055:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126792320 00000100:00100000:3.0:1780996936.103097:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:3.0:1780996936.103104:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126792320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780996936.103120:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996936.103164:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126792320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996936.103170:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00080000:1.0:1780996936.104021:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996936.104055:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126792320:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1780996936.422166:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780996937.125542:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780996937.125548:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780996937.125552:0:38:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780996937.125560:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3459 00000100:00080000:2.0:1780996937.125566:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780996937.125572:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996937.125593:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b78c2680 x1867507126792576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780996937.125658:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126792576:0@lo:38:kworker.0 00000100:00100000:1.0:1780996937.125723:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780996937.125780:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780996937.125784:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780996937.125786:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780996937.125789:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3459 00000100:00080000:2.0:1780996937.125792:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780996937.125796:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996937.125805:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b78c3480 x1867507126792832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780996937.125872:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126792448:0@lo:400:kworker.0 00000400:00000100:3.0:1780996937.125911:0:3498:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126792448 offset 0 length 224: 4 00000100:00100000:3.0:1780996937.125942:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780996937.125948:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126792704:0@lo:400:kworker.0 00000100:00100000:3.0:1780996937.125980:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996937.126034:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126792576 00000100:00100000:3.0:1780996937.126041:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126792576 00000100:00100000:3.0:1780996937.126071:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126792704 00000100:00100000:3.0:1780996937.126073:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126792704 00000100:00100000:3.0:1780996937.126108:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1780996937.126116:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126792704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996937.126161:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126792704:12345-0@lo:400:kworker.0 Request processed in 46us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996937.126169:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1780996937.126200:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:3.0:1780996937.126204:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126792576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780996937.126222:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1780996937.126311:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780996937.127280:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126792832:0@lo:38:kworker.0 00000100:00100000:1.0:1780996937.127323:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996937.127425:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126792832 00000100:00100000:0.0:1780996937.127430:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126792832 00000100:00100000:0.0:1780996937.127468:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1780996937.127473:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126792832:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780996937.127488:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780996937.127520:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126792832:12345-0@lo:38:kworker.0 Request processed in 45us (196us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780996937.127526:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1780996937.127584:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126792704:0@lo:400:kworker.0 00000100:00080000:2.0:1780996937.131489:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780996937.131496:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780996937.131500:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780996937.131508:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3459 00000100:00080000:2.0:1780996937.131514:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780996937.131537:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996937.131560:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b78c1500 x1867507126793088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780996937.131597:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780996937.131600:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780996937.131602:0:38:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780996937.131605:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3459 00000100:00080000:2.0:1780996937.131608:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780996937.131611:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996937.131621:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bff6ea00 x1867507126793472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780996937.131650:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126793216:0@lo:400:kworker.0 00000100:00100000:2.0:1780996937.131720:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996937.131755:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780996937.131761:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126792960:0@lo:400:kworker.0 00000100:00100000:2.0:1780996937.131783:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996937.132361:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126792576:12345-0@lo:38:kworker.0 Request processed in 6151us (6634us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780996937.132372:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126793344:0@lo:400:kworker.0 00000100:00100000:3.0:1780996937.132382:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1780996937.132408:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780996937.132441:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780996937.132448:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780996937.132453:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126792576:0@lo:38:kworker.0 00000100:00100000:0.0:1780996937.132473:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126793216 00000100:00100000:1.0:1780996937.132479:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126793088:0@lo:38:kworker.0 00000100:00100000:0.0:1780996937.132480:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126793216 00000100:00100000:0.0:1780996937.132525:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126793344 00000100:00100000:0.0:1780996937.132529:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126793344 00000100:00100000:0.0:1780996937.132549:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412 00000100:00100000:0.0:1780996937.132558:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126793216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996937.133004:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126792960 00000100:00100000:3.0:1780996937.133009:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126792960 00000100:00100000:3.0:1780996937.133043:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:3.0:1780996937.133049:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126792960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996937.133110:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413 00000100:00100000:2.0:1780996937.133119:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126793344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996937.133363:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126793216:12345-0@lo:400:kworker.0 Request processed in 804us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996937.133370:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412 00000100:00080000:0.0:1780996937.133444:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780996937.137981:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996937.138299:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126793216:0@lo:400:kworker.0 00000100:00100000:0.0:1780996937.138343:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126793088 00000100:00100000:0.0:1780996937.138350:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126793088 00000100:00100000:0.0:1780996937.138386:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:0.0:1780996937.138394:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126793088:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780996937.138415:0:8242:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996937.138508:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126793344:12345-0@lo:400:kworker.0 Request processed in 5389us (6099us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996937.138519:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413 00000100:00100000:2.0:1780996937.138572:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126793344:0@lo:400:kworker.0 00000100:00100000:1.0:1780996937.140028:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126793472:0@lo:38:kworker.0 00000100:00100000:1.0:1780996937.140082:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780996937.140253:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780996937.140260:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780996937.140264:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126792832:0@lo:38:kworker.0 00000100:00100000:3.0:1780996937.141118:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126792960:12345-0@lo:400:kworker.0 Request processed in 8066us (9330us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996937.141130:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:1.0:1780996937.141316:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126792960:0@lo:400:kworker.0 00000100:00100000:3.0:1780996937.141419:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126793472 00000100:00100000:3.0:1780996937.141427:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126793472 00000100:00100000:2.0:1780996937.142084:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1780996937.142093:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126793472:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780996937.142126:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996937.142466:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126793472:12345-0@lo:38:kworker.0 Request processed in 371us (2382us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996937.142474:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1780996937.144603:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126793088:12345-0@lo:38:kworker.0 Request processed in 6196us (6618us total) trans 0 rc -19/-19 00000100:00080000:1.0:1780996937.144613:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1780996937.144620:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00080000:1.0:1780996937.144623:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780996937.144629:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126793088:0@lo:38:kworker.0 00000100:00080000:1.0:1780996937.144644:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780996937.144648:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780996937.144651:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126793472:0@lo:38:kworker.0 00010000:00010000:0.0:1780996937.448319:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780996937.476364:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996937.476417:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:0.0:1780996937.476445:0:3490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110325504 offset 0 length 224: 4 00000100:00100000:0.0:1780996937.476464:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996937.476490:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110326016 00000100:00100000:0.0:1780996937.476498:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996937.476501:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110326016 00000100:00100000:0.0:1780996937.476523:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110325888 00000100:00100000:0.0:1780996937.476528:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110325888 00000100:00100000:0.0:1780996937.476580:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2414 00000100:00100000:0.0:1780996937.476590:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110325888:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996937.476662:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110325888:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996937.476669:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2414 00000100:00100000:0.0:1780996937.476686:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2415 00000100:00100000:0.0:1780996937.476692:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110326016:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996937.476716:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110326016:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996937.476737:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2415 00000100:00080000:2.0:1780996937.476829:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780996937.476834:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780996937.476950:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110325760 00000100:00100000:2.0:1780996937.476965:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110325760 00000100:00100000:2.0:1780996937.477001:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110325632 00000100:00100000:2.0:1780996937.477004:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110325632 00000100:00100000:2.0:1780996937.477019:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1052 00000100:00100000:2.0:1780996937.477026:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110325760:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780996937.477063:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110325760:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 39us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996937.477070:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1052 00000100:00100000:2.0:1780996937.477084:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1051 00000100:00100000:2.0:1780996937.477088:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110325632:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:2.0:1780996937.477107:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996937.477132:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110325632:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 42us (634us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996937.477139:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1051 00000100:00080000:2.0:1780996937.477153:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1780996938.469555:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996939.495540:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996940.518130:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996941.228898:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780996941.228919:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126793600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780996941.228992:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126793728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780996941.228995:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996941.229020:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996941.229037:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126793600 00000100:00100000:3.0:1780996941.229047:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126793728 00000100:00100000:3.0:1780996941.229054:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126793728 00000100:00100000:2.0:1780996941.229054:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126793600 00000100:00100000:2.0:1780996941.229103:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:2.0:1780996941.229112:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126793600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780996941.229142:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996941.229183:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126793600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996941.229191:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00100000:3.0:1780996941.236096:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:3.0:1780996941.236233:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126793728:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1780996941.236493:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780996941.236500:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780996941.236565:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126793600:0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780996941.236758:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996941.236844:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126793728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 737us (7823us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996941.236851:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00100000:2.0:1780996941.237171:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126793728:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1780996941.541516:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780996942.251150:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780996942.251157:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780996942.251160:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780996942.251167:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3464 00000100:00080000:2.0:1780996942.251172:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780996942.251178:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996942.251199:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968888df8000 x1867507126793984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780996942.251238:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780996942.251241:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780996942.251243:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780996942.251246:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3464 00000100:00080000:2.0:1780996942.251249:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780996942.251252:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996942.251304:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968888df9c00 x1867507126794240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780996942.251321:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780996942.251324:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780996942.251326:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780996942.251328:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3464 00000100:00080000:2.0:1780996942.251330:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780996942.251334:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996942.251345:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968986956a00 x1867507126794496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780996942.251365:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780996942.251368:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780996942.251370:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780996942.251374:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3464 00000100:00080000:2.0:1780996942.251376:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780996942.251379:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996942.251390:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bb5bb100 x1867507126794880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780996942.251425:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126794624:0@lo:400:kworker.0 00000100:00100000:2.0:1780996942.251486:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996942.251521:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1780996942.251528:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126793856:0@lo:400:kworker.0 00000400:00000100:2.0:1780996942.251547:0:3496:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126793856 offset 0 length 224: 4 00000100:00100000:2.0:1780996942.251567:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126794752:0@lo:400:kworker.0 00000100:00100000:2.0:1780996942.251596:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996942.251910:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126794112:0@lo:400:kworker.0 00000100:00100000:3.0:1780996942.251957:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996942.251986:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780996942.251992:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126794368:0@lo:400:kworker.0 00000100:00100000:3.0:1780996942.252022:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996942.252050:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126794112 00000100:00100000:3.0:1780996942.252056:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126794112 00000100:00100000:3.0:1780996942.252120:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126794368 00000100:00100000:3.0:1780996942.252123:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126794368 00000100:00100000:3.0:1780996942.252148:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1780996942.252156:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126794112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996942.252206:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126794112:12345-0@lo:400:kworker.0 Request processed in 50us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996942.252213:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1780996942.252230:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1780996942.252236:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126794368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996942.252263:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126794368:12345-0@lo:400:kworker.0 Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996942.252298:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00080000:3.0:1780996942.252315:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996942.252349:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126794368:0@lo:400:kworker.0 00000100:00100000:3.0:1780996942.252359:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126794112:0@lo:400:kworker.0 00000100:00100000:1.0:1780996942.253024:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126793984:0@lo:38:kworker.0 00000100:00100000:1.0:1780996942.253062:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996942.253171:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126794624 00000100:00100000:0.0:1780996942.253177:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126794624 00000100:00100000:0.0:1780996942.253216:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126794752 00000100:00100000:0.0:1780996942.253220:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126794752 00000100:00100000:0.0:1780996942.253239:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416 00000100:00100000:0.0:1780996942.253246:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126794624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996942.253308:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126794624:12345-0@lo:400:kworker.0 Request processed in 64us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996942.253315:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416 00000100:00100000:0.0:1780996942.253329:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417 00000100:00100000:0.0:1780996942.253335:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126794752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996942.253365:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126794752:12345-0@lo:400:kworker.0 Request processed in 30us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996942.253371:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417 00000100:00100000:0.0:1780996942.253406:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126794752:0@lo:400:kworker.0 00000100:00100000:0.0:1780996942.253418:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126794624:0@lo:400:kworker.0 00000100:00100000:1.0:1780996942.253616:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126794240:0@lo:38:kworker.0 00000100:00100000:1.0:1780996942.253646:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996942.253696:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126793984 00000100:00100000:2.0:1780996942.253701:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126793984 00000100:00100000:1.0:1780996942.253702:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126794496:0@lo:38:kworker.0 00000100:00100000:1.0:1780996942.253728:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996942.253729:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126794240 00000100:00100000:2.0:1780996942.253732:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126794240 00000100:00100000:2.0:1780996942.253746:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:1.0:1780996942.253746:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126794880:0@lo:38:kworker.0 00000100:00100000:2.0:1780996942.253751:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126793984:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1780996942.253765:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:2.0:1780996942.253767:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996942.253801:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126793984:12345-0@lo:38:kworker.0 Request processed in 49us (739us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996942.253807:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:1.0:1780996942.253808:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126794496 00000100:00100000:1.0:1780996942.253811:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126794496 00000100:00100000:2.0:1780996942.253816:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126794880 00000100:00100000:2.0:1780996942.253819:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126794880 00000100:00100000:2.0:1780996942.253831:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1780996942.253831:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:2.0:1780996942.253835:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126794240:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1780996942.253835:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126794496:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780996942.253844:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780996942.253882:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1780996942.253886:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126794880:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780996942.253911:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996942.253949:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126794240:12345-0@lo:38:kworker.0 Request processed in 112us (302us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780996942.253949:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126794496:12345-0@lo:38:kworker.0 Request processed in 111us (219us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996942.253956:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1780996942.253956:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00080000:2.0:1780996942.253980:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780996942.254045:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780996942.254049:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126793984:0@lo:38:kworker.0 00000100:00080000:2.0:1780996942.254060:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780996942.254063:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780996942.254065:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126794240:0@lo:38:kworker.0 00000100:00080000:2.0:1780996942.254071:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780996942.254080:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780996942.254083:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126794496:0@lo:38:kworker.0 00010000:00020000:3.0:1780996942.254438:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780996942.254469:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126794880:12345-0@lo:38:kworker.0 Request processed in 581us (702us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780996942.254476:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00080000:0.0:1780996942.254688:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780996942.254693:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780996942.254695:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126794880:0@lo:38:kworker.0 00010000:00010000:0.0:1780996942.565412:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1780996942.599517:0:3490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110326144 offset 0 length 224: 4 00000100:00100000:1.0:1780996942.599555:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996942.599590:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110326400 00000100:00100000:1.0:1780996942.599599:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110326400 00000100:00100000:1.0:1780996942.599654:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1055 00000100:00100000:1.0:1780996942.599663:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110326400:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996942.599728:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110326400:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 65us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996942.599736:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1055 00000100:00080000:1.0:1780996942.599756:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996942.611917:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996942.611991:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996942.612033:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996942.612062:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110326528 00000100:00100000:3.0:1780996942.612072:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110326528 00000100:00100000:2.0:1780996942.612085:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110326272 00000100:00100000:2.0:1780996942.612092:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110326272 00000100:00100000:3.0:1780996942.612130:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110326656 00000100:00100000:3.0:1780996942.612135:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110326656 00000100:00100000:2.0:1780996942.612137:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1055 00000100:00100000:2.0:1780996942.612146:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2393:x1867507110326272:12345-192.168.206.51@tcp:38:kworker.0 00000100:00100000:3.0:1780996942.612164:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5898 00000100:00100000:3.0:1780996942.612175:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2393:x1867507110326528:12345-192.168.206.51@tcp:9:kworker.0 00010000:00020000:2.0:1780996942.612178:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:3.0:1780996942.612208:0:25177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03058e7f 00000100:00080000:3.0:1780996942.612218:0:25177:0:(import.c:65:import_set_state_nolock()) ffff9689bcb9f000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1780996942.612246:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2393:x1867507110326272:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 99us (398us total) trans 0 rc -19/-19 00000001:00000004:3.0:1780996942.612264:0:25177:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:2.0:1780996942.612338:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1055 00000100:00100000:3.0:1780996942.612817:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:285c134c-d3a6-4c01-bb4d-8148c50d5f95+2:2393:x1867507110326528:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 643us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996942.612825:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5898 00000100:00100000:3.0:1780996942.612841:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5899 00000100:00100000:3.0:1780996942.612921:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2393:x1867507110326656:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:3.0:1780996942.612946:0:25177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059317 00000100:00080000:3.0:1780996942.612952:0:25177:0:(import.c:65:import_set_state_nolock()) ffff9689ba418000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780996942.613000:0:25177:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:3.0:1780996942.613075:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:285c134c-d3a6-4c01-bb4d-8148c50d5f95+2:2393:x1867507110326656:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 226us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996942.613081:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5899 00010000:00010000:3.0:1780996942.613112:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780996942.613217:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780996942.613222:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780996942.613229:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996943.590905:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996944.615863:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996945.637484:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996946.341941:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780996946.341969:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126795008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780996946.342042:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996946.342302:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780996946.342313:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126795136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780996946.342356:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996946.342387:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126795008 00000100:00100000:3.0:1780996946.342395:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126795008 00000100:00100000:3.0:1780996946.342507:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126795136 00000100:00100000:3.0:1780996946.342511:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126795136 00000100:00100000:3.0:1780996946.342611:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:3.0:1780996946.342621:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126795008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780996946.342651:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996946.342693:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126795008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996946.342701:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:3.0:1780996946.342718:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:3.0:1780996946.342725:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126795136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780996946.342740:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996946.342776:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126795136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996946.342782:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00080000:3.0:1780996946.342799:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780996946.342803:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780996946.342844:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126795008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780996946.342876:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126795136:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1780996946.661428:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780996947.375388:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996947.375396:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996947.375399:0:38:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996947.375407:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3469 00000100:00080000:3.0:1780996947.375413:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780996947.375433:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996947.375463:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b11aa680 x1867507126795392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780996947.375503:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996947.375506:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996947.375508:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996947.375512:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3469 00000100:00080000:3.0:1780996947.375514:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780996947.375517:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996947.375528:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b11a9500 x1867507126795648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780996947.375552:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996947.375556:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996947.375558:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996947.375561:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3469 00000100:00080000:3.0:1780996947.375563:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780996947.375568:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996947.375570:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126795392:0@lo:38:kworker.0 00000100:00100000:3.0:1780996947.375582:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b11a8700 x1867507126795904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780996947.375606:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996947.375610:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996947.375611:0:38:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996947.375614:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3469 00000100:00080000:3.0:1780996947.375617:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780996947.375627:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996947.375641:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968888df9c00 x1867507126796288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780996947.375647:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996947.375682:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126795648:0@lo:38:kworker.0 00000100:00100000:2.0:1780996947.375703:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996947.375729:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126795904:0@lo:38:kworker.0 00000100:00100000:2.0:1780996947.375754:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996947.375773:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126796288:0@lo:38:kworker.0 00000100:00100000:2.0:1780996947.375793:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996947.375851:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126795904 00000100:00100000:2.0:1780996947.375858:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126795904 00000100:00100000:2.0:1780996947.375914:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:2.0:1780996947.375922:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126795904:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1780996947.375938:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126795520:0@lo:400:kworker.0 00010000:00020000:2.0:1780996947.375942:0:8242:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780996947.376019:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126795264:0@lo:400:kworker.0 00000100:00100000:1.0:1780996947.376379:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126795392 00000100:00100000:1.0:1780996947.376383:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126795392 00000100:00100000:1.0:1780996947.376421:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126795648 00000100:00100000:1.0:1780996947.376424:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126795648 00000100:00100000:1.0:1780996947.376440:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126796288 00000100:00100000:1.0:1780996947.376443:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126796288 00000100:00100000:1.0:1780996947.376459:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:1.0:1780996947.376465:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126795392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780996947.376478:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996947.377344:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126795904:12345-0@lo:38:kworker.0 Request processed in 1417us (1583us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996947.377354:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00080000:2.0:1780996947.377920:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780996947.377927:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780996947.377932:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126795904:0@lo:38:kworker.0 00000100:00100000:2.0:1780996947.378360:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1780996947.378368:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126795648:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780996947.378386:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996947.378458:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126795648:12345-0@lo:38:kworker.0 Request processed in 89us (2753us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996947.378465:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1780996947.378483:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1780996947.378488:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126796288:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780996947.378498:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996947.378526:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126796288:12345-0@lo:38:kworker.0 Request processed in 36us (2731us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996947.378531:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1780996947.378555:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126796032:0@lo:400:kworker.0 00000100:00100000:2.0:1780996947.378592:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996947.378617:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780996947.378637:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126795776:0@lo:400:kworker.0 00000100:00100000:2.0:1780996947.378662:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780996947.378702:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780996947.378709:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780996947.378712:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126796288:0@lo:38:kworker.0 00000100:00080000:2.0:1780996947.378721:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780996947.378724:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780996947.378726:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126795648:0@lo:38:kworker.0 00000100:00100000:2.0:1780996947.378748:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126796032 00000100:00100000:2.0:1780996947.378753:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126796032 00000100:00100000:2.0:1780996947.378789:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418 00000100:00100000:2.0:1780996947.378796:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126796032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996947.378854:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126796032:12345-0@lo:400:kworker.0 Request processed in 59us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996947.378860:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418 00000100:00100000:2.0:1780996947.378876:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126795776 00000100:00100000:2.0:1780996947.378879:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126795776 00000100:00100000:2.0:1780996947.378917:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1780996947.378923:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126795776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996947.378956:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126795776:12345-0@lo:400:kworker.0 Request processed in 33us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996947.378963:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1780996947.378992:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126795776:0@lo:400:kworker.0 00000100:00100000:2.0:1780996947.379001:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126796032:0@lo:400:kworker.0 00000100:00080000:2.0:1780996947.379023:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996947.385850:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996947.386103:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126795520 00000100:00100000:3.0:1780996947.386114:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126795520 00000100:00100000:3.0:1780996947.386178:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1780996947.386191:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126795520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996947.386265:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126795520:12345-0@lo:400:kworker.0 Request processed in 78us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996947.386293:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00080000:2.0:1780996947.386323:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996947.386391:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126795520:0@lo:400:kworker.0 00000400:00000100:0.0:1780996947.386567:0:3496:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126795264 offset 0 length 224: 4 00000100:00100000:0.0:1780996947.386611:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126796160:0@lo:400:kworker.0 00000100:00100000:0.0:1780996947.386653:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996947.386694:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126796160 00000100:00100000:0.0:1780996947.386699:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126796160 00000100:00100000:0.0:1780996947.386728:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419 00000100:00100000:0.0:1780996947.386736:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126796160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996947.386913:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126796160:12345-0@lo:400:kworker.0 Request processed in 177us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996947.386920:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419 00000100:00100000:0.0:1780996947.386966:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126796160:0@lo:400:kworker.0 00000100:00100000:1.0:1780996947.388258:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126795392:12345-0@lo:38:kworker.0 Request processed in 11787us (12609us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780996947.388280:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00080000:2.0:1780996947.388617:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780996947.388624:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780996947.388628:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126795392:0@lo:38:kworker.0 00010000:00010000:2.0:1780996947.695948:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996947.716378:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996947.716410:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:1.0:1780996947.716426:0:3491:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110326784 offset 0 length 224: 4 00000100:00100000:3.0:1780996947.716721:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110326912 00000100:00100000:3.0:1780996947.716731:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110326912 00000100:00100000:3.0:1780996947.716772:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110327040 00000100:00100000:3.0:1780996947.716775:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110327040 00000100:00100000:3.0:1780996947.716842:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1058 00000100:00100000:3.0:1780996947.716852:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110327040:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996947.716931:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110327040:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 80us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996947.716938:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1058 00000100:00100000:3.0:1780996947.716954:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1059 00000100:00100000:3.0:1780996947.716958:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1867507110326912:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:3.0:1780996947.716975:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780996947.717013:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1867507110326912:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 53us (644us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780996947.717018:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1059 00000100:00080000:0.0:1780996947.717316:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00000400:0.0:1780996948.402822:0:3499:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780996932/real 1780996932] req@ffff9689bb575880 x1867507126790528/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780996948 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780996948.402853:0:3499:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9689bb575880 x1867507126790528/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780996948 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780996948.402861:0:3499:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1780996948.402865:0:3499:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000001:00100000:3.0:1780996948.415718:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:3.0:1780996948.415729:0:9294:0:(genops.c:906:class_export_put()) final put ffff9689ba41f000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:2.0:1780996948.415766:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba41f000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-OST0001 00000020:00000080:2.0:1780996948.415826:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689ba418000 for lustre-OST0001 00000100:00080000:0.0:1780996948.422035:0:3499:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.151@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1780996948.422041:0:3499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1780996948.422053:0:3499:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689bb575880 x1867507126790528/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780996948 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780996948.422067:0:3499:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689b78c0700 x1867507126792448/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780996953 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780996948.422103:0:3499:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff968888dfad80 x1867507126793856/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780996958 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780996948.422117:0:3499:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689b11a8000 x1867507126795264/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780996963 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1780996948.422125:0:3499:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1780996948.422128:0:3499:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1780996948.422130:0:3499:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1780996948.422132:0:3499:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1780996948.422163:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126790528:0@lo:400:kworker.0 00000100:00100000:0.0:1780996948.422221:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126792448:0@lo:400:kworker.0 00000100:00100000:0.0:1780996948.422254:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126795264:0@lo:400:kworker.0 00000100:00100000:0.0:1780996948.422266:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126793856:0@lo:400:kworker.0 00000100:00080000:0.0:1780996948.422312:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780996948.422316:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1780996948.422319:0:36:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780996948.422324:0:36:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3236 00000100:00080000:0.0:1780996948.422331:0:36:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780996948.422359:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7a4ea00 x1867507126796416/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780996948.422382:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780996948.422385:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780996948.422387:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780996948.422390:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3474 00000100:00080000:0.0:1780996948.422393:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780996948.422401:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780996948.422417:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7a4e300 x1867507126796544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780996948.422439:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780996948.422442:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780996948.422444:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780996948.422448:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3474 00000100:00080000:0.0:1780996948.422450:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780996948.422453:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780996948.422463:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7a4fb80 x1867507126796800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780996948.422482:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780996948.422485:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780996948.422487:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780996948.422490:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3474 00000100:00080000:0.0:1780996948.422492:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780996948.422495:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780996948.422505:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7a4dc00 x1867507126797056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780996948.422526:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780996948.422529:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780996948.422530:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780996948.422533:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3474 00000100:00080000:0.0:1780996948.422535:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780996948.422546:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780996948.422557:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7a4e680 x1867507126797440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780996948.422582:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126796416:0@lo:250:kworker.0 00000400:00000100:0.0:1780996948.422628:0:3495:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126796416 offset 0 length 520: 4 00000100:00100000:0.0:1780996948.422662:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126796544:0@lo:38:kworker.0 00000100:00100000:0.0:1780996948.422695:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996948.422715:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126796800:0@lo:38:kworker.0 00000100:00100000:0.0:1780996948.422736:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996948.422751:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126797056:0@lo:38:kworker.0 00000100:00100000:0.0:1780996948.422781:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996948.422800:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126797440:0@lo:38:kworker.0 00000100:00100000:0.0:1780996948.422824:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1780996948.422835:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:1.0:1780996948.422841:0:8226:0:(genops.c:906:class_export_put()) final put ffff968990f77000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000100:00100000:0.0:1780996948.422860:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126796672:0@lo:400:kworker.0 00000100:00100000:0.0:1780996948.422886:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996948.427556:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126796544 00000100:00100000:3.0:1780996948.427568:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126796544 00000100:00100000:3.0:1780996948.427599:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126796800 00000100:00100000:3.0:1780996948.427601:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126796800 00000100:00100000:3.0:1780996948.427618:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126797440 00000100:00100000:3.0:1780996948.427620:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126797440 00000100:00100000:3.0:1780996948.427645:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1780996948.427652:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126796544:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780996948.427673:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780996948.427749:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126796544:12345-0@lo:38:kworker.0 Request processed in 96us (5052us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780996948.427757:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1780996948.427775:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1780996948.427780:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126796800:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1780996948.427784:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00010000:00020000:3.0:1780996948.427794:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996948.427795:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126797440:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780996948.427810:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780996948.427843:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126796800:12345-0@lo:38:kworker.0 Request processed in 60us (5104us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780996948.427850:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1780996948.427868:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126797056 00000100:00100000:3.0:1780996948.427873:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126797056 00000100:00100000:3.0:1780996948.427904:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:3.0:1780996948.427908:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126797056:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780996948.427928:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996948.431380:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126797440:12345-0@lo:38:kworker.0 Request processed in 3577us (8546us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780996948.431393:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126797056:12345-0@lo:38:kworker.0 Request processed in 3479us (8608us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996948.431397:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1780996948.431408:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00100000:2.0:1780996948.431442:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126796672 00000100:00100000:2.0:1780996948.431452:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126796672 00000100:00100000:2.0:1780996948.431508:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:2.0:1780996948.431516:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126796672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996948.431577:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126796672:12345-0@lo:400:kworker.0 Request processed in 62us (8690us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996948.431584:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000020:00000080:3.0:1780996948.434660:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff968990f77000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-OST0000 00000020:00000080:3.0:1780996948.434709:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bcb9f000 for lustre-OST0000 00000100:00100000:0.0:1780996948.435787:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126796672:0@lo:400:kworker.0 00000100:00100000:0.0:1780996948.435923:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780996948.435936:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126797312:0@lo:400:kworker.0 00000100:00100000:0.0:1780996948.436005:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996948.436050:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126796928:0@lo:400:kworker.0 00000100:00100000:0.0:1780996948.436678:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996948.436710:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780996948.436718:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126797184:0@lo:400:kworker.0 00000100:00100000:0.0:1780996948.436762:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780996948.440417:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780996948.440432:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780996948.440438:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126796544:0@lo:38:kworker.0 00000100:00080000:0.0:1780996948.440475:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780996948.440478:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780996948.440481:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126796800:0@lo:38:kworker.0 00000100:00080000:0.0:1780996948.440493:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780996948.440496:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780996948.440500:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126797056:0@lo:38:kworker.0 00000100:00080000:0.0:1780996948.440511:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780996948.440514:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780996948.440517:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126797440:0@lo:38:kworker.0 00000100:00100000:0.0:1780996948.440562:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126797312 00000100:00100000:0.0:1780996948.440570:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126797312 00000100:00100000:0.0:1780996948.440631:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126797184 00000100:00100000:0.0:1780996948.440635:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126797184 00000100:00100000:0.0:1780996948.440661:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:0.0:1780996948.440670:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126797312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996948.440750:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126797312:12345-0@lo:400:kworker.0 Request processed in 81us (4744us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996948.440757:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00100000:0.0:1780996948.440774:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:0.0:1780996948.440780:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126797184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996948.441902:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126797184:12345-0@lo:400:kworker.0 Request processed in 32us (4048us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996948.441922:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00080000:0.0:1780996948.441953:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780996948.441957:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780996948.442016:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126797312:0@lo:400:kworker.0 00000100:00100000:0.0:1780996948.442058:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126797184:0@lo:400:kworker.0 00000100:00100000:0.0:1780996948.442081:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126796928 00000100:00100000:0.0:1780996948.442086:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126796928 00000100:00100000:0.0:1780996948.442119:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1780996948.442126:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126796928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996948.442187:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126796928:12345-0@lo:400:kworker.0 Request processed in 61us (5511us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996948.442193:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1780996948.442226:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126796928:0@lo:400:kworker.0 00010000:00010000:0.0:1780996948.716008:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1780996948.767653:0:3490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110327168 offset 0 length 520: 4 00000100:00100000:1.0:1780996948.767707:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996948.767805:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996948.768019:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110327296 00000100:00100000:2.0:1780996948.768031:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110327296 00000100:00100000:2.0:1780996948.768083:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110327424 00000100:00100000:2.0:1780996948.768087:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110327424 00000100:00100000:2.0:1780996948.768132:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1061 00000100:00100000:2.0:1780996948.768142:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110327424:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780996948.768217:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110327424:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 77us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996948.768231:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1061 00000100:00100000:2.0:1780996948.768250:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1063 00000100:00100000:2.0:1780996948.768254:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110327296:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:2.0:1780996948.768302:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996948.768330:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110327296:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 75us (624us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996948.768336:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1063 00010000:00010000:3.0:1780996949.733500:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996950.757488:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1780996951.247604:0:81481:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1780996951.247612:0:81481:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1780996951.247613:0:81481:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1780996951.247738:0:81481:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9689ba675000 00000020:01000004:0.0:1780996951.247753:0:81481:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1780996951.247767:0:81481:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1780996951.247781:0:81481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff968886ec19c0) 00000020:00000080:0.0:1780996951.247797:0:81481:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1780996951.330376:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1780996951.330822:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1780996951.332399:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1780996951.332816:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1780996951.333119:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1780996951.333438:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1780996951.333602:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1780996951.334018:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1780996951.334192:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1780996951.334521:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1780996951.334794:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1780996951.335048:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1780996951.335394:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1780996951.335623:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1780996951.336560:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1780996951.340546:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.340909:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.341084:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.341366:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.341553:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.341773:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.342038:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.342314:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.342488:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.342778:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.343017:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.343297:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.343528:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.344024:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.344297:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.344505:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.344766:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.345074:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.345422:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.345729:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.345976:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.346173:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.346511:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.346782:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.347063:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.347335:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.347556:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.347870:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.348074:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1780996951.348440:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.348737:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.349121:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1780996951.350003:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1780996951.350585:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1780996951.350901:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1780996951.351356:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1780996951.351600:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1780996951.351917:0:81481:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1780996951.352697:0:81481:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1780996951.352963:0:81481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1780996951.352971:0:81481:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1780996951.352982:0:81481:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305942f 00000020:01000004:1.0:1780996951.352989:0:81481:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1780996951.353001:0:81481:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1780996951.353007:0:81481:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9689ba675000 from MGS 00000020:01000004:1.0:1780996951.353010:0:81481:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1780996951.353021:0:81481:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff96888ac53380) 00000020:00000080:1.0:1780996951.353031:0:81481:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1780996951.353096:0:81481:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689ba675000 from MGS, refs=2 00080000:01000000:1.0:1780996951.353100:0:81481:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1780996951.353105:0:81481:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305943d 00010000:00010000:1.0:1780996951.353251:0:81481:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1780996951.357889:0:81481:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1780996951.359028:0:81485:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1780996951.359085:0:81481:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1780996951.359134:0:81481:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1780996951.359895:0:81481:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1780996951.360177:0:81481:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1780996951.371289:0:81481:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1780996951.371302:0:81481:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1780996951.372080:0:81481:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1780996951.372087:0:81481:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1780996951.373998:0:81481:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1780996951.374014:0:81481:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1780996951.374765:0:81481:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1780996951.374791:0:81481:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1780996951.374793:0:81481:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1780996951.374867:0:81481:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1780996951.374881:0:81481:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96898d0e6000 already not connected (conn 63, was 0): CONNECTING 00000100:00100000:0.0:1780996951.374887:0:81481:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1780996951.461662:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780996951.461683:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126797568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780996951.461761:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996951.462048:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126797568 00000100:00100000:3.0:1780996951.462056:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126797568 00000100:00100000:3.0:1780996951.462135:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:3.0:1780996951.462146:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126797568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780996951.462180:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1780996951.462425:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780996951.462777:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126797568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 631us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996951.462788:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00100000:2.0:1780996951.462950:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780996951.462963:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126797696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780996951.462996:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996951.463029:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126797696 00000100:00100000:2.0:1780996951.463034:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126797696 00000100:00100000:2.0:1780996951.463065:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:2.0:1780996951.463072:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126797696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780996951.463091:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996951.463124:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126797696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996951.463130:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00080000:2.0:1780996951.463147:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780996951.463182:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126797696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780996951.463312:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126797568:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1780996951.783670:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996952.805561:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780996953.510324:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996953.510334:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1780996953.510336:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996953.510350:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996953.510355:0:38:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996953.510364:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3475 00000100:00080000:3.0:1780996953.510369:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780996953.510376:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996953.510419:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968888dfbb80 x1867507126797824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780996953.510506:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996953.510509:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996953.510511:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996953.510515:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3475 00000100:00080000:3.0:1780996953.510517:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780996953.510521:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996953.510533:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968888dfad80 x1867507126798080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780996953.510554:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996953.510557:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996953.510559:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996953.510563:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3475 00000100:00080000:3.0:1780996953.510565:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780996953.510569:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996953.510584:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6799880 x1867507126798336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780996953.510606:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996953.510609:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996953.510611:0:38:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996953.510614:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3475 00000100:00080000:3.0:1780996953.510617:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780996953.510621:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996953.510631:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a679b480 x1867507126798720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780996953.511103:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126797952:0@lo:400:kworker.0 00000100:00100000:2.0:1780996953.511175:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996953.511240:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780996953.511249:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126797952 00000100:00100000:2.0:1780996953.511257:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126798592:0@lo:400:kworker.0 00000100:00100000:3.0:1780996953.511258:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126797952 00000100:00100000:2.0:1780996953.511317:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996953.511336:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1780996953.511347:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126797952:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1780996953.511357:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780996953.511386:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126798592 00000100:00100000:2.0:1780996953.511391:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126798592 00000100:00100000:3.0:1780996953.511408:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126797952:12345-0@lo:400:kworker.0 Request processed in 62us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996953.511417:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1780996953.511430:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422 00000100:00100000:2.0:1780996953.511438:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126798592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996953.511471:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126798592:12345-0@lo:400:kworker.0 Request processed in 35us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996953.511477:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422 00000100:00080000:2.0:1780996953.511491:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780996953.511518:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126798592:0@lo:400:kworker.0 00000100:00100000:2.0:1780996953.511527:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126797952:0@lo:400:kworker.0 00000100:00100000:1.0:1780996953.511748:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126797824:0@lo:38:kworker.0 00000100:00100000:1.0:1780996953.511778:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996953.511809:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126798080:0@lo:38:kworker.0 00000100:00100000:1.0:1780996953.511828:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996953.511854:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126798336:0@lo:38:kworker.0 00000100:00100000:3.0:1780996953.511912:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126797824 00000100:00100000:3.0:1780996953.511917:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126797824 00000100:00100000:3.0:1780996953.511935:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126798080 00000100:00100000:3.0:1780996953.511937:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126798080 00000100:00100000:3.0:1780996953.511949:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1780996953.511954:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126797824:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780996953.511974:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780996953.512003:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126797824:12345-0@lo:38:kworker.0 Request processed in 48us (224us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780996953.512008:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1780996953.512018:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1780996953.512021:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126798080:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780996953.512029:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780996953.512048:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126798080:12345-0@lo:38:kworker.0 Request processed in 25us (219us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780996953.512053:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1780996953.512083:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126798208:0@lo:400:kworker.0 00000100:00100000:3.0:1780996953.512109:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996953.512136:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780996953.512213:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126798464:0@lo:400:kworker.0 00000100:00100000:3.0:1780996953.512239:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996953.512265:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126798208 00000100:00100000:3.0:1780996953.512290:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126798208 00000100:00100000:3.0:1780996953.512322:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1780996953.512328:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126798208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996953.512364:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126798208:12345-0@lo:400:kworker.0 Request processed in 36us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996953.512369:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1780996953.512397:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126798208:0@lo:400:kworker.0 00000100:00100000:1.0:1780996953.512621:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996953.512641:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a679b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126798720:0@lo:38:kworker.0 00000100:00100000:1.0:1780996953.512674:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780996953.512699:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780996953.512704:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780996953.512707:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126797824:0@lo:38:kworker.0 00000100:00080000:1.0:1780996953.512724:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780996953.512727:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780996953.512730:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126798080:0@lo:38:kworker.0 00000100:00100000:1.0:1780996953.512750:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126798720 00000100:00100000:1.0:1780996953.512753:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126798720 00000100:00100000:1.0:1780996953.512772:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1780996953.512776:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126798720:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780996953.512787:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780996953.513110:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126798720:12345-0@lo:38:kworker.0 Request processed in 331us (434us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780996953.513116:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00080000:1.0:1780996953.513144:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780996953.513148:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780996953.513150:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a679b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126798720:0@lo:38:kworker.0 00000100:00100000:2.0:1780996953.513317:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126798336 00000100:00100000:2.0:1780996953.513322:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126798336 00000100:00100000:2.0:1780996953.513358:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:2.0:1780996953.513364:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126798336:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780996953.513376:0:8242:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780996953.513411:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126798336:12345-0@lo:38:kworker.0 Request processed in 46us (790us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996953.513417:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00000100:00080000:2.0:1780996953.513431:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780996953.517070:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780996953.517082:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780996953.517087:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126798336:0@lo:38:kworker.0 00000100:00100000:3.0:1780996953.529011:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126798464 00000100:00100000:3.0:1780996953.529027:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126798464 00000100:00100000:3.0:1780996953.529126:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423 00000100:00100000:3.0:1780996953.529137:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126798464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996953.529234:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126798464:12345-0@lo:400:kworker.0 Request processed in 98us (16992us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996953.529241:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423 00000100:00100000:3.0:1780996953.529308:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126798464:0@lo:400:kworker.0 00000100:00080000:2.0:1780996953.529473:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1780996953.831582:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996953.864152:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996953.864199:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996953.864346:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110327680 00000100:00100000:0.0:1780996953.864356:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110327680 00000100:00100000:0.0:1780996953.864426:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110327552 00000100:00100000:0.0:1780996953.864429:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110327552 00000100:00100000:0.0:1780996953.864449:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1064 00000100:00100000:0.0:1780996953.864459:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110327680:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996953.864535:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110327680:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 76us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996953.864554:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1064 00000100:00100000:0.0:1780996953.864576:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1067 00000100:00100000:0.0:1780996953.864580:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110327552:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:0.0:1780996953.864600:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780996953.864626:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110327552:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 45us (426us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780996953.864648:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1067 00000100:00080000:2.0:1780996953.864768:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1780996954.855447:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996955.879818:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996956.581501:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780996956.581523:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126798848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780996956.581604:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996956.581656:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126798848 00000100:00100000:2.0:1780996956.581663:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126798848 00000100:00100000:2.0:1780996956.581721:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:2.0:1780996956.581729:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126798848:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780996956.581739:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00000024:2.0:1780996956.581756:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996956.581759:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126798976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780996956.581801:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996956.581807:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126798848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996956.581815:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:2.0:1780996956.581830:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126798976 00000100:00100000:2.0:1780996956.581834:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126798976 00000100:00100000:2.0:1780996956.581865:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:2.0:1780996956.581873:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126798976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780996956.581888:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1780996956.581895:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780996956.581900:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780996956.581926:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126798976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996956.581932:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:1.0:1780996956.581976:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126798976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780996956.581977:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126798848:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1780996956.901895:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996957.925508:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996957.958301:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996957.958358:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996957.958392:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996957.958476:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110328064 00000100:00100000:0.0:1780996957.958485:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110328064 00000100:00100000:0.0:1780996957.958541:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110327936 00000100:00100000:0.0:1780996957.958544:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110327936 00000100:00100000:0.0:1780996957.958560:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1065 00000100:00100000:0.0:1780996957.958570:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110328064:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996957.958654:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110328064:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 86us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996957.958663:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1065 00000100:00100000:0.0:1780996957.958681:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1068 00000100:00100000:0.0:1780996957.958685:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1867507110327936:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:0.0:1780996957.958708:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780996957.958731:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1867507110327936:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 44us (338us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780996957.958738:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1068 00000100:00100000:2.0:1780996957.958848:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110327808 00000100:00100000:2.0:1780996957.958853:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110327808 00000100:00100000:2.0:1780996957.958880:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1780996957.958886:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2393:x1867507110327808:12345-192.168.206.51@tcp:250:kworker.0 00010000:00080000:2.0:1780996957.958901:0:81487:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 5bc603cc-b633-43af-a003-872c004686c8@192.168.206.51@tcp t0 exp 0000000000000000 cur 3485 last 0 00000020:00000080:2.0:1780996957.958928:0:81487:0:(genops.c:1406:class_connect()) connect: client 5bc603cc-b633-43af-a003-872c004686c8, cookie 0x30fd811c03059444 00000100:00080000:2.0:1780996957.959049:0:81487:0:(import.c:65:import_set_state_nolock()) ffff968990f92800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780996957.959079:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+4:2393:x1867507110327808:12345-192.168.206.51@tcp:250:kworker.0 Request processed in 192us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996957.959100:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00080000:1.0:1780996957.959427:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780996958.629528:0:3495:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780996948/real 1780996948] req@ffff9689b7a4ea00 x1867507126796416/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780996958 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780996958.629591:0:3495:0:(client.c:2511:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9689b7a4ea00 x1867507126796416/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780996958 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780996958.629612:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780996958.629635:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1780996958.629649:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126796416:0@lo:250:kworker.0 10000000:01000000:0.0:1780996958.629853:0:81481:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1780996958.629870:0:81481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c030590ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030590f5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.629881:0:81481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c030590ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030590f5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.629888:0:81481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1780996958.629914:0:81481:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780996958.629947:0:81481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c030590ee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030590f5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.629970:0:81481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689a56c9a00/0x30fd811c03059054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305905b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.629976:0:81481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c9a00/0x30fd811c03059054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305905b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.629981:0:81481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780996958.629985:0:81481:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780996958.629989:0:81481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689a56c9a00/0x30fd811c03059054 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305905b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.629999:0:81481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c03059070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059077 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.630005:0:81481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c03059070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059077 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.630009:0:81481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780996958.630013:0:81481:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780996958.630016:0:81481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c03059070 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059077 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.630023:0:81481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c0305909a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030590a1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.630041:0:81481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c0305909a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030590a1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.630058:0:81481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780996958.630062:0:81481:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780996958.630066:0:81481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c0305909a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030590a1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.630075:0:81481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2800/0x30fd811c030590a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030590af expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.630081:0:81481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2800/0x30fd811c030590a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030590af expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.630086:0:81481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780996958.630089:0:81481:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780996958.630092:0:81481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2800/0x30fd811c030590a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030590af expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.630099:0:81481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3e00/0x30fd811c030590c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030590cb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.630105:0:81481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3e00/0x30fd811c030590c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030590cb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.630110:0:81481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780996958.630114:0:81481:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780996958.630116:0:81481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3e00/0x30fd811c030590c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030590cb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.630124:0:81481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c030590d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030590d9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.630142:0:81481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c030590d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030590d9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.630147:0:81481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780996958.630150:0:81481:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780996958.630154:0:81481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c030590d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030590d9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.630164:0:81481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3000/0x30fd811c030590fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059103 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.630171:0:81481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3000/0x30fd811c030590fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059103 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.630175:0:81481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780996958.630179:0:81481:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780996958.630181:0:81481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3000/0x30fd811c030590fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059103 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.630193:0:81481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96898d6da000/0x30fd811c03059062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059069 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.630199:0:81481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96898d6da000/0x30fd811c03059062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059069 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.630204:0:81481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1780996958.630206:0:81481:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780996958.630209:0:81481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96898d6da000/0x30fd811c03059062 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059069 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.630232:0:81481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c0305907e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059085 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.630238:0:81481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c0305907e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059085 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.630243:0:81481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1780996958.630246:0:81481:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780996958.630250:0:81481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c0305907e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059085 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.630261:0:81481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689a56c9200/0x30fd811c0305908c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059093 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.630267:0:81481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c9200/0x30fd811c0305908c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059093 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.630316:0:81481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780996958.630319:0:81481:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780996958.630323:0:81481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689a56c9200/0x30fd811c0305908c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059093 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.630333:0:81481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c030590b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030590bd expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.630338:0:81481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c030590b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030590bd expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.630343:0:81481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780996958.630352:0:81481:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780996958.630356:0:81481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c030590b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030590bd expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.630364:0:81481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c030590e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030590e7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.630369:0:81481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c030590e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030590e7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.630374:0:81481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780996958.630377:0:81481:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780996958.630379:0:81481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c030590e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030590e7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1780996958.630395:0:81481:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96898d0e6000 already not connected (conn 63, was 0): DISCONN 00000100:00080000:0.0:1780996958.630400:0:81481:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780996958.630406:0:81481:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3475 00000100:00080000:0.0:1780996958.630411:0:81481:0:(import.c:591:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1780996958.630417:0:81481:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780996958.630445:0:81481:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689aded2300 x1867507126799104/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780996958.630462:0:81481:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:3.0:1780996958.630608:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996958.630614:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1780996958.630616:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996958.630619:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996958.630622:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996958.630632:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3481 00000100:00080000:3.0:1780996958.630635:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780996958.630639:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996958.630656:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6799f80 x1867507126799232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780996958.630713:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996958.630717:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996958.630719:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996958.630723:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3481 00000100:00080000:3.0:1780996958.630726:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780996958.630729:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996958.630741:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6798380 x1867507126799488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780996958.630764:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996958.630767:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996958.630769:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996958.630772:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3481 00000100:00080000:3.0:1780996958.630774:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780996958.630777:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996958.630788:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a679a680 x1867507126799744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780996958.630812:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996958.630815:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996958.630817:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996958.630841:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3481 00000100:00080000:3.0:1780996958.630843:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780996958.630847:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996958.630862:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a679b480 x1867507126800128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780996958.630893:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126800000:0@lo:400:kworker.0 00000100:00100000:3.0:1780996958.630960:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.630995:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780996958.631001:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126799360:0@lo:400:kworker.0 00000100:00100000:3.0:1780996958.631039:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.631070:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126800000 00000100:00100000:3.0:1780996958.631078:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126800000 00000100:00100000:3.0:1780996958.631131:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424 00000100:00100000:3.0:1780996958.631141:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126800000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996958.631193:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126800000:12345-0@lo:400:kworker.0 Request processed in 52us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996958.631202:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424 00000100:00100000:3.0:1780996958.631245:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126800000:0@lo:400:kworker.0 00000100:00100000:1.0:1780996958.631476:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a679bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126799872:0@lo:400:kworker.0 00000100:00100000:1.0:1780996958.631506:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996958.631533:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780996958.631538:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126799616:0@lo:400:kworker.0 00000100:00100000:1.0:1780996958.631559:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996958.631584:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126799360 00000100:00100000:1.0:1780996958.631587:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126799360 00000100:00100000:1.0:1780996958.631618:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126799616 00000100:00100000:1.0:1780996958.631621:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126799616 00000100:00100000:1.0:1780996958.631641:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1780996958.631647:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126799360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996958.631691:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126799360:12345-0@lo:400:kworker.0 Request processed in 43us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996958.631697:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1780996958.631724:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1780996958.631730:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126799616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996958.631759:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126799616:12345-0@lo:400:kworker.0 Request processed in 29us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996958.631764:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00080000:1.0:1780996958.631785:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780996958.631790:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780996958.631799:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126799104:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1780996958.631847:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996958.631875:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126799232:0@lo:38:kworker.0 00000100:00100000:1.0:1780996958.631904:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996958.631923:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126799488:0@lo:38:kworker.0 00000100:00100000:1.0:1780996958.631944:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996958.631958:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a679a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126799744:0@lo:38:kworker.0 00000100:00100000:1.0:1780996958.631980:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996958.631995:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a679b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126800128:0@lo:38:kworker.0 00000100:00100000:1.0:1780996958.632013:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996958.632048:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126799232 00000100:00100000:1.0:1780996958.632052:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126799232 00000100:00100000:1.0:1780996958.632067:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126799488 00000100:00100000:1.0:1780996958.632070:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126799488 00000100:00100000:1.0:1780996958.632078:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126800128 00000100:00100000:1.0:1780996958.632081:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126800128 00000100:00100000:1.0:1780996958.632099:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:1.0:1780996958.632103:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126799232:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780996958.632122:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780996958.632154:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126799232:12345-0@lo:38:kworker.0 Request processed in 50us (250us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780996958.632161:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:1.0:1780996958.632173:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1780996958.632177:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126799488:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780996958.632187:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780996958.632211:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126799488:12345-0@lo:38:kworker.0 Request processed in 32us (266us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780996958.632217:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1780996958.632227:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1780996958.632231:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126800128:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780996958.632239:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780996958.632262:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126800128:12345-0@lo:38:kworker.0 Request processed in 29us (248us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780996958.632267:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1780996958.632313:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126799744 00000100:00100000:1.0:1780996958.632316:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126799744 00000100:00100000:1.0:1780996958.632333:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:1.0:1780996958.632340:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126799744:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780996958.632349:0:80061:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780996958.632374:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126799744:12345-0@lo:38:kworker.0 Request processed in 34us (393us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780996958.632389:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000100:00100000:1.0:1780996958.632426:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126799616:0@lo:400:kworker.0 00000100:00100000:1.0:1780996958.632453:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126799360:0@lo:400:kworker.0 00000100:00080000:1.0:1780996958.632473:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780996958.632478:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780996958.632481:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126799232:0@lo:38:kworker.0 00000100:00080000:1.0:1780996958.632488:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780996958.632491:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780996958.632493:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126799488:0@lo:38:kworker.0 00000100:00080000:1.0:1780996958.632500:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780996958.632502:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780996958.632505:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a679a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126799744:0@lo:38:kworker.0 00000100:00080000:1.0:1780996958.632511:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780996958.632513:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780996958.632516:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a679b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126800128:0@lo:38:kworker.0 00000100:00100000:3.0:1780996958.632821:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126799872 00000100:00100000:3.0:1780996958.632826:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126799872 00000100:00100000:3.0:1780996958.632877:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425 00000100:00100000:3.0:1780996958.632885:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126799872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996958.632934:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126799872:12345-0@lo:400:kworker.0 Request processed in 43us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996958.632940:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425 00000100:00100000:3.0:1780996958.632971:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a679bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126799872:0@lo:400:kworker.0 00000100:00100000:2.0:1780996958.633304:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126799104 00000100:00100000:2.0:1780996958.633310:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126799104 00000100:00100000:2.0:1780996958.633335:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1780996958.633340:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3495:x1867507126799104:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1780996958.633358:0:81489:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo t0 exp 0000000000000000 cur 3486 last 0 00000020:00000080:2.0:1780996958.633385:0:81489:0:(genops.c:1406:class_connect()) connect: client bdcd4e03-8d56-43b8-bfda-3b2f97e67d18, cookie 0x30fd811c0305944b 00000100:00080000:2.0:1780996958.633515:0:81489:0:(import.c:65:import_set_state_nolock()) ffff968990f94800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780996958.633578:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:3495:x1867507126799104:12345-0@lo:250:mount.lustre.0 Request processed in 237us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996958.633585:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1780996958.633625:0:3495:0:(client.c:3131:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 23 00000100:00080000:2.0:1780996958.633632:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:2.0:1780996958.633640:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1780996958.633644:0:3495:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1780996958.633647:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1780996958.633650:0:3495:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1780996958.633668:0:3495:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1780996958.633676:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126799104:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1780996958.633854:0:81481:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1780996958.633865:0:81481:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1780996958.633903:0:81481:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1780996958.633909:0:81481:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1780996958.634024:0:81481:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1780996958.634072:0:81481:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1780996958.634076:0:81481:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1780996958.634082:0:81481:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780996958.634083:0:81481:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780996958.634084:0:81481:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780996958.634085:0:81481:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780996958.634087:0:81481:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780996958.634088:0:81481:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780996958.634089:0:81481:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780996958.634091:0:81481:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780996958.634092:0:81481:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1780996958.634094:0:81481:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1780996958.634096:0:81481:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1780996958.634097:0:81481:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780996958.634098:0:81481:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780996958.634099:0:81481:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780996958.634100:0:81481:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780996958.634100:0:81481:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780996958.634101:0:81481:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780996958.634102:0:81481:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780996958.634103:0:81481:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780996958.634104:0:81481:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1780996958.634122:0:81481:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1780996958.634138:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126800256:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1780996958.634191:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996958.634221:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688887220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780996958.634241:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126800256 00000100:00100000:0.0:1780996958.634245:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126800256 00000100:00100000:0.0:1780996958.634291:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1780996958.634298:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:81481:x1867507126800256:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1780996958.634327:0:81489:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1780996958.634329:0:81489:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1780996958.634331:0:81489:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1780996958.634457:0:81491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1780996958.634518:0:81489:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 100 00000020:01000000:3.0:1780996958.635004:0:36:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.206.151@tcp 10000000:01000000:3.0:1780996958.635018:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1780996958.635020:0:36:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1780996958.635021:0:36:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780996958.635516:0:36:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780996958.635519:0:36:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780996958.635520:0:36:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780996958.635522:0:36:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780996958.635523:0:36:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780996958.635525:0:36:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780996958.635526:0:36:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1780996958.635624:0:36:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1780996958.635633:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1780996958.635635:0:36:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1780996958.635636:0:36:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1780996958.635638:0:36:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780996958.635639:0:36:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780996958.635640:0:36:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780996958.635641:0:36:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780996958.635643:0:36:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780996958.635644:0:36:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780996958.635645:0:36:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1780996958.635666:0:36:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1780996958.635671:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1780996958.635673:0:36:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1780996958.635674:0:36:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1780996958.635675:0:36:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000100:00080000:1.0:1780996958.635863:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996958.635873:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780996958.635885:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126800384:0@lo:253:kworker.0 00000100:00100000:1.0:1780996958.635950:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996958.635991:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126800384 00000100:00100000:1.0:1780996958.635997:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126800384 00000100:00100000:1.0:1780996958.636023:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1780996958.636397:0:36:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780996958.636398:0:36:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780996958.636400:0:36:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780996958.636401:0:36:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780996958.636403:0:36:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780996958.636404:0:36:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1780996958.636425:0:36:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1780996958.636454:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126800640:0@lo:253:kworker.0 00000100:00100000:3.0:1780996958.636491:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.636512:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780996958.636526:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126800512:0@lo:253:kworker.0 00000100:00100000:3.0:1780996958.636570:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.636607:0:81487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1780996958.636615:0:81487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1780996958.636806:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:3496:x1867507126800384:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1780996958.636849:0:81488:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:3.0:1780996958.637675:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126800640 00000100:00100000:3.0:1780996958.637683:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126800640 00000100:00100000:2.0:1780996958.637959:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126800512 00000100:00100000:2.0:1780996958.637964:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126800512 00000100:00100000:2.0:1780996958.637984:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1780996958.637991:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3499:x1867507126800640:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1780996958.638011:0:81492:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1780996958.638324:0:81487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:3.0:1780996958.638332:0:81487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:1.0:1780996958.640243:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1780996958.640258:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3499:x1867507126800512:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1780996958.640325:0:81493:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1780996958.648217:0:81494:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1780996958.648227:0:81494:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1780996958.648230:0:81494:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1780996958.648233:0:81494:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1780996958.648641:0:81494:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1780996958.648976:0:81489:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1780996958.649001:0:81489:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1780996958.649337:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:81481:x1867507126800256:12345-0@lo:253:mount.lustre.0 Request processed in 15036us (15140us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996958.649357:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1780996958.649468:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126800256:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1780996958.649483:0:81481:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1780996958.649492:0:81481:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1780996958.649494:0:81481:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780996958.649495:0:81481:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780996958.649497:0:81481:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780996958.649498:0:81481:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780996958.649499:0:81481:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780996958.649501:0:81481:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780996958.649502:0:81481:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780996958.649504:0:81481:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780996958.649505:0:81481:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1780996958.649527:0:81481:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9689ba675000 from lustre-MDT0000 10000000:01000000:0.0:1780996958.649560:0:81481:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1780996958.649563:0:81481:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1780996958.649573:0:81481:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9689ba675000 10000000:01000000:0.0:1780996958.649577:0:81481:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1780996958.649582:0:81481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9689ba675000 10000000:01000000:0.0:1780996958.649585:0:81481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1780996958.649589:0:81481:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9689ba675000 from 1 10000000:01000000:0.0:1780996958.649592:0:81481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1780996958.649634:0:81481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.649646:0:81481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.649656:0:81481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996958.649679:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126800768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780996958.649727:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996958.649781:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b11799c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780996958.650034:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126800768 00000100:00100000:2.0:1780996958.650041:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126800768 00000100:00100000:2.0:1780996958.650090:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1780996958.650099:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:81481:x1867507126800768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780996958.650112:0:81487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780996958.650129:0:81487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce3000/0x30fd811c03059459 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059452 expref: -99 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996958.650155:0:81487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce3000/0x30fd811c03059459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059452 expref: 8 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996958.650166:0:81487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce3000/0x30fd811c03059459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059452 expref: 8 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996958.650177:0:81487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3000, rc 0) 00000100:00100000:2.0:1780996958.650211:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:81481:x1867507126800768:12345-0@lo:101:mount.lustre.0 Request processed in 114us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996958.650218:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1780996958.650933:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126800768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780996958.650949:0:81481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.650969:0:81481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.650986:0:81481:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1780996958.651005:0:81481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.651013:0:81481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.651020:0:81481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1780996958.651024:0:81481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1780996958.651029:0:81481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9689ba675000 10000000:01000000:0.0:1780996958.651033:0:81481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1780996958.651037:0:81481:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1780996958.651039:0:81481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1780996958.651061:0:81481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.651069:0:81481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.651076:0:81481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996958.651091:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126800896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780996958.651132:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996958.651154:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b11799c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780996958.651176:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126800896 00000100:00100000:0.0:1780996958.651181:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126800896 00000100:00100000:0.0:1780996958.651204:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1780996958.651212:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:81481:x1867507126800896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780996958.651221:0:81489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780996958.651231:0:81489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff03000/0x30fd811c03059467 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059460 expref: -99 pid: 81489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.651249:0:81489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03000/0x30fd811c03059467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059460 expref: 9 pid: 81489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.651257:0:81489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff03000/0x30fd811c03059467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059460 expref: 9 pid: 81489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.651263:0:81489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03000, rc 0) 00000100:00100000:0.0:1780996958.651313:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81481:x1867507126800896:12345-0@lo:101:mount.lustre.0 Request processed in 102us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996958.651319:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1780996958.651350:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126800896:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780996958.651360:0:81481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.651367:0:81481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996958.651415:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126801024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780996958.651439:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996958.651457:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b11799c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780996958.651475:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126801024 00000100:00100000:0.0:1780996958.651478:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126801024 00000100:00100000:0.0:1780996958.651493:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1780996958.651499:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81481:x1867507126801024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780996958.651642:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81481:x1867507126801024:12345-0@lo:501:mount.lustre.0 Request processed in 142us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996958.651649:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1780996958.651677:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126801024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780996958.651702:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126801152:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780996958.651740:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996958.651751:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b11799c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780996958.651779:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126801152 00000100:00100000:0.0:1780996958.651784:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126801152 00000100:00100000:0.0:1780996958.652065:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1780996958.652073:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81481:x1867507126801152:12345-0@lo:503:mount.lustre.0 20000000:01000000:1.0:1780996958.652507:0:81488:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1780996958.654403:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81481:x1867507126801152:12345-0@lo:503:mount.lustre.0 Request processed in 2324us (2654us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996958.654415:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1780996958.654535:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126801152:0@lo:503:mount.lustre.0 20000000:01000000:1.0:1780996958.657015:0:81488:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1780996958.657036:0:81488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1780996958.657198:0:81491:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1780996958.657205:0:81491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1780996958.657233:0:81491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689bff03400/0x30fd811c0305946e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.657258:0:81491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03400/0x30fd811c0305946e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1780996958.657297:0:81491:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000064978s 00010000:00010000:0.0:1780996958.657304:0:81491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bff03400/0x30fd811c0305946e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.657311:0:81491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bff03400/0x30fd811c0305946e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.657335:0:81491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689bff03400/0x30fd811c0305946e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.657343:0:81491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689bff03400/0x30fd811c0305946e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.657350:0:81491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780996958.657354:0:81491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689bff03400/0x30fd811c0305946e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.657362:0:81491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689bff03400/0x30fd811c0305946e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.657377:0:81491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689bff03400/0x30fd811c0305946e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.657385:0:81491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689bff03400/0x30fd811c0305946e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.657392:0:81491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03400/0x30fd811c0305946e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1780996958.657828:0:81492:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1780996958.661813:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:3496:x1867507126800384:12345-0@lo:253:kworker.0 Request processed in 25003us (25853us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996958.661827:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1780996958.662335:0:3496:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1780996958.662339:0:3496:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1780996958.662340:0:3496:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780996958.662341:0:3496:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780996958.662343:0:3496:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780996958.662345:0:3496:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780996958.662346:0:3496:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780996958.662362:0:3496:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780996958.662364:0:3496:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1780996958.662369:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126800384:0@lo:253:kworker.0 20000000:01000000:2.0:1780996958.663713:0:81492:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780996958.663763:0:81492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1780996958.663893:0:81493:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1780996958.664419:0:81495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81495:1867507126801280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780996958.664506:0:81495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.664546:0:81495:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1780996958.664591:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126801280 00000100:00100000:1.0:1780996958.664597:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126801280 00000100:00100000:1.0:1780996958.664642:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1780996958.664651:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81495:x1867507126801280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780996958.665360:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81495:x1867507126801280:12345-0@lo:502:llog_process_th.0 Request processed in 706us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996958.665370:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1780996958.665883:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:3499:x1867507126800640:12345-0@lo:253:kworker.0 Request processed in 27890us (29388us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996958.665892:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1780996958.666381:0:81495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81495:1867507126801280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780996958.666427:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780996958.666439:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780996958.666441:0:81495:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1780996958.666446:0:81495:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1780996958.666449:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1780996958.666464:0:81495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff968886bd8000) 00000020:00000080:3.0:1780996958.666488:0:81495:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:3.0:1780996958.666494:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1780996958.666587:0:81495:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1780996958.666594:0:81495:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305947c 00000020:00000080:3.0:1780996958.666811:0:81495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1780996958.666816:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780996958.666819:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780996958.666821:0:81495:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1780996958.666823:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780996958.666827:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780996958.666828:0:81495:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1780996958.668430:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1780996958.668447:0:81495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff968886bdcd40) 00000020:00000080:3.0:1780996958.668475:0:81495:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:3.0:1780996958.668481:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1780996958.668483:0:81495:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1780996958.668486:0:81495:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1780996958.668493:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1780996958.668585:0:81495:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689ba675000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1780996958.668597:0:81495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff968886bd99c0) 00000020:00000080:3.0:1780996958.668608:0:81495:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:3.0:1780996958.668667:0:81495:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1780996958.668674:0:81495:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c03059491 00000020:00000080:3.0:1780996958.668796:0:81495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1780996958.668802:0:81495:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1780996958.668806:0:81495:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x30fd811c03059498 00080000:01000000:3.0:1780996958.668812:0:81495:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1780996958.668816:0:81495:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305949f 00000020:01000004:2.0:1780996958.669643:0:3499:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1780996958.669648:0:3499:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1780996958.669649:0:3499:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780996958.669651:0:3499:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780996958.669652:0:3499:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780996958.669654:0:3499:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780996958.669655:0:3499:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780996958.669657:0:3499:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780996958.669659:0:3499:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1780996958.669664:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126800640:0@lo:253:kworker.0 20000000:01000000:2.0:1780996958.670763:0:81493:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1780996958.671733:0:81491:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 2 10000000:01000000:0.0:1780996958.671742:0:81491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1780996958.671784:0:81491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689bff02800/0x30fd811c030594a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.671802:0:81491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02800/0x30fd811c030594a6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1780996958.671813:0:81491:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000073065s 00010000:00010000:0.0:1780996958.671827:0:81491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bff02800/0x30fd811c030594a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.671848:0:81491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bff02800/0x30fd811c030594a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.671855:0:81491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689bff02800/0x30fd811c030594a6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.671862:0:81491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689bff02800/0x30fd811c030594a6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.671869:0:81491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780996958.671874:0:81491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689bff02800/0x30fd811c030594a6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.671882:0:81491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689bff02800/0x30fd811c030594a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.671901:0:81491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689bff02800/0x30fd811c030594a6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.671909:0:81491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689bff02800/0x30fd811c030594a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.671915:0:81491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02800/0x30fd811c030594a6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1780996958.675493:0:81493:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1780996958.676334:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3499:x1867507126800512:12345-0@lo:253:kworker.0 Request processed in 36072us (39755us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996958.676349:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:0.0:1780996958.676525:0:3499:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1780996958.676528:0:3499:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1780996958.676529:0:3499:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780996958.676530:0:3499:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780996958.676532:0:3499:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780996958.676541:0:3499:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780996958.676542:0:3499:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780996958.676544:0:3499:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780996958.676546:0:3499:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1780996958.676550:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126800512:0@lo:253:kworker.0 00010000:00010000:2.0:1780996958.808524:0:81495:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1780996958.808657:0:81495:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 285c134c-d3a6-4c01-bb4d-8148c50d5f95 idx: 0 lr: 0 srv lr: 94489280512 lx: 0 gen 22 00000001:00080000:2.0:1780996958.808701:0:81495:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 94489280512 lx: 0 gen 21 00000001:00000004:2.0:1780996958.808721:0:81495:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 94489280512 00000001:00080000:2.0:1780996958.810176:0:81495:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1780996958.810235:0:81495:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff96888752ca80: xid 1867507110318976, transno 94489280513, client gen 22, slot idx 0 00000020:00000080:2.0:1780996958.810666:0:81495:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9689bfb38000) 00000020:00000080:2.0:1780996958.810687:0:81495:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:2.0:1780996958.810748:0:81495:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1780996958.810753:0:81495:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c030594c2 00000020:00000080:3.0:1780996958.815212:0:81495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1780996958.819656:0:81495:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x30fd811c030594c9 00000020:00000080:3.0:1780996958.822430:0:81495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1780996958.822445:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780996958.822453:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780996958.822455:0:81495:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1780996958.822459:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1780996958.822461:0:81495:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1780996958.822463:0:81495:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1780996958.822464:0:81495:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1780996958.822466:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1780996958.822469:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780996958.822471:0:81495:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1780996958.822473:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780996958.822478:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780996958.822480:0:81495:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1780996958.822485:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1780996958.822551:0:81495:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1780996958.822567:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780996958.822570:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780996958.822571:0:81495:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1780996958.822574:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780996958.822577:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780996958.822578:0:81495:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1780996958.822581:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1780996958.822586:0:81495:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:00000080:3.0:1780996958.822612:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1780996958.822631:0:81495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9688858c19c0) 00000020:00000080:3.0:1780996958.822655:0:81495:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1780996958.822660:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1780996958.822722:0:81495:0:(osp_dev.c:1197:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1780996958.822730:0:81495:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1780996958.822737:0:81495:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c030594d7 00010000:00080000:3.0:1780996958.822856:0:81495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689bca5b800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1780996958.827975:0:81495:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1780996958.829164:0:81495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780996958.829189:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1780996958.829233:0:81495:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1780996958.829253:0:81495:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c030594de 00000100:00080000:2.0:1780996958.829263:0:81495:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780996958.829297:0:81495:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9689bca5b800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996958.829337:0:81495:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b11a9f80 x1867507126801408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780996958.829412:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126801408:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780996958.829475:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996958.829556:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126801408 00000100:00100000:0.0:1780996958.829563:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126801408 00000100:00100000:0.0:1780996958.829592:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:0.0:1780996958.829599:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126801408:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1780996958.829622:0:8242:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3486 last 0 00000020:00000080:0.0:1780996958.829664:0:8242:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c030594e5 00000004:00100000:0.0:1780996958.829677:0:8242:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780996958.829767:0:8242:0:(import.c:65:import_set_state_nolock()) ffff968990cc2000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1780996958.829817:0:81495:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1780996958.829883:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780996958.829887:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780996958.829889:0:81495:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1780996958.829892:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1780996958.829895:0:81495:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1780996958.829897:0:81495:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780996958.829898:0:81495:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780996958.829900:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1780996958.829902:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780996958.829903:0:81495:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1780996958.829906:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1780996958.829910:0:81495:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1780996958.829913:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780996958.829914:0:81495:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1780996958.829917:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1780996958.829920:0:81495:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:2.0:1780996958.829937:0:81495:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1780996958.829939:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1780996958.829951:0:81495:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9689bfb3b380) 00000020:00000080:2.0:1780996958.829965:0:81495:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1780996958.829969:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1780996958.830020:0:81495:0:(osp_dev.c:1197:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1780996958.830026:0:81495:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1780996958.830037:0:81495:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c030594f3 00010000:00080000:2.0:1780996958.830059:0:81495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689bcb9d000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:2.0:1780996958.830239:0:81495:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:2.0:1780996958.831138:0:81495:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1780996958.831164:0:81495:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1780996958.831414:0:81495:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 21, last_idx 22 00000040:00080000:2.0:1780996958.831925:0:81495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780996958.831948:0:81495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].23, 64 off9664 00000040:00080000:2.0:1780996958.832070:0:81495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5c:0x0].1, 64 off8256 00000100:00100000:0.0:1780996958.832505:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126801408:12345-0@lo:38:llog_process_th.0 Request processed in 2900us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996958.832517:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000040:00080000:1.0:1780996958.832838:0:81501:0:(llog.c:800:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:1.0:1780996958.832843:0:81501:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1780996958.833615:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780996958.833626:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:3.0:1780996958.833634:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1780996958.833639:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1780996958.833643:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bca5b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1780996958.833660:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126801408:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1780996958.833842:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780996958.833855:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126801536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780996958.833912:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996958.833947:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126801536 00000100:00100000:0.0:1780996958.833953:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126801536 00000100:00100000:0.0:1780996958.833983:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:0.0:1780996958.833990:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126801536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780996958.834018:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780996958.834052:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126801536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996958.834058:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00100000:0.0:1780996958.834088:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126801536:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1780996958.834534:0:81495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780996958.834545:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1780996958.834581:0:81495:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1780996958.834597:0:81495:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c030594fa 00000100:00080000:2.0:1780996958.834603:0:81495:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780996958.834608:0:81495:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9689bcb9d000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996958.834631:0:81495:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b11a9500 x1867507126801664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780996958.834682:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126801664:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1780996958.834718:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996958.834853:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126801664 00000100:00100000:0.0:1780996958.834858:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126801664 00000100:00100000:0.0:1780996958.834886:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5900 00000100:00100000:0.0:1780996958.834891:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3495:x1867507126801664:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1780996958.834909:0:25171:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3486 last 0 00000020:00000080:0.0:1780996958.834943:0:25171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c03059501 00002000:00100000:0.0:1780996958.834954:0:25171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff968986140000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1780996958.834958:0:25171:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1780996958.834961:0:25171:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1780996958.835024:0:25171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1780996958.835045:0:25171:0:(import.c:65:import_set_state_nolock()) ffff968986140800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1780996958.835135:0:81495:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1780996958.835226:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780996958.835231:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780996958.835233:0:81495:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1780996958.835235:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1780996958.835238:0:81495:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1780996958.835240:0:81495:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780996958.835241:0:81495:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780996958.835243:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1780996958.835245:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780996958.835247:0:81495:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1780996958.835249:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1780996958.835254:0:81495:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1780996958.835257:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780996958.835265:0:81495:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1780996958.835295:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1780996958.835300:0:81495:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:2.0:1780996958.835322:0:81495:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1780996958.835324:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1780996958.835337:0:81495:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff968990fe0000) 00000020:00000080:2.0:1780996958.835354:0:81495:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:2.0:1780996958.835359:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1780996958.835428:0:81495:0:(osp_dev.c:1197:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1780996958.835435:0:81495:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1780996958.835441:0:81495:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305950f 00010000:00080000:2.0:1780996958.835466:0:81495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff968983330800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:2.0:1780996958.835648:0:81495:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1780996958.835716:0:81495:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1780996958.835729:0:81495:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1780996958.836395:0:81495:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 21, last_idx 22 00000040:00080000:2.0:1780996958.836985:0:81495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780996958.837011:0:81495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].23, 64 off9664 00000040:00080000:2.0:1780996958.837129:0:81495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].1, 64 off8256 00000100:00100000:0.0:1780996958.837251:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126801664:12345-0@lo:8:llog_process_th.0 Request processed in 2354us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996958.837263:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5900 00000040:00080000:0.0:1780996958.837683:0:81503:0:(llog.c:800:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:0.0:1780996958.837689:0:81503:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1780996958.838056:0:81503:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000040:00080000:0.0:1780996958.838073:0:81503:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1780996958.838206:0:81503:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000040:00080000:0.0:1780996958.838210:0:81503:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1780996958.838336:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780996958.838347:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1780996958.838355:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1780996958.838359:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1780996958.838363:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcb9d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1780996958.838425:0:3495:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:3.0:1780996958.838432:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126801664:0@lo:8:llog_process_th.0 00000040:00080000:0.0:1780996958.838564:0:81501:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x58:0x0] index 3 count 2 00000040:00080000:0.0:1780996958.838582:0:81501:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000040:00080000:0.0:1780996958.838585:0:81501:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000004:00080000:0.0:1780996958.838600:0:81501:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1780996958.838625:0:81501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3486384354292ns, next at 0ns, rc = 0 00080000:00080000:0.0:1780996958.838630:0:81501:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1780996958.838653:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126801792:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1780996958.838735:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.839882:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126801792 00000100:00100000:3.0:1780996958.839893:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126801792 00000100:00100000:3.0:1780996958.839945:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5901 00000100:00100000:3.0:1780996958.839953:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126801792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1780996958.839979:0:25181:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:642 count 1 00000100:00100000:3.0:1780996958.840073:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126801792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 119us (1338us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780996958.840080:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5901 00000100:00080000:3.0:1780996958.840100:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1780996958.840124:0:3497:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9689aded0000, transno 0 00000004:00080000:3.0:1780996958.840130:0:3497:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9689aded0000/1, rc -2, transno 0 00000100:00100000:3.0:1780996958.840141:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126801792:0@lo:6:osp-syn-0-0.0 00000020:00000080:2.0:1780996958.840548:0:81495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780996958.840560:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1780996958.840598:0:81495:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1780996958.840613:0:81495:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c03059516 00000100:00080000:2.0:1780996958.840620:0:81495:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780996958.840626:0:81495:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff968983330800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996958.840653:0:81495:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b11a8700 x1867507126801920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780996958.840675:0:81495:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1780996958.840712:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780996958.840715:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780996958.840725:0:81495:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1780996958.840729:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780996958.840733:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780996958.840734:0:81495:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1780996958.840737:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1780996958.840740:0:81495:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1780996958.840742:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780996958.840744:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780996958.840745:0:81495:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1780996958.840747:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780996958.840750:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780996958.840751:0:81495:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1780996958.840754:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1780996958.841153:0:81495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81495:1867507126802048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780996958.841226:0:81495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996958.841266:0:81495:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689811ca780 going to sleep for 11 seconds 00000040:00080000:0.0:1780996958.841944:0:81501:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:0.0:1780996958.841967:0:81501:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000004:00080000:0.0:1780996958.842177:0:81482:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1780996958.842881:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126802048 00000100:00100000:0.0:1780996958.842889:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126802048 00000100:00100000:0.0:1780996958.842934:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1780996958.842943:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:81495:x1867507126802048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780996958.843085:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:81495:x1867507126802048:12345-0@lo:502:llog_process_th.0 Request processed in 142us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996958.843093:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1780996958.843216:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126801920:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1780996958.843258:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.843320:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126801920 00000100:00100000:3.0:1780996958.843324:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126801920 00000100:00100000:3.0:1780996958.843346:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5902 00000100:00100000:3.0:1780996958.843351:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3495:x1867507126801920:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1780996958.843374:0:25182:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3486 last 0 00000020:00000080:3.0:1780996958.843402:0:25182:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305951d 00002000:00100000:3.0:1780996958.843422:0:25182:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96888b410000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1780996958.843426:0:25182:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1780996958.843430:0:25182:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1780996958.843486:0:25182:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1780996958.843508:0:25182:0:(import.c:65:import_set_state_nolock()) ffff96888b416800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780996958.843545:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126801920:12345-0@lo:8:llog_process_th.0 Request processed in 192us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996958.843552:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5902 00000100:00100000:3.0:1780996958.843585:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780996958.843592:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1780996958.843599:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1780996958.843603:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1780996958.843606:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968983330800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1780996958.843613:0:3495:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:3.0:1780996958.843618:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126801920:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1780996958.843675:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126802176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780996958.843701:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.843737:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126802176 00000100:00100000:3.0:1780996958.843741:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126802176 00000100:00100000:3.0:1780996958.843772:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:3.0:1780996958.843779:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126802176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780996958.843796:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996958.843827:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126802176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996958.843847:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00080000:3.0:1780996958.843861:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780996958.843896:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126802176:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1780996958.844034:0:81503:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1780996958.844084:0:81503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3486389813279ns, next at 0ns, rc = 0 00080000:00080000:0.0:1780996958.844091:0:81503:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1780996958.844620:0:81495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81495:1867507126802048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780996958.844651:0:81495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780996958.844658:0:81495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780996958.844659:0:81495:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1780996958.844663:0:81495:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1780996958.844913:0:81481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1780996958.844939:0:81481:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1780996958.844956:0:81481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996958.844968:0:81481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780996958.844976:0:81481:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9689ba675000 from 1 10000000:01000000:3.0:1780996958.844979:0:81481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1780996958.845013:0:81481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996958.845021:0:81481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996958.845029:0:81481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996958.845047:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126802304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1780996958.845103:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.845131:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a64bc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780996958.847489:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126802304 00000100:00100000:1.0:1780996958.847502:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126802304 00000100:00100000:1.0:1780996958.847557:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1780996958.847566:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:81481:x1867507126802304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780996958.847582:0:81492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996958.847601:0:81492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c0000/0x30fd811c0305952b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059524 expref: -99 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.847628:0:81492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c0000/0x30fd811c0305952b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059524 expref: 8 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.847640:0:81492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c0000/0x30fd811c0305952b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059524 expref: 8 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.847650:0:81492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0000, rc 0) 00000100:00100000:1.0:1780996958.850052:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:81481:x1867507126802304:12345-0@lo:101:mount.lustre.0 Request processed in 2477us (4938us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996958.850065:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1780996958.850199:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780996958.850221:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126802432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780996958.850292:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.850334:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126802432 00000100:00100000:3.0:1780996958.850341:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126802432 00000100:00100000:3.0:1780996958.850385:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1780996958.850411:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd19e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126802432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780996958.850438:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996958.850480:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd19e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126802432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996958.850486:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1780996958.850716:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126802432:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1780996958.851309:0:81482:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1780996958.852957:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126802304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780996958.852986:0:81481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305952b expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996958.852999:0:81481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305952b expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780996958.855241:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126802560:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1780996958.855398:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996958.855465:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689811ca780 going to sleep for 11 seconds 00000100:00100000:1.0:1780996958.855512:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126802560 00000100:00100000:1.0:1780996958.855521:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126802560 00000100:00100000:1.0:1780996958.855571:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1780996958.855577:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:81481:x1867507126802560:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1780996958.855596:0:81493:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1780996958.855611:0:81493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1780996958.855614:0:81493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1780996958.855616:0:81493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1780996958.855618:0:81493:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 103 00000100:00100000:1.0:1780996958.855714:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:81481:x1867507126802560:12345-0@lo:256:mount.lustre.0 Request processed in 135us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996958.855730:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1780996958.856060:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126802560:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1780996958.856944:0:81481:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1780996958.856970:0:81481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305952b expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996958.856984:0:81481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305952b expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780996958.856993:0:81481:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9689ba675000 from 1 10000000:01000000:2.0:1780996958.856995:0:81481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1780996958.857032:0:81481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996958.857039:0:81481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996958.857050:0:81481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780996958.857177:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126802688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780996958.857231:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996958.857266:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689811ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1780996958.857323:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126802688 00000100:00100000:0.0:1780996958.857330:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126802688 00000100:00100000:0.0:1780996958.857374:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1780996958.857383:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:81481:x1867507126802688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780996958.857394:0:81487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780996958.857411:0:81487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff02800/0x30fd811c03059539 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059532 expref: -99 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.857437:0:81487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02800/0x30fd811c03059539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059532 expref: 9 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.857448:0:81487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff02800/0x30fd811c03059539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059532 expref: 9 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.857470:0:81487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02800, rc 0) 00000100:00100000:0.0:1780996958.857647:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81481:x1867507126802688:12345-0@lo:101:mount.lustre.0 Request processed in 264us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996958.857653:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1780996958.857914:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126802688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780996958.857929:0:81481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996958.857942:0:81481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780996958.858010:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126802816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780996958.858041:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996958.858085:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689811ca780 going to sleep for 11 seconds 00000100:00100000:1.0:1780996958.858106:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126802816 00000100:00100000:1.0:1780996958.858111:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126802816 00000100:00100000:1.0:1780996958.858144:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1780996958.858152:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81481:x1867507126802816:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780996958.858312:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81481:x1867507126802816:12345-0@lo:501:mount.lustre.0 Request processed in 161us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996958.858319:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1780996958.858452:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126802816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780996958.858477:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126802944:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780996958.858514:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996958.858537:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689811ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1780996958.858593:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126802944 00000100:00100000:0.0:1780996958.858597:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126802944 00000100:00100000:0.0:1780996958.858661:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1780996958.858668:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81481:x1867507126802944:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780996958.858753:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81481:x1867507126802944:12345-0@lo:503:mount.lustre.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996958.858759:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1780996958.858820:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126802944:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780996958.859723:0:81505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81505:1867507126803072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780996958.859778:0:81505:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996958.859859:0:81505:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689811ca540 going to sleep for 11 seconds 00000100:00100000:0.0:1780996958.859888:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126803072 00000100:00100000:0.0:1780996958.859893:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126803072 00000100:00100000:0.0:1780996958.859952:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1780996958.859960:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81505:x1867507126803072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780996958.860624:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81505:x1867507126803072:12345-0@lo:502:llog_process_th.0 Request processed in 663us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996958.860632:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1780996958.860720:0:81505:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81505:1867507126803072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780996958.860752:0:81505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780996958.860771:0:81505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780996958.860773:0:81505:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1780996958.860781:0:81505:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9689ba675000 00000020:00000080:1.0:1780996958.860783:0:81505:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1780996958.860792:0:81505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780996958.860795:0:81505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780996958.860796:0:81505:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1780996958.860799:0:81505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780996958.860801:0:81505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780996958.860803:0:81505:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1780996958.860806:0:81505:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9689ba675000 00000020:00000080:1.0:1780996958.860808:0:81505:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1780996958.860903:0:81505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba186300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81505:1867507126803200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780996958.860944:0:81505:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996958.863119:0:81505:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993900 going to sleep for 11 seconds 00000100:00100000:2.0:1780996958.863221:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126803200 00000100:00100000:2.0:1780996958.863232:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126803200 00000100:00100000:2.0:1780996958.863349:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1780996958.863359:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81505:x1867507126803200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780996958.863531:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81505:x1867507126803200:12345-0@lo:502:llog_process_th.0 Request processed in 174us (2587us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996958.863540:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1780996958.863616:0:81505:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba186300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81505:1867507126803200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780996958.863648:0:81505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780996958.863656:0:81505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780996958.863659:0:81505:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1780996958.863663:0:81505:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1780996958.864339:0:81481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1780996958.864366:0:81481:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780996958.865874:0:81481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996958.865892:0:81481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780996958.865972:0:81481:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1780996958.865975:0:81481:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9689ba675000 10000000:01000000:2.0:1780996958.865979:0:81481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9689ba675000 10000000:01000000:2.0:1780996958.865983:0:81481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1780996958.865989:0:81481:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689ba675000 from 1 10000000:01000000:2.0:1780996958.865991:0:81481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780996958.866033:0:81481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996958.866042:0:81481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996958.866053:0:81481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780996958.866079:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126803328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780996958.866146:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996958.866195:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991d23f00 going to sleep for 11 seconds 00000100:00100000:3.0:1780996958.866298:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126803328 00000100:00100000:3.0:1780996958.866307:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126803328 00000100:00100000:3.0:1780996958.866354:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1780996958.866362:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:81481:x1867507126803328:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780996958.866375:0:81492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780996958.866388:0:81492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb2600/0x30fd811c03059547 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059540 expref: -99 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996958.866411:0:81492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb2600/0x30fd811c03059547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059540 expref: 10 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996958.866420:0:81492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb2600/0x30fd811c03059547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059540 expref: 10 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996958.866428:0:81492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2600, rc 0) 00000100:00100000:3.0:1780996958.866468:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81481:x1867507126803328:12345-0@lo:101:mount.lustre.0 Request processed in 106us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996958.866475:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1780996958.866525:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126803328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780996958.866540:0:81481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996958.866560:0:81481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996958.866614:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126803456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780996958.866642:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.866657:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a1840 going to sleep for 11 seconds 00000100:00100000:2.0:1780996958.866721:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126803456 00000100:00100000:2.0:1780996958.866726:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126803456 00000100:00100000:2.0:1780996958.866768:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1780996958.866775:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81481:x1867507126803456:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780996958.866906:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81481:x1867507126803456:12345-0@lo:501:mount.lustre.0 Request processed in 132us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996958.866913:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1780996958.867033:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126803456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780996958.867059:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126803584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780996958.867100:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.867127:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1780996958.867191:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126803584 00000100:00100000:0.0:1780996958.867196:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126803584 00000100:00100000:0.0:1780996958.867340:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1780996958.867349:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81481:x1867507126803584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780996958.867435:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81481:x1867507126803584:12345-0@lo:503:mount.lustre.0 Request processed in 87us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996958.867447:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1780996958.867543:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126803584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780996958.868413:0:81507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81507:1867507126803712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780996958.868464:0:81507:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.868532:0:81507:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1780996958.868566:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126803712 00000100:00100000:1.0:1780996958.868571:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126803712 00000100:00100000:1.0:1780996958.868632:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1780996958.868647:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81507:x1867507126803712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780996958.868979:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81507:x1867507126803712:12345-0@lo:502:llog_process_th.0 Request processed in 332us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996958.868987:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1780996958.869078:0:81507:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81507:1867507126803712:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1780996958.869135:0:81507:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1780996958.869155:0:81507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9689aeba19c0) 00000020:00000080:3.0:1780996958.869183:0:81507:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1780996958.869375:0:81507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689ba675000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1780996958.869379:0:81507:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689ba675000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1780996958.869382:0:81507:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689ba675000 4 00010000:00080000:3.0:1780996958.869410:0:81507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96888969a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1780996958.873637:0:81507:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1780996958.877010:0:81507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1780996958.877130:0:81507:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1780996958.877147:0:81507:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x30fd811c03059555 00000100:00080000:3.0:1780996958.877158:0:81507:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1780996958.877164:0:81507:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96888969a800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996958.877210:0:81507:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba2e3800 x1867507126803840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780996958.877247:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126803840:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780996958.877365:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780996958.877434:0:81507:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1780996958.877470:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126803840 00000100:00100000:1.0:1780996958.877478:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126803840 00000100:00100000:1.0:1780996958.877510:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:1.0:1780996958.877518:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126803840:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1780996958.877571:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126803840:12345-0@lo:38:llog_process_th.0 Request processed in 52us (205us total) trans 0 rc -11/-11 00000100:00100000:1.0:1780996958.877578:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:3.0:1780996958.877596:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780996958.877602:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888969a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780996958.877607:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1780996958.877610:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126803840:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780996958.878512:0:81507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81507:1867507126803968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780996958.878565:0:81507:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.878589:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126803968 00000100:00100000:3.0:1780996958.878594:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126803968 00000100:00100000:3.0:1780996958.878631:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1780996958.878638:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81507:x1867507126803968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780996958.878950:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81507:x1867507126803968:12345-0@lo:502:llog_process_th.0 Request processed in 311us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996958.878957:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1780996958.878999:0:81507:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898133a600 going to sleep for 11 seconds 00000100:00100000:3.0:1780996958.879014:0:81507:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81507:1867507126803968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780996958.879051:0:81507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81507:1867507126804096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780996958.879513:0:81507:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.879536:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126804096 00000100:00100000:3.0:1780996958.879539:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126804096 00000100:00100000:3.0:1780996958.879563:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1780996958.879570:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81507:x1867507126804096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780996958.879631:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81507:x1867507126804096:12345-0@lo:502:llog_process_th.0 Request processed in 61us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996958.879637:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1780996958.879666:0:81507:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898133a600 going to sleep for 11 seconds 00000100:00100000:3.0:1780996958.879689:0:81507:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81507:1867507126804096:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780996958.879711:0:81507:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1780996958.880319:0:81481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1780996958.880340:0:81481:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780996958.880358:0:81481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996958.880370:0:81481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1780996958.880421:0:81481:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1780996958.880424:0:81481:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1780996958.880425:0:81481:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780996958.880426:0:81481:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780996958.880427:0:81481:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780996958.880429:0:81481:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780996958.880430:0:81481:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780996958.880432:0:81481:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1780996958.880434:0:81481:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780996958.880435:0:81481:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1780996958.880439:0:81481:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1780996958.880441:0:81481:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1780996958.880442:0:81481:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1780996958.880443:0:81481:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780996958.880445:0:81481:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780996958.880446:0:81481:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780996958.880447:0:81481:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780996958.880448:0:81481:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780996958.880449:0:81481:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1780996958.880450:0:81481:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780996958.880451:0:81481:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1780996958.880468:0:81481:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1780996958.880480:0:81481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126804224:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1780996958.880522:0:81481:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996958.880553:0:81481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689845e7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1780996958.880863:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126804224 00000100:00100000:3.0:1780996958.880869:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126804224 00000100:00100000:3.0:1780996958.880905:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1780996958.880912:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81481:x1867507126804224:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1780996958.880930:0:81487:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1780996958.880942:0:81487:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1780996958.890210:0:81487:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1780996958.890233:0:81487:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1780996958.890431:0:81491:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1780996958.890436:0:81491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1780996958.890457:0:81491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.890475:0:81491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bc4c0000/0x30fd811c0305952b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059524 expref: 10 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.890484:0:81491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.890530:0:81491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bc4c0000/0x30fd811c0305952b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c03059524 expref: 10 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.890546:0:81491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bc4c0000/0x30fd811c0305952b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c03059524 expref: 10 pid: 81492 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996958.890561:0:81491:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:81491:1867507126804352:0@lo:104: 00000100:00100000:0.0:1780996958.890624:0:81491:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996958.890662:0:81491:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689869fa600 going to sleep for 11 seconds 00000100:00100000:2.0:1780996958.890790:0:9303:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1780996958.890809:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126804352 00000100:00100000:2.0:1780996958.890816:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126804352 00000100:00100000:2.0:1780996958.890879:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1780996958.890888:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb1f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:81491:x1867507126804352:12345-0@lo:104: 00010000:00010000:2.0:1780996958.890903:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305952b expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996958.890968:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:81481:x1867507126804224:12345-0@lo:253:mount.lustre.0 Request processed in 10054us (10443us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996958.890978:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1780996958.891002:0:81481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:81481:1867507126804224:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1780996958.891014:0:81481:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1780996958.891017:0:81481:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1780996958.891019:0:81481:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780996958.891020:0:81481:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780996958.891022:0:81481:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780996958.891023:0:81481:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780996958.891024:0:81481:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780996958.891026:0:81481:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780996958.891027:0:81481:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780996958.891029:0:81481:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780996958.891031:0:81481:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1780996958.891045:0:81481:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1780996958.891961:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1780996958.891970:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb1f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:81491:x1867507126804352:12345-0@lo:104: Request processed in 1082us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996958.891978:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1780996958.892147:0:81491:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:81491:1867507126804352:0@lo:104: 00010000:00010000:1.0:1780996958.892167:0:81491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.892264:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780996958.892641:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305952b expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.892650:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2200 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:0.0:1780996958.892654:0:6339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305952b expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.892664:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305952b expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996958.892688:0:6339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305952b expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996958.892800:0:6339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1780996958.892846:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305952b expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.892854:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780996958.892873:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305952b expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.892881:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2200/0x30fd811c03059524 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305952b expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996958.892896:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996958.892898:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996958.892900:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996958.893098:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126804480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780996958.893158:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996958.893319:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126804480 00000100:00100000:1.0:1780996958.893327:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126804480 00010000:00010000:1.0:1780996958.893374:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bc4c0000/0x30fd811c0305952b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c03059524 expref: 10 pid: 81492 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780996958.893406:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:1.0:1780996958.893415:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:3496:x1867507126804480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780996958.893429:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780996958.893434:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bc4c0000/0x30fd811c0305952b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c03059524 expref: 10 pid: 81492 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.893445:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bc4c0000/0x30fd811c0305952b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c03059524 expref: 10 pid: 81492 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.893460:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c0000/0x30fd811c0305952b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c03059524 expref: 10 pid: 81492 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.893475:0:25183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.893484:0:25183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780996958.893499:0:25183:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003062988s 00010000:00010000:1.0:1780996958.893504:0:25183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.893512:0:25183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.893520:0:25183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.893527:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.893539:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996958.893544:0:25183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.893553:0:25183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.893571:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996958.893580:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780996958.893614:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:3496:x1867507126804480:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996958.893622:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00010000:00010000:3.0:1780996958.893968:0:81491:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996958.893989:0:81491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996958.893996:0:81491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03400/0x30fd811c0305955c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996958.894029:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126804480:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1780996958.907986:0:81481:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444067 00000040:01000000:2.0:1780996958.908879:0:81481:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1780996958.909959:0:81514:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1780996958.910023:0:81514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1780996958.910070:0:81481:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1780996958.910638:0:81515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81515:1867507126804608:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780996958.910705:0:81515:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.910748:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126804608 00000100:00100000:3.0:1780996958.910763:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126804608 00000100:00100000:3.0:1780996958.910801:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:3.0:1780996958.910809:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81515:x1867507126804608:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780996958.910896:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81515:x1867507126804608:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996958.910904:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00100000:3.0:1780996958.910931:0:81515:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a1780 going to sleep for 11 seconds 00000100:00100000:3.0:1780996958.910960:0:81515:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81515:1867507126804608:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1780996958.911000:0:81515:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1780996958.911025:0:81515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81515:1867507126804736:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780996958.911053:0:81515:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.911072:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126804736 00000100:00100000:3.0:1780996958.911076:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126804736 00000100:00100000:3.0:1780996958.911095:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:3.0:1780996958.911101:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81515:x1867507126804736:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780996958.911188:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81515:x1867507126804736:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996958.911195:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:3.0:1780996958.911223:0:81515:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886ff90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780996958.911235:0:81515:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81515:1867507126804736:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780996958.911308:0:81515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81515:1867507126804864:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780996958.911329:0:81515:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996958.911344:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126804864 00000100:00100000:3.0:1780996958.911347:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126804864 00000100:00100000:3.0:1780996958.911362:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:3.0:1780996958.911368:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81515:x1867507126804864:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780996958.911400:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81515:x1867507126804864:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 33us (71us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996958.911406:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00000100:00100000:3.0:1780996958.911421:0:81515:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886ff90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780996958.911431:0:81515:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81515:1867507126804864:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1780996958.911461:0:81515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1780996958.914592:0:81481:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1780996958.914631:0:81481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1780996958.914856:0:81513:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444067 00000020:00080000:0.0:1780996958.914862:0:81513:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444067 00000004:00000080:1.0:1780996958.915344:0:81481:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1780996958.915353:0:81481:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1780996958.915394:0:81481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780996958.916370:0:81514:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1780996958.916449:0:81514:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1780996958.919248:0:81481:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1780996958.919914:0:81515:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1780996958.920086:0:81515:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1780996958.920091:0:81515:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1780996958.920203:0:81481:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1780996958.920267:0:81481:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1780996958.925181:0:81481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1780996958.925812:0:81481:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4a:0x0] (8/32) registered 00010000:00080000:1.0:1780996958.930014:0:81481:0:(ldlm_lib.c:3037:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 94489280513 00010000:00080000:3.0:1780996958.939288:0:81516:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 81516 00010000:02000000:3.0:1780996958.939322:0:81516:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1780996958.939325:0:81516:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1780996958.939329:0:81516:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1780996958.939943:0:81481:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1780996958.939964:0:81481:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1780996958.939984:0:81481:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:0.0:1780996958.940006:0:81481:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1780996958.943081:0:81481:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780996958.943743:0:81481:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1780996958.965512:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996959.299080:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996959.300110:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110328192 00000100:00100000:2.0:1780996959.300126:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110328192 00000100:00100000:2.0:1780996959.300239:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:2.0:1780996959.300250:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+4:41993:x1867507110328192:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780996959.300284:0:81492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780996959.300305:0:81492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce3e00/0x30fd811c03059563 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a88 expref: -99 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996959.300334:0:81492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce3e00/0x30fd811c03059563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a88 expref: 5 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996959.300354:0:81492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce3e00/0x30fd811c03059563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a88 expref: 5 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996959.300363:0:81492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3e00, rc 0) 00000100:00100000:2.0:1780996959.300432:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110328192:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 184us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996959.300439:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1780996959.305307:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996959.305448:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110328320 00000100:00100000:3.0:1780996959.305460:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110328320 00000100:00100000:3.0:1780996959.305521:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1780996959.305531:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110328320:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780996959.305559:0:81493:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1780996959.305577:0:81493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780996959.305582:0:81493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1780996959.305585:0:81493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1780996959.305588:0:81493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1780996959.305591:0:81493:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:3.0:1780996959.307879:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110328320:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 Request processed in 2339us (2602us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996959.307893:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:1.0:1780996959.311438:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996959.311476:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996959.311566:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110328576 00000100:00100000:3.0:1780996959.311576:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110328576 00000100:00100000:3.0:1780996959.311664:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1780996959.311675:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110328576:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780996959.311692:0:81487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1780996959.311698:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110328448 00000100:00100000:2.0:1780996959.311705:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110328448 00010000:00010000:3.0:1780996959.311710:0:81487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb2200/0x30fd811c0305956a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a8f expref: -99 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780996959.311735:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1073 00010000:00010000:3.0:1780996959.311739:0:81487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb2200/0x30fd811c0305956a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a8f expref: 6 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780996959.311746:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110328448:12345-192.168.206.51@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1780996959.311769:0:63417:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '285c134c-d3a6-4c01-bb4d-8148c50d5f95' at ffff9689bc9e0000, cookie 0x30fd811c030594ad 00010000:00080000:2.0:1780996959.311774:0:63417:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp recovering/t94489280514 exp ffff9689bc9e0000 cur 3486 last 1780996958 00010000:02000400:2.0:1780996959.311782:0:63417:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00010000:3.0:1780996959.312586:0:81487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb2200/0x30fd811c0305956a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a8f expref: 6 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996959.312601:0:81487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2200, rc 0) 00000100:00100000:3.0:1780996959.312680:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+6:41993:x1867507110328576:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 1006us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996959.312689:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1780996959.317111:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996959.317912:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110328704 00000100:00100000:3.0:1780996959.317928:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110328704 00000100:00100000:3.0:1780996959.318002:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1780996959.318013:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+6:41993:x1867507110328704:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780996959.318399:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110328704:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 386us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996959.318406:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00010000:00080000:2.0:1780996959.328036:0:63417:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1780996959.328131:0:63417:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1780996959.328314:0:63417:0:(import.c:65:import_set_state_nolock()) ffff9689bb5a4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780996959.328531:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110328448:12345-192.168.206.51@tcp:38:ll_cfg_requeue.0 Request processed in 16784us (17099us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996959.328544:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1073 00000100:00100000:2.0:1780996959.328646:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996959.330028:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110328832 00000100:00100000:3.0:1780996959.330039:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110328832 00000100:00100000:3.0:1780996959.330781:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1780996959.330793:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110328832:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780996959.330965:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110328832:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 174us (2319us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996959.330973:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:2.0:1780996959.331102:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996959.331868:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110321408 00000100:00100000:3.0:1780996959.331877:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110321408 00000100:00100000:3.0:1780996959.331936:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1074 00000100:00100000:3.0:1780996959.331945:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110321408:12345-192.168.206.51@tcp:36:mcreate.0 00010000:00080000:3.0:1780996959.331961:0:80049:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 94489280514, current: 94489280514, replaying 00000100:00100000:3.0:1780996959.332030:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110321408:12345-192.168.206.51@tcp:36:mcreate.0 Request processed in 87us (929us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780996959.332038:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1074 00010000:00080000:2.0:1780996959.334164:0:81516:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1780996959.343993:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996959.347364:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110328960 00000100:00100000:3.0:1780996959.347381:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110328960 00000100:00100000:3.0:1780996959.347516:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1780996959.347652:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110328960:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780996959.347669:0:81487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780996959.347688:0:81487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb3600/0x30fd811c03059571 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a96 expref: -99 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996959.347913:0:81487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb3600/0x30fd811c03059571 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a96 expref: 8 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996959.347925:0:81487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb3600/0x30fd811c03059571 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a96 expref: 8 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996959.347935:0:81487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3600, rc 0) 00000100:00100000:3.0:1780996959.347994:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110328960:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 469us (4009us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996959.348001:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1780996959.354056:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996959.354093:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110329088 00000100:00100000:3.0:1780996959.354102:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110329088 00000100:00100000:3.0:1780996959.354147:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:3.0:1780996959.354157:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110329088:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780996959.354501:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110329088:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 344us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996959.354510:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:2.0:1780996959.363260:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996959.364415:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110329216 00000100:00100000:3.0:1780996959.364438:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110329216 00000100:00100000:2.0:1780996959.365297:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1780996959.365310:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110329216:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780996959.365459:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110329216:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 151us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996959.365468:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1780996959.388337:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996959.388695:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110329344 00000100:00100000:0.0:1780996959.388707:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110329344 00000100:00100000:0.0:1780996959.388791:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:0.0:1780996959.388801:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110329344:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780996959.388819:0:81489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780996959.388848:0:81489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff02e00/0x30fd811c03059578 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a9d expref: -99 pid: 81489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996959.388876:0:81489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02e00/0x30fd811c03059578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a9d expref: 9 pid: 81489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996959.388888:0:81489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff02e00/0x30fd811c03059578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a9d expref: 9 pid: 81489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996959.388898:0:81489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02e00, rc 0) 00000100:00100000:0.0:1780996959.388952:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+9:41993:x1867507110329344:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 153us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996959.388959:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:1.0:1780996959.391522:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996959.392185:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110329472 00000100:00100000:3.0:1780996959.392196:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110329472 00000100:00100000:3.0:1780996959.392247:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:3.0:1780996959.392256:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:5bc603cc-b633-43af-a003-872c004686c8+9:41993:x1867507110329472:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780996959.392501:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:5bc603cc-b633-43af-a003-872c004686c8+9:41993:x1867507110329472:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 245us (988us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780996959.392510:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00010000:00010000:0.0:1780996959.973606:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1780996960.166720:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1780996960.166732:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9689ba675000 from 104 10000000:01000000:3.0:1780996960.166738:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1780996960.166787:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.166798:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.166808:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996960.166846:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126804992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.166916:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996960.166961:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780996960.167692:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126804992 00000100:00100000:2.0:1780996960.167702:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126804992 00000100:00100000:2.0:1780996960.167773:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1780996960.167784:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:6348:x1867507126804992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780996960.167799:0:81488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780996960.167814:0:81488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce3800/0x30fd811c03059586 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305957f expref: -99 pid: 81488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.167849:0:81488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce3800/0x30fd811c03059586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305957f expref: 10 pid: 81488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.167870:0:81488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce3800/0x30fd811c03059586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305957f expref: 10 pid: 81488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.167880:0:81488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3800, rc 0) 00000100:00100000:2.0:1780996960.167939:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126804992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996960.167946:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1780996960.168098:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126804992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780996960.168113:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.168122:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996960.168192:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.168226:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996960.168255:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780996960.168483:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126805120 00000100:00100000:2.0:1780996960.168488:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126805120 00000100:00100000:2.0:1780996960.168565:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1780996960.168572:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126805120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1780996960.168593:0:81492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1780996960.168608:0:81492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1780996960.168611:0:81492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 104 00000100:00100000:2.0:1780996960.168693:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126805120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996960.168700:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1780996960.168766:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1780996960.168807:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1780996960.168814:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.168831:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780996960.168840:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1780996960.168842:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968886f5e000 from 52 10000000:01000000:3.0:1780996960.168845:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780996960.168870:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3000/0x30fd811c0305958d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.168878:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3000/0x30fd811c0305958d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.168885:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3000/0x30fd811c0305958d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996960.168897:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.168918:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996960.169215:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.169415:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126805248 00000100:00100000:1.0:1780996960.169422:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126805248 00000100:00100000:1.0:1780996960.169448:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1780996960.169455:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126805248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780996960.169463:0:81487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996960.169471:0:81487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c0a00/0x30fd811c03059594 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305958d expref: -99 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.169487:0:81487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c0a00/0x30fd811c03059594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305958d expref: 11 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.169495:0:81487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c0a00/0x30fd811c03059594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305958d expref: 11 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.169501:0:81487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0a00, rc 0) 00000100:00100000:1.0:1780996960.169530:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126805248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.169536:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1780996960.169578:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780996960.169589:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3000/0x30fd811c0305958d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059594 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.169597:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3000/0x30fd811c0305958d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059594 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780996960.169655:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.169680:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996960.169707:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72540 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.169731:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126805376 00000100:00100000:1.0:1780996960.169735:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126805376 00000100:00100000:1.0:1780996960.169771:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1780996960.169778:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126805376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.170000:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126805376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.170007:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1780996960.170046:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.170201:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.170251:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996960.170304:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72540 going to sleep for 11 seconds 00000100:00100000:3.0:1780996960.170453:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126805504 00000100:00100000:3.0:1780996960.170463:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126805504 00000100:00100000:3.0:1780996960.170498:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1780996960.170505:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126805504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.170584:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126805504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996960.170590:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1780996960.170690:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780996960.172140:0:81583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1780996960.172406:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1780996960.172427:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780996960.172438:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3000/0x30fd811c0305958d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059594 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.172450:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3000/0x30fd811c0305958d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059594 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780996960.172459:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1780996960.172462:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff968886f5e000 from 101 10000000:01000000:1.0:1780996960.172465:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1780996960.172497:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1400/0x30fd811c0305959b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.172505:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1400/0x30fd811c0305959b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.172525:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1400/0x30fd811c0305959b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780996960.172545:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.172595:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996960.172629:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72540 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.172643:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126805632 00000100:00100000:1.0:1780996960.172648:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126805632 00000100:00100000:1.0:1780996960.172687:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1780996960.172694:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126805632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780996960.172705:0:81493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996960.172715:0:81493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c0200/0x30fd811c030595a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305959b expref: -99 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.172737:0:81493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c0200/0x30fd811c030595a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305959b expref: 12 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.172757:0:81493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c0200/0x30fd811c030595a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305959b expref: 12 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.172765:0:81493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0200, rc 0) 00000100:00100000:1.0:1780996960.172797:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126805632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.172804:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1780996960.172851:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780996960.172977:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1400/0x30fd811c0305959b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595a2 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.172994:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1400/0x30fd811c0305959b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c030595a2 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780996960.173047:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.173077:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996960.173092:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72540 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.173105:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126805760 00000100:00100000:1.0:1780996960.173107:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126805760 00000100:00100000:1.0:1780996960.173130:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1780996960.173136:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126805760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1780996960.173148:0:81487:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1780996960.173164:0:81487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1780996960.173168:0:81487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1780996960.173170:0:81487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1780996960.173173:0:81487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1780996960.173175:0:81487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:1.0:1780996960.173261:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126805760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.173295:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1780996960.173325:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1780996960.173392:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780996960.173398:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1400/0x30fd811c0305959b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595a2 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.173406:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1400/0x30fd811c0305959b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595a2 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780996960.173421:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1780996960.173422:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1780996960.173424:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1780996960.173437:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1a00/0x30fd811c030595a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.173443:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1a00/0x30fd811c030595a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.173450:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1a00/0x30fd811c030595a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780996960.173460:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.173483:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996960.173501:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72540 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.173511:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126805888 00000100:00100000:1.0:1780996960.173514:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126805888 00000100:00100000:1.0:1780996960.173533:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1780996960.173538:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126805888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780996960.173544:0:81493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996960.173551:0:81493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c1600/0x30fd811c030595b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c030595a9 expref: -99 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.173564:0:81493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c1600/0x30fd811c030595b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c030595a9 expref: 13 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.173571:0:81493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c1600/0x30fd811c030595b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c030595a9 expref: 13 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.173586:0:81493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1600, rc 0) 00000100:00100000:1.0:1780996960.173613:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126805888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.173619:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1780996960.173646:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126805888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780996960.173656:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1a00/0x30fd811c030595a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595b0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.173664:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1a00/0x30fd811c030595a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c030595b0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780996960.173714:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.173738:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996960.174008:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72540 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.174078:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126806016 00000100:00100000:1.0:1780996960.174083:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126806016 00000100:00100000:1.0:1780996960.174107:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1780996960.174113:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126806016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.174561:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126806016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 447us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.174568:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1780996960.174691:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.174726:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.174850:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996960.174984:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.175017:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126806144 00000100:00100000:1.0:1780996960.175078:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126806144 00000100:00100000:1.0:1780996960.175140:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1780996960.175147:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126806144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.176635:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126806144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1483us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996960.176645:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1780996960.176734:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780996960.178502:0:81584:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1780996960.178665:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1780996960.178688:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1780996960.178700:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1a00/0x30fd811c030595a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595b0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.178723:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1a00/0x30fd811c030595a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595b0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996960.178733:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1780996960.178736:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff968886f5e000 from 1 10000000:01000000:0.0:1780996960.178739:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1780996960.178791:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030595b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.178799:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030595b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.178809:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030595b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996960.178845:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.178915:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996960.178956:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722780 going to sleep for 11 seconds 00000100:00100000:2.0:1780996960.179124:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126806272 00000100:00100000:2.0:1780996960.179131:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126806272 00000100:00100000:2.0:1780996960.179188:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1780996960.179197:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126806272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780996960.179221:0:81492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780996960.179233:0:81492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce2e00/0x30fd811c030595be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c030595b7 expref: -99 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.179257:0:81492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce2e00/0x30fd811c030595be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c030595b7 expref: 14 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.179289:0:81492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce2e00/0x30fd811c030595be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c030595b7 expref: 14 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.179298:0:81492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2e00, rc 0) 00000100:00100000:2.0:1780996960.179340:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507126806272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996960.179346:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1780996960.179536:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780996960.179549:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030595b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595be expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.179558:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030595b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c030595be expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996960.179573:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1780996960.179577:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030595b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595be expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.179596:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030595b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595be expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996960.179603:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1780996960.179605:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff968886f5e000 from 7 10000000:01000000:0.0:1780996960.179607:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780996960.179623:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c030595c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.179631:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c030595c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.179637:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c030595c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996960.179650:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.179673:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996960.179702:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722780 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.179744:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126806400 00000100:00100000:1.0:1780996960.179748:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126806400 00000100:00100000:1.0:1780996960.179780:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1780996960.179788:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968987103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507126806400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780996960.179795:0:81493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996960.179803:0:81493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c1c00/0x30fd811c030595cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c030595c5 expref: -99 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.179817:0:81493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c1c00/0x30fd811c030595cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c030595c5 expref: 15 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.179868:0:81493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c1c00/0x30fd811c030595cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c030595c5 expref: 15 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.179875:0:81493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1c00, rc 0) 00000100:00100000:1.0:1780996960.179906:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968987103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126806400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.179912:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1780996960.180955:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780996960.180982:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c030595c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595cc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.180991:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c030595c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c030595cc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996960.181381:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.181430:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996960.181531:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722780 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.181806:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126806528 00000100:00100000:1.0:1780996960.181813:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126806528 00000100:00100000:1.0:1780996960.181955:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1780996960.181975:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968987100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126806528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.182348:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968987100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126806528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.182356:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1780996960.182447:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.182482:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.182523:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996960.182756:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722780 going to sleep for 11 seconds 00000100:00100000:2.0:1780996960.182896:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126806656 00000100:00100000:2.0:1780996960.182903:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126806656 00000100:00100000:2.0:1780996960.182944:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1780996960.182954:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968987101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126806656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780996960.183076:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968987101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126806656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996960.183083:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1780996960.183562:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780996960.189608:0:81585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1780996960.190538:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1780996960.190574:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780996960.190590:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c030595c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595cc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.190604:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c030595c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595cc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780996960.190682:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780996960.190685:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689bfa99000 from 52 10000000:01000000:2.0:1780996960.190689:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780996960.190734:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce2a00/0x30fd811c030595d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.190742:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968983ce2a00/0x30fd811c030595d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.190819:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968983ce2a00/0x30fd811c030595d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780996960.190918:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780996960.190988:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996960.191127:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a5f5dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1780996960.192249:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126806784 00000100:00100000:0.0:1780996960.192259:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126806784 00000100:00100000:1.0:1780996960.192578:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1780996960.192588:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968987100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126806784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780996960.192603:0:81488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996960.192696:0:81488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c1e00/0x30fd811c030595da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c030595d3 expref: -99 pid: 81488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.192730:0:81488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c1e00/0x30fd811c030595da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c030595d3 expref: 16 pid: 81488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.192743:0:81488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c1e00/0x30fd811c030595da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c030595d3 expref: 16 pid: 81488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.192765:0:81488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1e00, rc 0) 00000100:00100000:1.0:1780996960.192851:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968987100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126806784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 264us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.192925:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1780996960.193028:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780996960.193046:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968983ce2a00/0x30fd811c030595d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595da expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.193054:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968983ce2a00/0x30fd811c030595d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c030595da expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996960.193131:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.193170:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996960.193644:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722000 going to sleep for 11 seconds 00000100:00100000:2.0:1780996960.194307:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126806912 00000100:00100000:2.0:1780996960.194314:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126806912 00000100:00100000:2.0:1780996960.194363:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1780996960.194386:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968987101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126806912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780996960.194534:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968987101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126806912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996960.194542:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1780996960.194708:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126806912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.194812:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.194935:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996960.194969:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722000 going to sleep for 11 seconds 00000100:00100000:2.0:1780996960.195130:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126807040 00000100:00100000:2.0:1780996960.195135:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126807040 00000100:00100000:2.0:1780996960.195171:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1780996960.195177:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968987102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126807040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780996960.195254:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968987102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126807040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996960.195260:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1780996960.195418:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780996960.201731:0:81586:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1780996960.203216:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1780996960.203262:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780996960.203303:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce2a00/0x30fd811c030595d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595da expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.203316:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968983ce2a00/0x30fd811c030595d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595da expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996960.203326:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1780996960.203329:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1780996960.203331:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1780996960.203372:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03c00/0x30fd811c030595e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.203381:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03c00/0x30fd811c030595e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.203393:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03c00/0x30fd811c030595e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996960.203425:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.203503:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996960.203549:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722c00 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.203622:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126807168 00000100:00100000:1.0:1780996960.203629:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126807168 00000100:00100000:1.0:1780996960.203676:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1780996960.203685:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968987103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126807168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780996960.203698:0:81487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996960.203711:0:81487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c1000/0x30fd811c030595e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c030595e1 expref: -99 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.203733:0:81487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c1000/0x30fd811c030595e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c030595e1 expref: 17 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.203742:0:81487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c1000/0x30fd811c030595e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c030595e1 expref: 17 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.203770:0:81487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1000, rc 0) 00000100:00100000:1.0:1780996960.203816:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968987103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126807168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.203832:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1780996960.204039:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780996960.204053:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03c00/0x30fd811c030595e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595e8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.204062:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03c00/0x30fd811c030595e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c030595e8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996960.204120:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.204153:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996960.204177:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780996960.204306:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126807296 00000100:00100000:2.0:1780996960.204311:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126807296 00000100:00100000:2.0:1780996960.204344:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1780996960.204350:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968987100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126807296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780996960.204489:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968987100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126807296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996960.204496:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1780996960.204997:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.205041:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.205081:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996960.205108:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780996960.205198:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126807424 00000100:00100000:2.0:1780996960.205203:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126807424 00000100:00100000:2.0:1780996960.205235:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1780996960.205241:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b798e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126807424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780996960.206234:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b798e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126807424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 988us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996960.206244:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1780996960.206414:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780996960.208471:0:81587:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1780996960.218779:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1780996960.218834:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1780996960.218848:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03c00/0x30fd811c030595e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595e8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.218985:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03c00/0x30fd811c030595e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595e8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780996960.218996:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1780996960.218999:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9689bfa99000 from 7 10000000:01000000:1.0:1780996960.219002:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1780996960.219055:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1200/0x30fd811c030595ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.219063:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1200/0x30fd811c030595ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.219073:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1200/0x30fd811c030595ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780996960.219098:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.219168:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996960.219212:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72840 going to sleep for 11 seconds 00000100:00100000:2.0:1780996960.220142:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126807552 00000100:00100000:2.0:1780996960.220171:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126807552 00000100:00100000:2.0:1780996960.220232:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1780996960.220241:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b798cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126807552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780996960.220254:0:81489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780996960.220293:0:81489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce3400/0x30fd811c030595f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c030595ef expref: -99 pid: 81489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.220322:0:81489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce3400/0x30fd811c030595f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c030595ef expref: 18 pid: 81489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.220333:0:81489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce3400/0x30fd811c030595f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c030595ef expref: 18 pid: 81489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.220342:0:81489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3400, rc 0) 00000100:00100000:2.0:1780996960.220406:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b798cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126807552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996960.220415:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1780996960.226229:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780996960.226263:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1200/0x30fd811c030595ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595f6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.227352:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1200/0x30fd811c030595ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c030595f6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996960.227449:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.227515:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996960.227602:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e33a80 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.236294:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126807680 00000100:00100000:1.0:1780996960.236322:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126807680 00000100:00100000:1.0:1780996960.236380:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1780996960.236389:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b798e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126807680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.236554:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b798e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126807680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (9038us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.236562:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1780996960.236665:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.236731:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.236799:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996960.236847:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e33a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780996960.236872:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126807808 00000100:00100000:3.0:1780996960.236876:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126807808 00000100:00100000:3.0:1780996960.236903:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1780996960.236910:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b798f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126807808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.236995:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b798f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126807808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996960.237013:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1780996960.237070:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780996960.237834:0:81588:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1780996960.237902:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1780996960.237923:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1780996960.237933:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1200/0x30fd811c030595ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595f6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.237945:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1200/0x30fd811c030595ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030595f6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780996960.237956:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1780996960.237959:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968990f90000 from 52 10000000:01000000:3.0:1780996960.237961:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780996960.237989:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3e00/0x30fd811c030595fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.237996:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3e00/0x30fd811c030595fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.238004:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3e00/0x30fd811c030595fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996960.238020:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.238057:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996960.238071:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.238423:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126807936 00000100:00100000:1.0:1780996960.238430:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126807936 00000100:00100000:1.0:1780996960.238468:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1780996960.238475:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b798e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126807936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780996960.238485:0:81492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996960.238496:0:81492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c0600/0x30fd811c03059604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c030595fd expref: -99 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.238516:0:81492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c0600/0x30fd811c03059604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c030595fd expref: 19 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.238526:0:81492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c0600/0x30fd811c03059604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c030595fd expref: 19 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.238533:0:81492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0600, rc 0) 00000100:00100000:1.0:1780996960.238566:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b798e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126807936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.238573:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1780996960.238659:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126807936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780996960.238672:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3e00/0x30fd811c030595fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059604 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.238690:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3e00/0x30fd811c030595fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059604 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996960.238739:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.238837:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996960.238948:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.243484:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126808064 00000100:00100000:1.0:1780996960.243499:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126808064 00000100:00100000:1.0:1780996960.243559:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1780996960.243569:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126808064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.243766:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126808064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (4928us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.243775:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1780996960.244505:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.244562:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.244612:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996960.244643:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722c00 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.244706:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126808192 00000100:00100000:1.0:1780996960.244711:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126808192 00000100:00100000:1.0:1780996960.244802:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1780996960.244811:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b6300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126808192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.244980:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b6300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126808192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.244987:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1780996960.245115:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780996960.246560:0:81589:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1780996960.246819:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1780996960.258056:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780996960.258077:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3e00/0x30fd811c030595fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059604 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.258090:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3e00/0x30fd811c030595fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059604 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996960.258117:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1780996960.258121:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1780996960.258125:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1780996960.258170:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305960b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.258187:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305960b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.258200:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305960b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996960.258229:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.258318:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996960.258379:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780996960.259997:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126808320 00000100:00100000:2.0:1780996960.260024:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126808320 00000100:00100000:2.0:1780996960.260105:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1780996960.260116:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b6302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126808320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780996960.260135:0:81493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780996960.260154:0:81493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce3200/0x30fd811c03059612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305960b expref: -99 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.260186:0:81493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce3200/0x30fd811c03059612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305960b expref: 20 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.260198:0:81493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce3200/0x30fd811c03059612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305960b expref: 20 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.260216:0:81493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3200, rc 0) 00000100:00100000:2.0:1780996960.260312:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b6302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126808320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996960.260320:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1780996960.263519:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780996960.263548:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305960b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059612 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.263562:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305960b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059612 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996960.263651:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.263711:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996960.263752:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780996960.263779:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126808448 00000100:00100000:2.0:1780996960.263788:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126808448 00000100:00100000:2.0:1780996960.264164:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1780996960.264175:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b6303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126808448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780996960.264385:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b6303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126808448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996960.264393:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1780996960.264638:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.264680:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.264734:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996960.269997:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126808576 00000100:00100000:3.0:1780996960.270012:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126808576 00000100:00100000:3.0:1780996960.270441:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1780996960.270452:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126808576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.271586:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72540 going to sleep for 11 seconds 00000100:00100000:0.0:1780996960.273197:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126808576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2734us (8449us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996960.273215:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1780996960.273318:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780996960.276220:0:81592:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1780996960.278238:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1780996960.278289:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1780996960.278311:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305960b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059612 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.278324:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305960b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059612 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780996960.279484:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1780996960.279489:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff968990f90000 from 7 10000000:01000000:3.0:1780996960.279494:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1780996960.279543:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2800/0x30fd811c03059619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.279556:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2800/0x30fd811c03059619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.279569:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2800/0x30fd811c03059619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996960.279596:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.279665:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996960.279708:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e33a80 going to sleep for 11 seconds 00000100:00100000:0.0:1780996960.280044:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126808704 00000100:00100000:0.0:1780996960.280052:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126808704 00000100:00100000:0.0:1780996960.280342:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1780996960.280366:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126808704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780996960.280383:0:81492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780996960.281084:0:81492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff03800/0x30fd811c03059620 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059619 expref: -99 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.281114:0:81492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03800/0x30fd811c03059620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059619 expref: 21 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.281127:0:81492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff03800/0x30fd811c03059620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059619 expref: 21 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996960.281136:0:81492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03800, rc 0) 00000100:00100000:0.0:1780996960.281213:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126808704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 861us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996960.281220:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1780996960.281388:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780996960.281421:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2800/0x30fd811c03059619 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059620 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996960.281431:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2800/0x30fd811c03059619 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059620 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780996960.281580:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780996960.281621:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996960.285008:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126808832 00000100:00100000:3.0:1780996960.285178:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126808832 00000100:00100000:3.0:1780996960.285242:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1780996960.285266:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126808832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.285592:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126808832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (3969us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996960.285600:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1780996960.287095:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968987108cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780996960.287131:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780996960.287185:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780996960.287260:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996960.287307:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968987108cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1780996960.287566:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126808960 00000100:00100000:0.0:1780996960.287577:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126808960 00000100:00100000:0.0:1780996960.287670:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1780996960.287685:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126808960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780996960.287810:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126808960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996960.287850:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1780996960.294597:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126808960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780996960.297890:0:81594:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1780996960.298315:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1780996960.298342:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1780996960.298355:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2800/0x30fd811c03059619 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059620 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.298368:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2800/0x30fd811c03059619 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059620 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780996960.298378:0:6348:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1780996960.298382:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9689b6283380 from 1 10000000:01000000:3.0:1780996960.298385:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1780996960.298445:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c03059627 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.298454:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c03059627 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.298466:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c03059627 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996960.298493:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126809088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.298558:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996960.298601:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780996960.299645:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126809088 00000100:00100000:1.0:1780996960.299655:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126809088 00000100:00100000:1.0:1780996960.299708:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1780996960.299718:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126809088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780996960.299733:0:81487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996960.299748:0:81487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c0800/0x30fd811c0305962e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059627 expref: -99 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.299774:0:81487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c0800/0x30fd811c0305962e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059627 expref: 22 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.299784:0:81487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c0800/0x30fd811c0305962e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059627 expref: 22 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.299801:0:81487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0800, rc 0) 00000100:00100000:1.0:1780996960.299875:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126809088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996960.299882:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1780996960.299959:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126809088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780996960.299975:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c03059627 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305962e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.299992:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c03059627 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305962e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780996960.300013:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1780996960.300018:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c03059627 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305962e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.300026:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c03059627 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305962e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780996960.300034:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1780996960.300036:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9689b6283380 from 1 10000000:01000000:3.0:1780996960.300039:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1780996960.300058:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3200/0x30fd811c03059635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.300065:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3200/0x30fd811c03059635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.300073:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3200/0x30fd811c03059635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996960.300090:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126809216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.300120:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996960.300145:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e330c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780996960.300326:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126809216 00000100:00100000:3.0:1780996960.300331:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126809216 00000100:00100000:3.0:1780996960.300364:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1780996960.300371:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126809216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780996960.300386:0:81493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780996960.300395:0:81493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb2a00/0x30fd811c0305963c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059635 expref: -99 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.300488:0:81493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb2a00/0x30fd811c0305963c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059635 expref: 23 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.300500:0:81493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb2a00/0x30fd811c0305963c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059635 expref: 23 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996960.300506:0:81493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2a00, rc 0) 00000100:00100000:3.0:1780996960.300552:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126809216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996960.300559:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1780996960.300597:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126809216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780996960.300611:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3200/0x30fd811c03059635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305963c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.300621:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3200/0x30fd811c03059635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305963c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780996960.300676:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba187100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126809344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780996960.300709:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996960.300736:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e330c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780996960.300836:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126809344 00000100:00100000:3.0:1780996960.300841:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126809344 00000100:00100000:3.0:1780996960.300943:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1780996960.300952:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126809344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780996960.301022:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126809344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (312us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780996960.301030:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1780996960.301171:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba187100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126809344:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1780996960.301195:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1780996960.301201:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3200/0x30fd811c03059635 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305963c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996960.301209:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3200/0x30fd811c03059635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305963c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996961.002501:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996961.702068:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780996961.702111:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126809472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780996961.702197:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996961.702264:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126809472 00000100:00100000:2.0:1780996961.702300:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126809472 00000100:00100000:2.0:1780996961.702368:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:2.0:1780996961.702379:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126809472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780996961.702420:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996961.702475:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126809472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996961.702483:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00080000:2.0:1780996961.702505:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780996961.702554:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126809472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780996961.702762:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780996961.702771:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126809600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780996961.702809:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996961.704348:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126809600 00000100:00100000:1.0:1780996961.704358:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126809600 00000100:00100000:1.0:1780996961.704421:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:1.0:1780996961.704430:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126809600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780996961.704461:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996961.704534:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126809600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996961.704542:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00100000:1.0:1780996961.704595:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126809600:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780996961.704713:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780996962.021768:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1780996962.964509:0:81750:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1780996963.046293:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996963.082608:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996963.082660:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996963.082690:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110329728 00000100:00100000:1.0:1780996963.082701:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110329728 00000100:00100000:1.0:1780996963.082770:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1068 00000100:00100000:1.0:1780996963.082781:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110329728:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996963.082857:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110329728:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 79us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996963.082865:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1068 00000100:00080000:1.0:1780996963.082888:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996963.083219:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110329600 00000100:00100000:3.0:1780996963.083225:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110329600 00000100:00100000:3.0:1780996963.083264:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:3.0:1780996963.083300:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110329600:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996963.083352:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110329600:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 81us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996963.083360:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000020:00000004:2.0:1780996964.051148:0:81802:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1780996964.051582:0:81802:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1780996964.069426:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996964.109375:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996964.109417:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996964.109459:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110329984 00000100:00100000:1.0:1780996964.109468:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110329984 00000100:00100000:1.0:1780996964.109511:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1069 00000100:00100000:1.0:1780996964.109521:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110329984:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996964.110224:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110329984:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 700us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996964.110254:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1069 00000100:00100000:2.0:1780996964.110338:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110329856 00000100:00100000:2.0:1780996964.110344:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110329856 00000100:00100000:2.0:1780996964.110378:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:2.0:1780996964.110386:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110329856:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780996964.110420:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110329856:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996964.110436:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1780996964.262023:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126809728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780996964.262096:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996964.262177:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126809728 00000100:00100000:0.0:1780996964.262186:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126809728 00000100:00100000:0.0:1780996964.262292:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:0.0:1780996964.262302:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126809728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780996964.262335:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780996964.262389:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126809728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996964.262397:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00000001:00100000:0.0:1780996964.263091:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:3.0:1780996964.265171:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996964.265179:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996964.265183:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996964.265191:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3486 00000100:00080000:3.0:1780996964.265196:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780996964.265203:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996964.265228:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba2e2680 x1867507126809984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780996964.265254:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996964.265257:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996964.265259:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996964.265262:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3486 00000100:00080000:3.0:1780996964.265264:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780996964.265291:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996964.265306:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc639500 x1867507126810240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780996964.265331:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996964.265335:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996964.265337:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996964.265341:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3486 00000100:00080000:3.0:1780996964.265343:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780996964.265359:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996964.265372:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc638a80 x1867507126810496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780996964.265395:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780996964.265398:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996964.265399:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996964.265402:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3486 00000100:00080000:3.0:1780996964.265404:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780996964.265408:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996964.265419:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b78c2d80 x1867507126810880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780996964.265439:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1780996964.265442:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780996964.265444:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888969a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996964.265448:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96888969a800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996964.265459:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9688895f8000 x1867507126811264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780996964.265764:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126810624:0@lo:400:kworker.0 00000100:00100000:0.0:1780996964.265855:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126810112:0@lo:400:kworker.0 00000100:00100000:1.0:1780996964.265865:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996964.265897:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996964.265923:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126811008:0@lo:400:kworker.0 00000100:00100000:1.0:1780996964.265929:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126809728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780996964.265948:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996964.265969:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1780996964.265970:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1780996964.265983:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126810368:0@lo:400:kworker.0 00000100:00100000:0.0:1780996964.265990:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126809856:0@lo:400:kworker.0 00000100:00100000:1.0:1780996964.266015:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996964.266030:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996964.266040:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126811136:0@lo:400:kworker.0 00000100:00100000:0.0:1780996964.266064:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126810752:0@lo:400:kworker.0 00000100:00100000:1.0:1780996964.266072:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996964.266113:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126810624 00000100:00100000:1.0:1780996964.266119:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126810624 00000100:00100000:1.0:1780996964.266165:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126811008 00000100:00100000:1.0:1780996964.266169:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126811008 00000100:00100000:1.0:1780996964.266187:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126811136 00000100:00100000:1.0:1780996964.266190:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126811136 00000100:00100000:1.0:1780996964.266213:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426 00000100:00100000:1.0:1780996964.266223:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126810624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996964.266289:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126810624:12345-0@lo:400:kworker.0 Request processed in 68us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996964.266295:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426 00000100:00100000:1.0:1780996964.266310:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427 00000100:00100000:1.0:1780996964.266316:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126811008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996964.266340:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126811008:12345-0@lo:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996964.266352:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427 00000100:00100000:1.0:1780996964.266362:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428 00000100:00100000:1.0:1780996964.266367:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126811136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996964.266391:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126811136:12345-0@lo:400:kworker.0 Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996964.266397:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428 00000100:00100000:1.0:1780996964.266418:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126810112 00000100:00100000:1.0:1780996964.266421:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126810112 00000100:00100000:1.0:1780996964.266444:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126810368 00000100:00100000:1.0:1780996964.266446:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126810368 00000100:00100000:1.0:1780996964.266462:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1780996964.266468:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126810112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996964.266497:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126810112:12345-0@lo:400:kworker.0 Request processed in 30us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996964.266503:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1780996964.266514:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1780996964.266521:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126810368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996964.266545:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126810368:12345-0@lo:400:kworker.0 Request processed in 26us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996964.266551:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00080000:1.0:1780996964.266571:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780996964.266575:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780996964.266577:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996964.266621:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126810368:0@lo:400:kworker.0 00000100:00100000:1.0:1780996964.266630:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126811136:0@lo:400:kworker.0 00000100:00100000:1.0:1780996964.266649:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126810624:0@lo:400:kworker.0 00000100:00100000:0.0:1780996964.266882:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996964.266913:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126810112:0@lo:400:kworker.0 00000100:00100000:0.0:1780996964.266924:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126811008:0@lo:400:kworker.0 00000100:00100000:0.0:1780996964.266953:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126810752 00000100:00100000:0.0:1780996964.266964:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126810752 00000100:00100000:0.0:1780996964.267005:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429 00000100:00100000:0.0:1780996964.267012:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126810752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996964.267048:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126810752:12345-0@lo:400:kworker.0 Request processed in 36us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996964.267054:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429 00000100:00100000:0.0:1780996964.267080:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126810752:0@lo:400:kworker.0 00000100:00100000:0.0:1780996964.269564:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126809984:0@lo:38:kworker.0 00000100:00100000:0.0:1780996964.269645:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996964.269687:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126810240:0@lo:38:kworker.0 00000100:00100000:0.0:1780996964.269708:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996964.269723:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126810496:0@lo:38:kworker.0 00000100:00100000:0.0:1780996964.269744:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996964.269759:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126810880:0@lo:38:kworker.0 00000100:00100000:0.0:1780996964.269777:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996964.269789:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126811264:0@lo:38:kworker.0 00000100:00100000:0.0:1780996964.269824:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996964.269934:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126809856 00000100:00100000:3.0:1780996964.269943:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126809856 00000100:00080000:1.0:1780996964.270133:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780996964.270148:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126809984 00000100:00100000:1.0:1780996964.270151:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126809984 00000100:00100000:1.0:1780996964.270173:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126810240 00000100:00100000:1.0:1780996964.270175:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126810240 00000100:00100000:1.0:1780996964.270190:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126810880 00000100:00100000:1.0:1780996964.270192:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126810880 00000100:00100000:3.0:1780996964.270223:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1780996964.270233:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126809856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996964.270318:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126809856:12345-0@lo:400:kworker.0 Request processed in 85us (4288us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996964.270325:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1780996964.270370:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126810496 00000100:00100000:3.0:1780996964.270380:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126810496 00000100:00100000:3.0:1780996964.270405:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:3.0:1780996964.270411:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126810496:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780996964.270437:0:8242:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9689bc9e1000, cookie 0x30fd811c030594b4 00010000:00080000:3.0:1780996964.270443:0:8242:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411355 exp ffff9689bc9e1000 cur 3491 last 1780996958 00000004:00100000:3.0:1780996964.270463:0:8242:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1780996964.270785:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126811264 00000100:00100000:2.0:1780996964.270791:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126811264 00000100:00100000:2.0:1780996964.270822:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1780996964.270827:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126809984:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780996964.270842:0:63417:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3491 last 0 00000020:00000080:2.0:1780996964.270874:0:63417:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x30fd811c03059643 00000004:00100000:2.0:1780996964.270882:0:63417:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1780996964.270884:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1780996964.270893:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126810240:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1780996964.270908:0:63417:0:(import.c:65:import_set_state_nolock()) ffff968886f58000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1780996964.270912:0:63419:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3491 last 0 00000020:00000080:1.0:1780996964.270943:0:63419:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x30fd811c0305964a 00000004:00100000:1.0:1780996964.270952:0:63419:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1780996964.270961:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3495:x1867507126809984:12345-0@lo:38:kworker.0 Request processed in 131us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996964.270971:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00080000:1.0:1780996964.270974:0:63419:0:(import.c:65:import_set_state_nolock()) ffff9689a5871800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780996964.271123:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3495:x1867507126810240:12345-0@lo:38:kworker.0 Request processed in 230us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996964.271129:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1780996964.271144:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1780996964.271148:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126810880:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780996964.271161:0:63419:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3491 last 0 00000020:00000080:1.0:1780996964.271181:0:63419:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x30fd811c03059651 00000004:00100000:1.0:1780996964.271187:0:63419:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780996964.271201:0:63419:0:(import.c:65:import_set_state_nolock()) ffff9689a5873800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780996964.271230:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3495:x1867507126810880:12345-0@lo:38:kworker.0 Request processed in 80us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996964.271237:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1780996964.271258:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:1.0:1780996964.271263:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126811264:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780996964.271294:0:63419:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3491 last 0 00000020:00000080:1.0:1780996964.271317:0:63419:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x30fd811c03059658 00000004:00100000:1.0:1780996964.271324:0:63419:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780996964.271340:0:63419:0:(import.c:65:import_set_state_nolock()) ffff96888a013800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780996964.271374:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1867507126811264:12345-0@lo:38:kworker.0 Request processed in 109us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996964.271382:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00010000:00080000:2.0:1780996964.271812:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689ba2e2680 x1867507126809984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780996989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780996964.271828:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 23 00000100:00080000:3.0:1780996964.272168:0:8242:0:(import.c:65:import_set_state_nolock()) ffff96888969e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780996964.272234:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126810496:12345-0@lo:38:kworker.0 Request processed in 1822us (2487us total) trans 0 rc 0/0 00010000:00080000:0.0:1780996964.272238:0:81516:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1780996964.272244:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00010000:00080000:0.0:1780996964.272247:0:81516:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 94489280514 00000020:00080000:0.0:1780996964.272254:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780996964.272258:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 94489280514, next_transno: 94489280514 00010000:00080000:0.0:1780996964.272263:0:81516:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280514) 00000020:00080000:0.0:1780996964.272266:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780996964.272301:0:81516:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110321408 t94489280514 from 192.168.206.51@tcp req@ffff9689b11a9f80 x1867507110321408/t0(94489280514) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:290/0 lens 528/0 e 0 to 0 dl 1780996970 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780996964.272351:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126809856:0@lo:400:kworker.0 00000001:00100000:1.0:1780996964.273221:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1780996964.273404:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:2.0:1780996964.273606:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9689ba2e2680 x1867507126809984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780996989 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780996964.273618:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1780996964.273623:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1780996964.273627:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1780996964.273632:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126809984:0@lo:38:kworker.0 00010000:00080000:2.0:1780996964.273656:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689bc639500 x1867507126810240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780996989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780996964.273669:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 23 00000004:00080000:0.0:1780996964.274179:0:81516:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1807us 00000100:00080000:2.0:1780996964.274947:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9689bc639500 x1867507126810240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780996989 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780996964.274958:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1780996964.274962:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1780996964.274966:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1780996964.274972:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126810240:0@lo:38:kworker.0 00000100:00080000:2.0:1780996964.275001:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 23 00000100:00080000:2.0:1780996964.275009:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1780996964.275012:0:3495:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1780996964.275015:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:2.0:1780996964.275019:0:3495:0:(recover.c:53:ptlrpc_replay_next()) import ffff9689ae566000 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:2.0:1780996964.275022:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1780996964.275324:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126810496:0@lo:38:kworker.0 00010000:00080000:1.0:1780996964.275340:0:81819:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1780996964.275346:0:81819:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00080000:0.0:1780996964.275348:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689b78c2d80 x1867507126810880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780996989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1780996964.275358:0:81819:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1780996964.275362:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 23 00000100:00080000:0.0:1780996964.278065:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9689b78c2d80 x1867507126810880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780996989 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780996964.278080:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1780996964.278086:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780996964.278091:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1780996964.278583:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126810880:0@lo:38:kworker.0 00010000:00080000:0.0:1780996964.278625:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9688895f8000 x1867507126811264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780996974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780996964.278643:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 23 00000100:00080000:0.0:1780996964.278651:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1780996964.278655:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1780996964.278658:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888969a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1780996964.278663:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126811264:0@lo:38:kworker.0 00000100:00080000:1.0:1780996964.280056:0:81819:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1780996964.280156:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126811392:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1780996964.280226:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996964.280845:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126811392 00000100:00100000:1.0:1780996964.280854:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126811392 00000100:00100000:1.0:1780996964.280908:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:1.0:1780996964.280918:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126811392:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1780996964.280937:0:8241:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff9689aded2300 x1867507126811392/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:295/0 lens 224/0 e 0 to 0 dl 1780996975 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780996964.280949:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126811392:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 34us (724us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780996964.280955:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00010000:00010000:2.0:1780996964.301322:0:81516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305965f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301344:0:81516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305965f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301358:0:81516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305965f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301370:0:81516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c03059666 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301377:0:81516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c03059666 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301384:0:81516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c03059666 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301755:0:81516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305965f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301764:0:81516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305965f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301771:0:81516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305965f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301776:0:81516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780996964.301781:0:81516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305965f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301788:0:81516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305965f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301813:0:81516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:2.0:1780996964.301817:0:81516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780996964.301821:0:81516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305965f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301828:0:81516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3c00/0x30fd811c0305965f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780996964.301844:0:81516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c3123842 reply state 00000000c3da3648 transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c03059666 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301853:0:81516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c03059666 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.301860:0:81516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689882bd700) 00010000:00010000:2.0:1780996964.301868:0:81516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780996964.301873:0:81516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1780996964.301988:0:81516:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1780996964.302014:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780996964.302018:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000020:00080000:2.0:1780996964.302022:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780996964.302024:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000100:00100000:1.0:1780996964.305506:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996964.305604:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110321920 00000100:00100000:2.0:1780996964.305618:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110321920 00000100:00100000:1.0:1780996964.305718:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1079 00000100:00100000:1.0:1780996964.305808:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2393:x1867507110321920:12345-192.168.206.51@tcp:36:rm.0 00010000:00080000:1.0:1780996964.305832:0:63418:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 94489280515, current: 94489280515, replaying 00000100:00100000:1.0:1780996964.305851:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2393:x1867507110321920:12345-192.168.206.51@tcp:36:rm.0 Request processed in 58us (360us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780996964.305858:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1079 00000020:00080000:0.0:1780996964.305897:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780996964.305907:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280515, next_transno: 94489280515 00010000:00080000:0.0:1780996964.305912:0:81516:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280515) 00000020:00080000:0.0:1780996964.305915:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780996964.305924:0:81516:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110321920 t94489280515 from 192.168.206.51@tcp req@ffff9689ba186a00 x1867507110321920/t0(94489280515) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:295/0 lens 512/0 e 0 to 0 dl 1780996975 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1780996964.306090:0:81516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305966d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306108:0:81516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305966d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306121:0:81516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305966d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306134:0:81516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059674 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306143:0:81516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059674 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306149:0:81516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059674 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306245:0:81516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305967b lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306253:0:81516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305967b lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306260:0:81516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305967b lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306523:0:81516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305967b lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306532:0:81516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305967b lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306539:0:81516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305967b lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306546:0:81516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780996964.306550:0:81516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305967b lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306557:0:81516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305967b lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306569:0:81516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9689bc9eae00) 00010000:00010000:0.0:1780996964.306572:0:81516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1780996964.306577:0:81516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305967b lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306582:0:81516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305967b lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306604:0:81516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305966d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306610:0:81516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305966d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306616:0:81516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305966d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306629:0:81516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780996964.306632:0:81516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305966d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306638:0:81516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305966d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306646:0:81516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689bc9eaa00) 00010000:00010000:0.0:1780996964.306648:0:81516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780996964.306651:0:81516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305966d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306656:0:81516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305966d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780996964.306667:0:81516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec4b67e5 reply state 00000000eab0d14c transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059674 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306678:0:81516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059674 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.306685:0:81516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689882bd700) 00010000:00010000:0.0:1780996964.306687:0:81516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780996964.306689:0:81516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1780996964.307035:0:81516:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1780996964.307056:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780996964.307060:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000020:00080000:0.0:1780996964.307063:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780996964.307065:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000100:00100000:3.0:1780996964.314588:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996964.314820:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110323072 00000100:00100000:0.0:1780996964.314838:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110323072 00000100:00100000:0.0:1780996964.314934:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1080 00000100:00100000:0.0:1780996964.314945:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2393:x1867507110323072:12345-192.168.206.51@tcp:101:lfs.0 00010000:00080000:0.0:1780996964.314965:0:65272:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 94489280516, current: 94489280516, replaying 00000100:00100000:0.0:1780996964.314985:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2393:x1867507110323072:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 42us (404us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780996964.314996:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1080 00000020:00080000:3.0:1780996964.315027:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.315032:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280516, next_transno: 94489280516 00010000:00080000:3.0:1780996964.315037:0:81516:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280516) 00000020:00080000:3.0:1780996964.315040:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.315050:0:81516:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110323072 t94489280516 from 192.168.206.51@tcp req@ffff9688895f8000 x1867507110323072/t0(94489280516) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:295/0 lens 536/0 e 0 to 0 dl 1780996975 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1780996964.315086:0:81516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780996964.315115:0:81516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c03059682 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a7a expref: -99 pid: 81516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.315330:0:81516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c03059689 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.315344:0:81516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c03059689 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.315365:0:81516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c03059689 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.315379:0:81516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c03059690 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.315387:0:81516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c03059690 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.315394:0:81516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c03059690 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780996964.315939:0:81516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000004:00080000:3.0:1780996964.315958:0:81516:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0x30fd811c0305940c 00000004:00080000:3.0:1780996964.315961:0:81516:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x30fd811c0305940c in new mfd 00010000:00010000:3.0:1780996964.315972:0:81516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c03059689 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.315981:0:81516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c03059689 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.315987:0:81516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c03059689 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.315993:0:81516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996964.315997:0:81516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c03059689 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.316004:0:81516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c03059689 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.316027:0:81516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689964dcc00) 00010000:00010000:3.0:1780996964.316030:0:81516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996964.316034:0:81516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c03059689 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.316040:0:81516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c03059689 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780996964.316052:0:81516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e992bda reply state 00000000c520877a transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c03059690 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.316063:0:81516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c03059690 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.316069:0:81516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9689964dc500) 00010000:00010000:3.0:1780996964.316071:0:81516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780996964.316073:0:81516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1780996964.316161:0:81516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c03059682 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a7a expref: 12 pid: 81516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.316173:0:81516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689964dcc00) 00010000:00010000:3.0:1780996964.316175:0:81516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996964.316179:0:81516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c03059682 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a7a expref: 12 pid: 81516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.316192:0:81516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2e00, rc 0) 00010000:00080000:3.0:1780996964.316258:0:81516:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1780996964.316295:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.316299:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000020:00080000:3.0:1780996964.316308:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.316310:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000100:00100000:0.0:1780996964.362828:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996964.363130:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110323328 00000100:00100000:1.0:1780996964.363143:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110323328 00000100:00100000:1.0:1780996964.363310:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1081 00000100:00100000:1.0:1780996964.363322:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2393:x1867507110323328:12345-192.168.206.51@tcp:101:lfs.0 00010000:00080000:1.0:1780996964.363346:0:80049:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 94489280517, current: 94489280517, replaying 00000100:00100000:1.0:1780996964.363369:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2393:x1867507110323328:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 50us (552us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780996964.363376:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1081 00000020:00080000:3.0:1780996964.363440:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.363446:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280517, next_transno: 94489280517 00010000:00080000:3.0:1780996964.363450:0:81516:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280517) 00000020:00080000:3.0:1780996964.363454:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.363464:0:81516:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110323328 t94489280517 from 192.168.206.51@tcp req@ffff9689ad8cad80 x1867507110323328/t0(94489280517) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:295/0 lens 736/0 e 0 to 0 dl 1780996975 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1780996964.363487:0:81516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780996964.363512:0:81516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2c00/0x30fd811c0305969e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8a81 expref: -99 pid: 81516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780996964.363641:0:81516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000004:00080000:3.0:1780996964.363881:0:81516:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0x30fd811c03059421 00000004:00080000:3.0:1780996964.363884:0:81516:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x30fd811c03059421 in new mfd 00010000:00010000:3.0:1780996964.363917:0:81516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2c00/0x30fd811c0305969e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a81 expref: 14 pid: 81516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.363933:0:81516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689964dcc00) 00010000:00010000:3.0:1780996964.363936:0:81516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1780996964.363942:0:81516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2c00/0x30fd811c0305969e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a81 expref: 14 pid: 81516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.363956:0:81516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2c00, rc 0) 00010000:00080000:3.0:1780996964.364035:0:81516:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1780996964.364051:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.364053:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000020:00080000:3.0:1780996964.364069:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.364071:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000100:00100000:0.0:1780996964.371551:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996964.372487:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110323712 00000100:00100000:2.0:1780996964.372499:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110323712 00000100:00100000:2.0:1780996964.372617:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 214 00000100:00100000:2.0:1780996964.372629:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:2393:x1867507110323712:12345-192.168.206.51@tcp:35:lfs.0 00010000:00080000:2.0:1780996964.372649:0:63420:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 94489280518, current: 94489280518, replaying 00000100:00100000:2.0:1780996964.372673:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:2393:x1867507110323712:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 48us (1135us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780996964.372682:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 214 00000020:00080000:3.0:1780996964.372748:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.372752:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280518, next_transno: 94489280518 00010000:00080000:3.0:1780996964.372756:0:81516:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280518) 00000020:00080000:3.0:1780996964.372760:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.372770:0:81516:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110323712 t94489280518 from 192.168.206.51@tcp req@ffff9689b7a4ea00 x1867507110323712/t0(94489280518) o35->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:295/0 lens 392/0 e 0 to 0 dl 1780996975 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780996964.373029:0:81516:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1780996964.373044:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.373046:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000020:00080000:3.0:1780996964.373050:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.373052:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000100:00100000:0.0:1780996964.375095:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996964.375205:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110323968 00000100:00100000:1.0:1780996964.375216:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110323968 00000100:00100000:1.0:1780996964.375298:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00100000:1.0:1780996964.375313:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:2393:x1867507110323968:12345-192.168.206.51@tcp:35:lfs.0 00010000:00080000:1.0:1780996964.375332:0:63421:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 94489280519, current: 94489280519, replaying 00000100:00100000:1.0:1780996964.375351:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:2393:x1867507110323968:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 45us (269us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780996964.375359:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 215 00000020:00080000:3.0:1780996964.375477:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.375481:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280519, next_transno: 94489280519 00010000:00080000:3.0:1780996964.375486:0:81516:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280519) 00000020:00080000:3.0:1780996964.375489:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.375499:0:81516:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110323968 t94489280519 from 192.168.206.51@tcp req@ffff9689b7a4d500 x1867507110323968/t0(94489280519) o35->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:295/0 lens 392/0 e 0 to 0 dl 1780996975 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780996964.375731:0:81516:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1780996964.375747:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.375750:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000020:00080000:3.0:1780996964.375752:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.375754:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000100:00100000:0.0:1780996964.380493:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996964.380679:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110330112 00000100:00100000:1.0:1780996964.380690:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110330112 00000100:00100000:1.0:1780996964.380757:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1072 00000100:00100000:1.0:1780996964.380767:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+15:2393:x1867507110330112:12345-192.168.206.51@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1780996964.380834:0:63418:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff9689b7a4df80 x1867507110330112/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:295/0 lens 224/0 e 0 to 0 dl 1780996975 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780996964.380860:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+15:2393:x1867507110330112:12345-192.168.206.51@tcp:400:ldlm_lock_repla.0 Request processed in 95us (383us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780996964.380868:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1072 00000020:00080000:3.0:1780996964.381131:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.381136:0:81516:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 94489280520 00010000:00080000:3.0:1780996964.381150:0:81516:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1780996964.381153:0:81516:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780996964.381162:0:81516:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1780996964.381164:0:81516:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1780996964.381324:0:81516:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 98784247808 00000001:00100000:1.0:1780996964.388016:0:81482:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000001:00100000:1.0:1780996964.388029:0:81482:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1780996964.388054:0:81482:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00010000:00010000:3.0:1780996964.388329:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c03059666 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780996964.388335:0:81516:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:3.0:1780996964.388342:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c03059666 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388350:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c03059666 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388355:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996964.388360:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c03059666 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388374:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c03059666 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1780996964.388389:0:81516:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00010000:3.0:1780996964.388391:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689882bd700) 00010000:00010000:3.0:1780996964.388394:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996964.388399:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c03059666 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1780996964.388402:0:81516:0:(ldlm_lib.c:2924:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9689aded2300 x1867507126811392/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:295/0 lens 224/0 e 0 to 0 dl 1780996975 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1780996964.388406:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2400/0x30fd811c03059666 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388423:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059674 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388445:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059674 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388450:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059674 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388454:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996964.388457:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059674 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388463:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059674 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388470:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689882bd700) 00010000:00010000:3.0:1780996964.388472:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996964.388474:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059674 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388479:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059674 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388499:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c03059690 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388505:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c03059690 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388511:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c03059690 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388516:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996964.388524:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c03059690 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388530:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c03059690 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1780996964.388531:0:81516:0:(ldlm_lib.c:2924:target_recovery_thread()) @@@ processing final ping from 192.168.206.51@tcp: req@ffff9689b7a4df80 x1867507110330112/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:295/0 lens 224/0 e 0 to 0 dl 1780996975 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1780996964.388539:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9689964dc500) 00010000:00010000:3.0:1780996964.388541:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996964.388544:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c03059690 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.388550:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c03059690 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1780996964.388777:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1780996964.388785:0:3495:0:(client.c:3253:ptlrpc_resend_req()) @@@ going to resend req@ffff9689ba184a80 x1867507126811392/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780996980 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780996964.388795:0:3495:0:(client.c:3262:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9689ba184a80 x1867507126811392/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780996980 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780996964.388816:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780996964.389064:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1780996964.389071:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126811392:0@lo:400:ldlm_lock_repla.0 00010000:02000000:2.0:1780996964.389191:0:81516:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:3.0:1780996964.389338:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126811520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780996964.389384:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996964.389427:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126811520 00000100:00100000:3.0:1780996964.389434:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126811520 00000100:00100000:3.0:1780996964.389467:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:3.0:1780996964.389475:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126811520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780996964.389504:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:3.0:1780996964.389542:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126811520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996964.389552:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00000100:00100000:1.0:1780996964.389573:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126811520:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1780996964.422507:0:81516:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8c8c764be10 00100000:10000000:0.0:1780996964.422526:0:81516:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1780996964.427596:0:81502:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x282:0x0] 00000100:00100000:2.0:1780996964.428064:0:81502:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11ab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:81502:1867507126811648:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1780996964.428198:0:81502:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996964.428247:0:81502:0:(client.c:2692:ptlrpc_set_wait()) set ffff968987108e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780996964.428442:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126811648 00000100:00100000:1.0:1780996964.428451:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126811648 00000100:00100000:1.0:1780996964.428500:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5903 00000100:00100000:1.0:1780996964.428510:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:81502:x1867507126811648:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1780996964.428538:0:23044:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -63 00002000:02000040:1.0:1780996964.428544:0:23044:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:643 to 0x280000400:705) 00000004:00080000:3.0:1780996964.435581:0:81504:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x90:0x0] 00000100:00100000:3.0:1780996964.435637:0:81504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:81504:1867507126811776:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1780996964.435718:0:81504:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996964.435753:0:81504:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a5f5d480 going to sleep for 11 seconds 00000100:00100000:3.0:1780996964.435780:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126811776 00000100:00100000:3.0:1780996964.435812:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126811776 00000100:00100000:3.0:1780996964.435856:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5904 00000100:00100000:3.0:1780996964.435865:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:81504:x1867507126811776:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1780996964.435892:0:25178:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -561 00002000:02000040:3.0:1780996964.435897:0:25178:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:145 to 0x2c0000401:705) 00002000:00010000:1.0:1780996964.440509:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.440527:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c030596ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.440548:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.440550:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.440555:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c030596ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.440572:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c030596ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.440591:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c030596ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.440599:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c030596ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.440624:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996964.441092:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.441099:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c030596b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.441108:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.441110:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.441113:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c030596b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.441123:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c030596b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.441305:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c030596b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.441314:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c030596b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.441561:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780996964.441581:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780996964.441588:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c030596ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.441596:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.441601:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c030596ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.441610:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c030596ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.441628:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c030596ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.441636:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c030596ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.443691:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780996964.443705:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c030596b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.443732:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.443738:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c030596b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.443749:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c030596b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.443790:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c030596b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.443809:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c030596b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.443832:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.443834:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.443837:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780996964.444079:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.444087:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c030596ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.444100:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.444101:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.444106:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c030596ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.444118:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c030596ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.444138:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c030596ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.444146:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c030596ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.444579:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780996964.444616:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780996964.444625:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c030596ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.444636:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780996964.444647:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c030596ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.444657:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c030596ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780996964.444668:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780996964.444671:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c030596ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.444675:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c030596c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.444686:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c030596ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.444691:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.444694:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.444700:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c030596c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.444706:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996964.444710:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.444713:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c030596c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.444713:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.445007:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c030596c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445015:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c030596c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445034:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996964.445075:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.445080:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c030596c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445087:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.445089:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.445099:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c030596c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445108:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c030596c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445116:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c030596c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445243:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c030596c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445259:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780996964.445289:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780996964.445294:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c030596c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445301:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.445305:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c030596c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445313:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c030596c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.445324:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780996964.445328:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c030596c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.445333:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c030596c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.445348:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780996964.445351:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c030596c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.445373:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c030596c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445377:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c030596c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.445390:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c030596c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445398:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.445402:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.445406:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996964.445410:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c030596c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.445429:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996964.445432:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996964.445434:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780996964.445475:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.445482:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c030596cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445491:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.445494:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.445498:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c030596cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445508:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c030596cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445516:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c030596cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445525:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c030596cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445549:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996964.445596:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.445610:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c030596d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445620:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.445622:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.445626:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c030596d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445637:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c030596d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445645:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c030596d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.445653:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c030596d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.445680:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780996964.445686:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c030596cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.445694:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780996964.445698:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c030596cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.445707:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c030596cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.445717:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c030596cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.445724:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d06fab/0x30fd811c030596cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.445738:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996964.445740:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996964.445747:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.451387:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996964.451523:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.451532:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c030596dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451546:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.451548:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.451554:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c030596dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451567:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c030596dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451585:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c030596dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451593:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c030596dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451608:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780996964.451619:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780996964.451624:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c030596d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451630:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.451635:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c030596d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451644:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c030596d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451662:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c030596d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451670:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053eae3be/0x30fd811c030596d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451691:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780996964.451702:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c030596dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451708:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.451711:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c030596dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451718:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c030596dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451741:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c030596dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451748:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c030596dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451760:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.451761:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.451763:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780996964.451814:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.451819:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c030596e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451826:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.451827:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.451830:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c030596e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451849:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c030596e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451856:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c030596e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451862:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c030596e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451876:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780996964.451883:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780996964.451887:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c030596e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.451894:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.451896:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c030596e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453042:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c030596e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453062:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c030596e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453070:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb8d4bac/0x30fd811c030596e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453111:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.453113:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.453115:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780996964.453387:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.453393:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c030596eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453403:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.453405:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.453408:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c030596eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453418:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c030596eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453427:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c030596eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453433:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c030596eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453454:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780996964.453461:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780996964.453465:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c030596eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453483:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.453487:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c030596eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453495:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c030596eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453507:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c030596eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453514:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddfcce40/0x30fd811c030596eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453531:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.453533:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.453535:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996964.453544:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780996964.453576:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.453581:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c030596f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453589:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.453590:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.453593:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c030596f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453602:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c030596f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453616:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c030596f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453624:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c030596f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453649:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996964.453690:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.453695:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c030596f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453702:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.453703:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.453708:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c030596f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453716:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c030596f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453723:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c030596f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453730:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c030596f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453742:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780996964.453754:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780996964.453758:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c030596f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453766:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.453770:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c030596f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453777:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c030596f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453787:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c030596f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453795:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f894b54b/0x30fd811c030596f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453821:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780996964.453825:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c030596f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.453825:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.453834:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.453838:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c030596f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453845:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c030596f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453867:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c030596f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453875:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050a9a176/0x30fd811c030596f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.453889:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.453890:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.453893:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780996964.454782:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.454789:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c03059700 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.454811:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.454813:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.454817:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c03059700 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.454827:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c03059700 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.454835:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c03059700 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.454845:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c03059700 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.454881:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996964.455093:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.455099:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c03059707 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455107:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.455108:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.455112:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c03059707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455306:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c03059707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455320:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c03059707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455329:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c03059707 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455360:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780996964.455394:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780996964.455402:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c03059700 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780996964.455409:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.455414:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.455417:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c0305970e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.455421:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c03059700 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455431:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.455435:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.455437:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c03059700 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455446:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c0305970e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.455458:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c03059700 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455460:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c0305970e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.455478:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d92b8cf3/0x30fd811c03059700 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455481:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c0305970e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455501:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c0305970e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.455516:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780996964.455517:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780996964.455521:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c03059707 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455529:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780996964.455530:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.455534:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c0305970e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.455536:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c03059707 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455554:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.455559:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c0305970e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455579:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c0305970e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.455583:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c03059707 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.455600:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c0305970e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.455603:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c03059707 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.455622:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002347e9cc/0x30fd811c03059707 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.455642:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.455643:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006994f072/0x30fd811c0305970e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.455646:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996964.455650:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.456115:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.456118:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.456120:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996964.457523:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780996964.457869:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.457880:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c03059715 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.457896:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.457968:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.457973:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c03059715 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.457987:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c03059715 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.457996:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c03059715 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.458003:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c03059715 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.458020:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996964.458068:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.458081:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c0305971c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.458089:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.458090:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.458093:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c0305971c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.458103:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c0305971c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.458112:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c0305971c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.458119:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c0305971c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.458858:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780996964.458872:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780996964.458879:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c03059715 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.458888:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.458893:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c03059715 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.458972:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c03059715 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.459005:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c03059715 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.459014:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f96b946b/0x30fd811c03059715 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.459038:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780996964.459042:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c0305971c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.459049:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.459052:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c0305971c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.459059:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c0305971c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.459069:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c0305971c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.459076:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082399e8a/0x30fd811c0305971c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.459090:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.459093:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.459102:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996964.459663:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780996964.459850:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.459858:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c03059723 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.459870:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.459872:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.459876:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c03059723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.459888:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c03059723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.459897:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c03059723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.459980:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c03059723 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.459996:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996964.460048:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.460055:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c0305972a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.460064:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.460066:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.460069:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c0305972a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.460090:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c0305972a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.460099:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c0305972a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.460106:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c0305972a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.460122:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780996964.460139:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780996964.460144:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c03059723 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.460151:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.460154:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c03059723 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.460831:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c03059723 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.460855:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c03059723 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.460864:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcdc61f6/0x30fd811c03059723 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.460882:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780996964.460892:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c0305972a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.460898:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996964.460903:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780996964.460907:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c0305972a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.460916:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c0305972a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.460930:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c0305972a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.460938:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e6c5a1f/0x30fd811c0305972a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.460954:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996964.460956:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996964.460957:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.461303:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.461306:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780996964.461388:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.461395:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c03059731 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.461404:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.461406:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.461409:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c03059731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.461418:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c03059731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.461427:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c03059731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.461434:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c03059731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.461464:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996964.461511:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.461517:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c03059738 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.461538:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.461540:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.461544:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c03059738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.461554:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c03059738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.461564:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c03059738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462313:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c03059738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462333:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780996964.462391:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.462397:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078cb97e8/0x30fd811c0305973f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462405:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.462406:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.462409:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078cb97e8/0x30fd811c0305973f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462418:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078cb97e8/0x30fd811c0305973f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462440:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078cb97e8/0x30fd811c0305973f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462447:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078cb97e8/0x30fd811c0305973f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462464:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1780996964.462475:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780996964.462481:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c03059731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462488:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.462493:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c03059731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462502:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c03059731 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462515:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c03059731 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462523:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5ef6e45/0x30fd811c03059731 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462542:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780996964.462552:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c03059738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462558:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.462561:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c03059738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462579:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c03059738 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462591:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c03059738 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462599:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a359055f/0x30fd811c03059738 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462613:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780996964.462616:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078cb97e8/0x30fd811c0305973f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462622:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6da000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780996964.462630:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078cb97e8/0x30fd811c0305973f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.462638:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078cb97e8/0x30fd811c0305973f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996964.463144:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996964.463151:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.464014:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078cb97e8/0x30fd811c0305973f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.464026:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078cb97e8/0x30fd811c0305973f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.464051:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.464053:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996964.464055:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780996964.466763:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.466777:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0b9b784/0x30fd811c03059746 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780996964.467588:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780996964.467598:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305974d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.467610:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780996964.467612:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780996964.467618:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305974d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.467635:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305974d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.467646:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305974d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.467655:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305974d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.467688:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780996964.467703:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996964.467709:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305974d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.467738:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.467744:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305974d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.467753:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305974d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.467771:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305974d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.467780:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305974d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.467813:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.467815:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.467817:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.467827:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780996964.467961:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780996964.467966:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cda887f/0x30fd811c03059754 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.468499:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780996964.468504:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780996964.468508:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cda887f/0x30fd811c03059754 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.468544:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cda887f/0x30fd811c03059754 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.468653:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cda887f/0x30fd811c03059754 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.468674:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cda887f/0x30fd811c03059754 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.468735:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780996964.468746:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996964.468751:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cda887f/0x30fd811c03059754 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.468760:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.468765:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cda887f/0x30fd811c03059754 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.468773:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cda887f/0x30fd811c03059754 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.468785:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cda887f/0x30fd811c03059754 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.468793:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cda887f/0x30fd811c03059754 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.468827:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.468829:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.468831:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780996964.469052:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780996964.469059:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ec2604/0x30fd811c0305975b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.469068:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780996964.469069:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780996964.469072:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087ec2604/0x30fd811c0305975b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.469083:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087ec2604/0x30fd811c0305975b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.469092:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ec2604/0x30fd811c0305975b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.469099:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087ec2604/0x30fd811c0305975b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.469116:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780996964.469316:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996964.469322:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087ec2604/0x30fd811c0305975b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.469343:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.469346:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ec2604/0x30fd811c0305975b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.469359:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ec2604/0x30fd811c0305975b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469425:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.469430:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.469435:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0b9b784/0x30fd811c03059746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469447:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0b9b784/0x30fd811c03059746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469456:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0b9b784/0x30fd811c03059746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469463:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0b9b784/0x30fd811c03059746 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469490:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996964.469557:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.469563:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c03059762 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469571:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.469572:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.469576:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c03059762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469585:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c03059762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469593:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c03059762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469600:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c03059762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469614:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780996964.469669:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.469679:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069bc7917/0x30fd811c03059769 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469691:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.469693:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.469704:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069bc7917/0x30fd811c03059769 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469715:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069bc7917/0x30fd811c03059769 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469732:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069bc7917/0x30fd811c03059769 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469739:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069bc7917/0x30fd811c03059769 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469754:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1780996964.469810:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.469816:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006da668d1/0x30fd811c03059770 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469823:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.469828:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.469831:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006da668d1/0x30fd811c03059770 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469842:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006da668d1/0x30fd811c03059770 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.469849:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006da668d1/0x30fd811c03059770 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.470000:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006da668d1/0x30fd811c03059770 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.470009:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1780996964.470053:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.470058:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c03059777 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.470066:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.470068:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.470071:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c03059777 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.470080:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c03059777 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.470087:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c03059777 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.470094:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c03059777 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.470102:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1780996964.470147:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.470152:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305977e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470380:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087ec2604/0x30fd811c0305975b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470390:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087ec2604/0x30fd811c0305975b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470414:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780996964.470418:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0b9b784/0x30fd811c03059746 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470426:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6daa00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.470430:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0b9b784/0x30fd811c03059746 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470438:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0b9b784/0x30fd811c03059746 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470449:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0b9b784/0x30fd811c03059746 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470465:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0b9b784/0x30fd811c03059746 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470485:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780996964.470488:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c03059762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470494:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.470497:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c03059762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470505:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c03059762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470516:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c03059762 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470525:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c03059762 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470539:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780996964.470543:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069bc7917/0x30fd811c03059769 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470550:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dac00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.470560:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069bc7917/0x30fd811c03059769 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470570:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069bc7917/0x30fd811c03059769 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470581:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069bc7917/0x30fd811c03059769 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470588:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069bc7917/0x30fd811c03059769 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470602:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780996964.470606:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006da668d1/0x30fd811c03059770 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470612:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dba00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.470615:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006da668d1/0x30fd811c03059770 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470623:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006da668d1/0x30fd811c03059770 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470632:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006da668d1/0x30fd811c03059770 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470640:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006da668d1/0x30fd811c03059770 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470676:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996964.470681:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c03059777 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470689:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6da600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.470693:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c03059777 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470712:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c03059777 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470741:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c03059777 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470749:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c03059777 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.470765:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.470767:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.470769:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.470782:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.470788:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.470793:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780996964.470870:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.471045:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.471047:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.471052:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305977e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471063:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305977e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471072:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305977e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471080:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305977e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471099:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780996964.471408:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.471415:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305978c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471423:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.471425:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.471428:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305978c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471437:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305978c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471462:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305978c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471470:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305978c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471489:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780996964.471536:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.471541:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c03059793 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471549:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.471551:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.471554:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c03059793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471562:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c03059793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471570:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c03059793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471578:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c03059793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471591:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1780996964.471635:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.471640:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c0305979a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.471649:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.471650:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.471653:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c0305979a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.471849:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd09116/0x30fd811c03059785 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.472086:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c0305979a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.472096:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c0305979a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.472104:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c0305979a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.472311:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1780996964.472363:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.472368:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c030597a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.472375:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.472377:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.472380:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c030597a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.472389:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c030597a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.472404:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c030597a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.472411:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c030597a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.472419:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:1.0:1780996964.472679:0:23044:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:642 00010000:00010000:3.0:1780996964.472832:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780996964.472834:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780996964.472837:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd09116/0x30fd811c03059785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.472846:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afd09116/0x30fd811c03059785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.472854:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd09116/0x30fd811c03059785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.472861:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afd09116/0x30fd811c03059785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.472880:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780996964.472887:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305977e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.472894:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6da200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.473372:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305977e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473388:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305977e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473406:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305977e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473423:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305977e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473448:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780996964.473453:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305978c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473459:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dbc00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.473462:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305978c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473469:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305978c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473479:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305978c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473486:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305978c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473496:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780996964.473499:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c03059793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473505:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.473514:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c03059793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473522:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c03059793 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473531:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c03059793 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473538:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c03059793 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473550:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780996964.473554:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c0305979a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473561:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dbe00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.473564:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c0305979a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473571:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c0305979a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473581:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c0305979a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473587:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef332c85/0x30fd811c0305979a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473606:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996964.473609:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c030597a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473616:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.473619:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c030597a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.473626:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c030597a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.476398:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c030597a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.476411:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c030597a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.476435:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.476437:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.476439:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.476447:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.476453:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.476458:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.476472:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780996964.476485:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996964.476491:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afd09116/0x30fd811c03059785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.476510:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780996964.476514:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd09116/0x30fd811c03059785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.476524:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd09116/0x30fd811c03059785 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.476537:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afd09116/0x30fd811c03059785 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.476545:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd09116/0x30fd811c03059785 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.476561:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.476563:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996964.476565:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780996964.476667:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780996964.476675:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beed4172/0x30fd811c030597a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.476686:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780996964.476688:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780996964.476694:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beed4172/0x30fd811c030597a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.476705:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000beed4172/0x30fd811c030597a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996964.476720:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beed4172/0x30fd811c030597a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780996964.476828:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:81502:x1867507126811648:12345-0@lo:5:osp-pre-0-0.0 Request processed in 48315us (48625us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996964.476840:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5903 00000100:00100000:1.0:1780996964.477767:0:81502:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11ab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:81502:1867507126811648:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1780996964.477785:0:81502:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x2c1:0x0] from OST, last_created [0x280000400:0x2c1:0x0]last_used is [0x280000400:0x282:0x0] 00000100:00100000:1.0:1780996964.477876:0:81502:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:81502:1867507126812032:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1780996964.478048:0:81502:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996964.478079:0:81502:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27000 going to sleep for 11 seconds 00000100:00100000:1.0:1780996964.479356:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126811904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780996964.479406:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996964.479456:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126811904 00000100:00100000:1.0:1780996964.479464:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126811904 00000100:00100000:1.0:1780996964.479508:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:1.0:1780996964.479517:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126811904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780996964.479548:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996964.479603:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126811904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996964.479610:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00100000:1.0:1780996964.479653:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126811904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1780996964.480016:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000beed4172/0x30fd811c030597a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780996964.480044:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126812032 00000100:00100000:3.0:1780996964.480048:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126812032 00000100:00100000:3.0:1780996964.480084:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5905 00000100:00100000:3.0:1780996964.480091:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:81502:x1867507126812032:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1780996964.480116:0:25177:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 706 00010000:00010000:2.0:1780996964.481346:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780996964.481458:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.481468:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c030597af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481484:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.481487:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.481493:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c030597af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481509:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c030597af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481540:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c030597af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481549:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c030597af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481565:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780996964.481615:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.481621:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c030597b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481630:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.481632:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.481635:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c030597b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481646:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c030597b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481654:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c030597b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481662:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c030597b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481677:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1780996964.481730:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.481736:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c030597bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481744:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.481746:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.481748:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c030597bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481757:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c030597bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481764:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c030597bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481771:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c030597bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481783:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1780996964.481827:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.481832:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c030597c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481839:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.481840:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.481843:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c030597c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481852:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c030597c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481865:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c030597c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481872:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c030597c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481881:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1780996964.481915:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.481920:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c030597cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481928:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.481930:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.481933:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c030597cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481943:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c030597cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481951:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c030597cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481959:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c030597cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.481968:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1780996964.482009:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.482015:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c030597d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482024:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482026:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482029:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c030597d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482037:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c030597d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482045:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c030597d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482052:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c030597d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482060:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1780996964.482105:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.482110:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c030597d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482118:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482119:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482122:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c030597d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482131:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c030597d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482145:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c030597d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482153:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c030597d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482161:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1780996964.482194:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.482199:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c030597e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482206:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482208:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482210:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c030597e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482219:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c030597e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482227:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c030597e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482234:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c030597e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482242:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1780996964.482304:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.482308:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c030597e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482316:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482317:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482320:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c030597e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482329:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c030597e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482337:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c030597e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482344:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c030597e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482352:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1780996964.482380:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.482385:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c030597ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482392:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482393:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482397:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c030597ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482405:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c030597ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482419:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c030597ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482426:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c030597ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482434:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1780996964.482466:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.482471:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c030597f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482478:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482479:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482482:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c030597f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482491:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c030597f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482500:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c030597f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482507:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c030597f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482515:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1780996964.482552:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.482556:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c030597fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482564:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482565:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482569:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c030597fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482578:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c030597fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482586:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c030597fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482592:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c030597fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482600:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1780996964.482631:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.482636:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059803 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482642:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482644:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482646:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059803 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482654:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059803 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482667:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059803 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482674:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059803 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482682:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1780996964.482721:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.482726:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305980a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482734:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482735:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482737:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305980a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482745:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305980a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482752:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305980a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482758:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305980a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482766:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1780996964.482817:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.482822:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059811 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482829:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482830:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482832:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059811 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482840:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059811 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482847:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059811 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482853:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059811 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482860:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:2.0:1780996964.482891:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.482896:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c03059818 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482902:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482904:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482906:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c03059818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482915:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c03059818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482929:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c03059818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482936:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c03059818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482944:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:2.0:1780996964.482983:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.482988:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305981f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.482995:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482997:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.482999:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305981f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483008:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305981f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483016:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305981f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483024:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305981f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483032:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:2.0:1780996964.483069:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.483074:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c03059826 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483082:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.483083:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.483086:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c03059826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483095:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c03059826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483103:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c03059826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483110:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c03059826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483118:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:2.0:1780996964.483149:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.483154:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305982d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483161:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.483162:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.483165:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305982d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483174:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305982d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483188:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305982d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483195:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305982d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483203:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:2.0:1780996964.483234:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.483239:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c03059834 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483247:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.483249:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.483252:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c03059834 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483261:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c03059834 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483290:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c03059834 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483298:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c03059834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483305:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:2.0:1780996964.483345:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.483351:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c0305983b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483358:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.483360:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.483363:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c0305983b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483372:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c0305983b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483380:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c0305983b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483387:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c0305983b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483396:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:2.0:1780996964.483428:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780996964.483433:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c03059842 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483441:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.483442:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.483448:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c03059842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483457:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c03059842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483471:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c03059842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.483479:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c03059842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.483686:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:1.0:1780996964.483746:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.483753:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059849 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.483762:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.483763:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.483767:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.483778:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.483787:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.483805:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059849 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.483815:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00002000:00010000:1.0:1780996964.483848:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.483854:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059850 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.483876:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.483878:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.483881:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.483890:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.483898:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.484419:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.484429:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00010000:00010000:2.0:1780996964.484575:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00010000:00010000:2.0:1780996964.484583:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000beed4172/0x30fd811c030597a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484592:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.484596:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000beed4172/0x30fd811c030597a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484605:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000beed4172/0x30fd811c030597a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484625:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000beed4172/0x30fd811c030597a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484633:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000beed4172/0x30fd811c030597a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484651:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:2.0:1780996964.484655:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c030597af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484670:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.484673:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c030597af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484682:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c030597af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484693:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c030597af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484700:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c030597af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484714:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:2.0:1780996964.484718:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c030597b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484725:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.484729:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c030597b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484737:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c030597b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484746:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c030597b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484758:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c030597b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484771:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:2.0:1780996964.484775:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c030597bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484781:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.484784:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c030597bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484792:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c030597bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484813:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c030597bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484820:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c030597bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484834:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:2.0:1780996964.484838:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c030597c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484845:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3c00 already unused, calling callback (ffffffffc0ecc850) 00002000:00010000:1.0:1780996964.484847:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.484855:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059857 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484857:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c030597c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.484875:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780996964.484878:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c030597c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.484879:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.484884:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059857 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484893:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c030597c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.484898:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059857 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484903:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c030597c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484916:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:2.0:1780996964.484920:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c030597cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484926:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.484929:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c030597cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484936:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c030597cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484945:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c030597cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484953:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c030597cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484973:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:2.0:1780996964.484977:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c030597d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484983:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.484985:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c030597d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.484993:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c030597d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485003:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c030597d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485011:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c030597d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485022:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:2.0:1780996964.485026:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c030597d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485032:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.485035:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c030597d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485055:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c030597d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485068:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c030597d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485077:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c030597d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485091:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:2.0:1780996964.485095:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c030597e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485102:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.485105:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c030597e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485114:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c030597e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485124:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c030597e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485131:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c030597e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485155:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:2.0:1780996964.485159:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c030597e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485166:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.485169:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c030597e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485178:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c030597e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485188:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c030597e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485195:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c030597e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485206:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1780996964.485210:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c030597ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485217:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.485221:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c030597ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485239:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c030597ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485250:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c030597ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485258:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c030597ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485286:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1780996964.485290:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c030597f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485297:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.485300:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c030597f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485308:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c030597f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485318:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c030597f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485325:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001656ce6c/0x30fd811c030597f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485348:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1780996964.485352:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c030597fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485359:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.485363:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c030597fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485372:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c030597fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485382:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c030597fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485390:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000900f69ea/0x30fd811c030597fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485400:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1780996964.485404:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059803 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485411:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.485414:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059803 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485433:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059803 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485443:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059803 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485451:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c03059803 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485463:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1780996964.485466:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305980a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485473:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.485475:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305980a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485482:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305980a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485490:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305980a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485497:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305980a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485520:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1780996964.485524:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059811 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485530:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.485534:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059811 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485541:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059811 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485550:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059811 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485557:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c03059811 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485568:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1780996964.485572:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c03059818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485579:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.485582:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c03059818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485599:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c03059818 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485608:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c03059818 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485615:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c03059818 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485628:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1780996964.485631:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305981f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485639:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.485641:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305981f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485649:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305981f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485659:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305981f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485666:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305981f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485689:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1780996964.485693:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c03059826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485699:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.485702:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c03059826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485709:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c03059826 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485719:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c03059826 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485726:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c03059826 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485737:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1780996964.485741:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305982d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485747:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.485750:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305982d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485768:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305982d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485779:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305982d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.485787:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305982d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.486626:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059857 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.486636:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059857 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.487111:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1780996964.487186:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.487193:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c0305985e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.487204:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.487205:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.487209:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c0305985e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.487221:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c0305985e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.487229:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c0305985e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.487237:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c0305985e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.487246:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1780996964.487307:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780996964.487312:0:25178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059865 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.487320:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.487321:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780996964.487325:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059865 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.487333:0:25178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059865 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.487341:0:25178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059865 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.487349:0:25178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059865 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996964.487357:0:25178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1780996964.488103:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1780996964.488113:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c03059834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488122:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.488127:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c03059834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488137:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c03059834 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488153:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c03059834 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488161:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb3b309c/0x30fd811c03059834 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488187:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1780996964.488190:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c0305983b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488196:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.488200:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c0305983b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488206:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c0305983b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488214:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c0305983b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488221:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc18c993/0x30fd811c0305983b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488231:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1780996964.488234:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c03059842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488239:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.488242:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c03059842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488259:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c03059842 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488281:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c03059842 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488288:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bd0ff29/0x30fd811c03059842 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488300:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1780996964.488304:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059849 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488309:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.488312:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059849 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488319:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059849 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488328:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059849 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488334:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059849 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488361:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1780996964.488365:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488371:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dae00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.488375:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488382:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059850 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488393:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059850 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488400:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059850 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488415:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780996964.488419:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059857 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488432:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6da400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.488435:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059857 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488454:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059857 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488465:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059857 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488473:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059857 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488489:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780996964.488493:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c0305985e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488501:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.488505:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c0305985e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488514:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c0305985e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488524:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c0305985e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488532:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c0305985e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488558:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780996964.488562:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059865 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488570:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780996964.488573:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059865 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488582:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059865 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488593:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059865 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488600:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059865 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996964.488616:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996964.488620:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996964.488623:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996964.488815:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996964.489332:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996964.490972:0:81502:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:81502:1867507126812032:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1780996964.490997:0:81502:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x2c1:0x0]-[0x280000400:0x2e1:0x0] 00000100:00100000:3.0:1780996964.491691:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:81502:x1867507126812032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10811us (12853us total) trans 4294969449 rc 0/0 00000100:00100000:3.0:1780996964.491705:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5905 00010000:00010000:3.0:1780996964.491753:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1780996964.503762:0:25178:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:144 00000100:00100000:1.0:1780996964.503873:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:81504:x1867507126811776:12345-0@lo:5:osp-pre-1-0.0 Request processed in 68003us (68149us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996964.503887:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5904 00000100:00100000:2.0:1780996964.504435:0:81504:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:81504:1867507126811776:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1780996964.504458:0:81504:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2c1:0x0] from OST, last_created [0x2c0000401:0x2c1:0x0]last_used is [0x2c0000401:0x90:0x0] 00000100:00100000:2.0:1780996964.504541:0:81504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:81504:1867507126812288:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1780996964.504581:0:81504:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996964.504606:0:81504:0:(client.c:2692:ptlrpc_set_wait()) set ffff968983683540 going to sleep for 11 seconds 00000100:00100000:2.0:1780996964.504621:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780996964.504632:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126812160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780996964.504659:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996964.504688:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126812288 00000100:00100000:2.0:1780996964.504693:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126812288 00000100:00100000:1.0:1780996964.506409:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126812160 00000100:00100000:1.0:1780996964.506424:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126812160 00000100:00100000:1.0:1780996964.506481:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:1.0:1780996964.506492:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126812160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780996964.506531:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996964.506619:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126812160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996964.506628:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1780996964.509093:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5906 00000100:00100000:2.0:1780996964.509113:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:81504:x1867507126812288:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1780996964.509157:0:25171:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 706 00000100:00100000:1.0:1780996964.510779:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126812160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780996964.516245:0:81504:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:81504:1867507126812288:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1780996964.516266:0:81504:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2c1:0x0]-[0x2c0000401:0x2e1:0x0] 00000100:00100000:2.0:1780996964.516366:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:81504:x1867507126812288:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7057us (11578us total) trans 4294969449 rc 0/0 00000100:00100000:2.0:1780996964.516378:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5906 00000020:00000004:0.0:1780996964.891482:0:81855:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780996964.891858:0:81855:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1780996965.105217:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996966.117661:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996966.822723:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780996966.822750:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126812416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780996966.822841:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996966.823082:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126812416 00000100:00100000:2.0:1780996966.823091:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126812416 00000100:00100000:2.0:1780996966.823161:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:2.0:1780996966.823170:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126812416:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780996966.823181:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00000024:2.0:1780996966.823200:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780996966.823210:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126812544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780996966.823252:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996966.823259:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126812416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996966.823299:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00100000:2.0:1780996966.823316:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126812544 00000100:00100000:2.0:1780996966.823325:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126812544 00000100:00100000:2.0:1780996966.823342:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:2.0:1780996966.823347:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126812544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780996966.823362:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996966.823397:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126812544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996966.823403:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00100000:1.0:1780996966.823652:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126812416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780996966.823757:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126812544:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1780996966.824007:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780996966.824012:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780996966.933367:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996966.933510:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110330240 00000100:00100000:2.0:1780996966.933521:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110330240 00000100:00100000:2.0:1780996966.933590:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1082 00000100:00100000:2.0:1780996966.933600:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64623:x1867507110330240:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780996966.933621:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780996966.933655:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305986c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8aa4 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996966.933720:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c03059873 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996966.933735:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c03059873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996966.933749:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c03059873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780996966.933809:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780996966.933813:0:63584:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780996966.933840:0:63584:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c03059873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996966.933866:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305986c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aa4 expref: 8 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996966.933903:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c03059873 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aa4 expref: 7 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996966.933912:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3b00) 00010000:00010000:2.0:1780996966.933915:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780996966.933918:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454200, rc 0) 00000100:00100000:2.0:1780996966.933983:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:64623:x1867507110330240:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 385us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996966.933990:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1082 00000100:00080000:3.0:1780996966.934361:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780996966.940540:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996966.940644:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110330368 00000100:00100000:2.0:1780996966.940660:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110330368 00000100:00100000:2.0:1780996966.940732:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1083 00000100:00100000:2.0:1780996966.940743:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:64623:x1867507110330368:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:2.0:1780996966.940780:0:63417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:2.0:1780996966.940870:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:64623:x1867507110330368:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 129us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996966.940878:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1083 00000100:00100000:1.0:1780996966.947636:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996966.947780:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110330496 00000100:00100000:2.0:1780996966.947804:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110330496 00000100:00100000:2.0:1780996966.947959:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1084 00000100:00100000:2.0:1780996966.947971:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64623:x1867507110330496:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:2.0:1780996966.948008:0:63418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1780996966.948102:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64623:x1867507110330496:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 132us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996966.948110:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1084 00000100:00080000:3.0:1780996966.948578:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780996966.951916:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996966.952030:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110330624 00000100:00100000:3.0:1780996966.952042:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110330624 00000100:00100000:3.0:1780996966.952109:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5907 00000100:00100000:3.0:1780996966.952118:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1867507110330624:12345-192.168.206.51@tcp:8:lfs.0 00010000:00080000:3.0:1780996966.952168:0:8233:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp t0 exp 0000000000000000 cur 3494 last 0 00000020:00000080:3.0:1780996966.952199:0:8233:0:(genops.c:1406:class_connect()) connect: client 285c134c-d3a6-4c01-bb4d-8148c50d5f95, cookie 0x30fd811c0305987a 00002000:00100000:3.0:1780996966.952212:0:8233:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 285c134c-d3a6-4c01-bb4d-8148c50d5f95/ffff96888b417000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1780996966.952224:0:8233:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1780996966.952330:0:8233:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1780996966.952359:0:8233:0:(import.c:65:import_set_state_nolock()) ffff96888b417800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780996966.952427:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110330624:12345-192.168.206.51@tcp:8:lfs.0 Request processed in 310us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996966.952435:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5907 00000100:00100000:0.0:1780996966.955267:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996966.955381:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110330752 00000100:00100000:2.0:1780996966.955391:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110330752 00000100:00100000:2.0:1780996966.955464:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1938 00000100:00100000:2.0:1780996966.955474:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64623:x1867507110330752:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1780996966.955499:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996966.955570:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64623:x1867507110330752:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996966.955578:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1938 00000100:00080000:3.0:1780996966.955644:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996966.961546:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996966.961643:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110330880 00000100:00100000:3.0:1780996966.961655:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110330880 00000100:00100000:3.0:1780996966.961703:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5908 00000100:00100000:3.0:1780996966.961711:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2393:x1867507110330880:12345-192.168.206.51@tcp:8:lfs.0 00010000:00080000:3.0:1780996966.961748:0:25180:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp t0 exp 0000000000000000 cur 3494 last 0 00000020:00000080:3.0:1780996966.961780:0:25180:0:(genops.c:1406:class_connect()) connect: client 285c134c-d3a6-4c01-bb4d-8148c50d5f95, cookie 0x30fd811c03059881 00002000:00100000:3.0:1780996966.961801:0:25180:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 285c134c-d3a6-4c01-bb4d-8148c50d5f95/ffff96888b411800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1780996966.961812:0:25180:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1780996966.961886:0:25180:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1780996966.961918:0:25180:0:(import.c:65:import_set_state_nolock()) ffff96888b412000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780996966.961992:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110330880:12345-192.168.206.51@tcp:8:lfs.0 Request processed in 280us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996966.962001:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5908 00000100:00100000:0.0:1780996966.977005:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996966.977137:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110331008 00000100:00100000:1.0:1780996966.977148:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110331008 00000100:00100000:1.0:1780996966.977422:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1939 00000100:00100000:1.0:1780996966.977433:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64623:x1867507110331008:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:1.0:1780996966.977464:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996966.977538:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:64623:x1867507110331008:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 107us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996966.977545:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1939 00000100:00080000:3.0:1780996966.980216:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780996967.141756:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996968.168092:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996969.189661:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996969.227145:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996969.227193:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996969.227225:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996969.227247:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996969.227293:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996969.227321:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110331392 00000100:00100000:3.0:1780996969.227332:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110331392 00000100:00100000:3.0:1780996969.227390:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110331264 00000100:00100000:3.0:1780996969.227393:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110331264 00000100:00100000:3.0:1780996969.227432:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1073 00000100:00100000:3.0:1780996969.227443:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110331392:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996969.227521:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110331392:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 80us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996969.227528:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1073 00000100:00100000:3.0:1780996969.227546:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1074 00000100:00100000:3.0:1780996969.227553:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110331264:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996969.227578:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110331264:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996969.227584:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1074 00000100:00100000:3.0:1780996969.227605:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110331648 00000100:00100000:3.0:1780996969.227609:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110331648 00000100:00100000:3.0:1780996969.227633:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110331520 00000100:00100000:3.0:1780996969.227635:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110331520 00000100:00100000:3.0:1780996969.227653:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2430 00000100:00100000:3.0:1780996969.227659:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110331648:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996969.227684:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110331648:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996969.227707:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2430 00000100:00100000:3.0:1780996969.227720:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2431 00000100:00100000:3.0:1780996969.227726:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110331520:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996969.227751:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110331520:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996969.227757:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2431 00000100:00080000:3.0:1780996969.227790:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780996969.227794:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780996969.227796:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780996969.227798:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780996969.228198:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110331136 00000100:00100000:1.0:1780996969.228203:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110331136 00000100:00100000:1.0:1780996969.228240:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:1.0:1780996969.228248:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110331136:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996969.228306:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110331136:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 59us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996969.228314:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:3.0:1780996969.383540:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126812800:0@lo:400:kworker.0 00000100:00100000:1.0:1780996969.383541:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126812928:0@lo:400:kworker.0 00000100:00100000:0.0:1780996969.383676:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126813056:0@lo:400:kworker.0 00000100:00100000:2.0:1780996969.383801:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126812672:0@lo:400:kworker.0 00000100:00100000:1.0:1780996969.388854:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996969.388906:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126813440:0@lo:400:kworker.0 00000100:00100000:1.0:1780996969.388953:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996969.388975:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126813952:0@lo:400:kworker.0 00000100:00100000:1.0:1780996969.388997:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996969.389067:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126812928 00000100:00100000:1.0:1780996969.389075:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126812928 00000100:00100000:1.0:1780996969.389950:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1780996969.389960:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126812928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996969.390026:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126812928:12345-0@lo:400:kworker.0 Request processed in 68us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996969.390033:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1780996969.390059:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126813440 00000100:00100000:1.0:1780996969.390065:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126813440 00000100:00100000:1.0:1780996969.392137:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126813952 00000100:00100000:1.0:1780996969.392148:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126813952 00000100:00100000:1.0:1780996969.392210:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432 00000100:00100000:1.0:1780996969.392218:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126813440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996969.392309:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126813440:12345-0@lo:400:kworker.0 Request processed in 92us (3355us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996969.392316:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432 00000100:00100000:1.0:1780996969.392332:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433 00000100:00100000:1.0:1780996969.392338:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126813952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996969.392367:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126813952:12345-0@lo:400:kworker.0 Request processed in 29us (3368us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996969.392389:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433 00000100:00100000:1.0:1780996969.392519:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126812928:0@lo:400:kworker.0 00000100:00100000:1.0:1780996969.392532:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126813440:0@lo:400:kworker.0 00000100:00100000:1.0:1780996969.392543:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126813952:0@lo:400:kworker.0 00000100:00080000:1.0:1780996969.392611:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780996969.392616:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996969.393253:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996969.393306:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888d7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126813312:0@lo:400:kworker.0 00000100:00100000:3.0:1780996969.393345:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996969.393371:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126813824:0@lo:400:kworker.0 00000100:00100000:3.0:1780996969.393429:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996969.393458:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126813312 00000100:00100000:3.0:1780996969.393463:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126813312 00000100:00100000:3.0:1780996969.393492:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126813824 00000100:00100000:3.0:1780996969.393496:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126813824 00000100:00100000:3.0:1780996969.393517:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884 00000100:00100000:3.0:1780996969.393532:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bf8c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126813312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996969.393571:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bf8c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126813312:12345-0@lo:400:kworker.0 Request processed in 47us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996969.393577:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884 00000100:00100000:1.0:1780996969.393920:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126812800 00000100:00100000:1.0:1780996969.393925:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126812800 00000100:00100000:1.0:1780996969.393961:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1780996969.393978:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126812800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996969.394014:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126812800:12345-0@lo:400:kworker.0 Request processed in 47us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996969.394020:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00080000:1.0:1780996969.394039:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780996969.394410:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:3.0:1780996969.394418:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126813824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996969.394451:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126813824:12345-0@lo:400:kworker.0 Request processed in 35us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996969.394458:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00000100:00100000:3.0:1780996969.394501:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126813824:0@lo:400:kworker.0 00000100:00100000:3.0:1780996969.394522:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126814336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780996969.394544:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996969.394560:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126814336 00000100:00100000:3.0:1780996969.394564:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126814336 00000100:00100000:3.0:1780996969.394582:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:3.0:1780996969.394587:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126814336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780996969.394610:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1780996969.394638:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126814336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996969.394644:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00000100:00100000:3.0:1780996969.394671:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126814336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780996969.394681:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126812800:0@lo:400:kworker.0 00000100:00100000:3.0:1780996969.394690:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888d7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126813312:0@lo:400:kworker.0 00000100:00100000:0.0:1780996969.399454:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996969.399521:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126813568:0@lo:400:kworker.0 00000100:00100000:3.0:1780996969.399563:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126813056 00000100:00100000:0.0:1780996969.399570:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996969.399574:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126813056 00000100:00100000:0.0:1780996969.399608:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126814080:0@lo:400:kworker.0 00000100:00100000:0.0:1780996969.399637:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996969.399650:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:3.0:1780996969.399662:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126813056:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1780996969.399698:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780996969.399825:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126813568 00000100:00100000:1.0:1780996969.399830:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126813568 00000100:00100000:1.0:1780996969.399876:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126814080 00000100:00100000:1.0:1780996969.399879:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126814080 00000100:00100000:1.0:1780996969.399899:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434 00000100:00100000:1.0:1780996969.399906:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126813568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996969.399947:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126813568:12345-0@lo:400:kworker.0 Request processed in 41us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996969.399955:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434 00000100:00100000:1.0:1780996969.399986:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2435 00000100:00100000:1.0:1780996969.399994:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126814080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996969.400040:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126814080:12345-0@lo:400:kworker.0 Request processed in 48us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996969.400047:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2435 00000100:00080000:0.0:1780996969.400907:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780996969.400950:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126813568:0@lo:400:kworker.0 00000100:00100000:0.0:1780996969.400963:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126814080:0@lo:400:kworker.0 00000100:00100000:3.0:1780996969.401105:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126813056:12345-0@lo:400:kworker.0 Request processed in 1445us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996969.401123:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1780996969.401203:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126813056:0@lo:400:kworker.0 00000100:00100000:2.0:1780996969.402345:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996969.402400:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126813184:0@lo:400:kworker.0 00000100:00100000:2.0:1780996969.402454:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996969.402488:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126813696:0@lo:400:kworker.0 00000100:00100000:2.0:1780996969.402510:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996969.402526:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126814208:0@lo:400:kworker.0 00000100:00100000:2.0:1780996969.402550:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996969.402578:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126813184 00000100:00100000:2.0:1780996969.402584:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126813184 00000100:00100000:2.0:1780996969.402632:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126813696 00000100:00100000:2.0:1780996969.402635:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126813696 00000100:00100000:2.0:1780996969.402650:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126814208 00000100:00100000:2.0:1780996969.402652:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126814208 00000100:00100000:2.0:1780996969.402670:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1780996969.402678:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126813184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996969.402724:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126813184:12345-0@lo:400:kworker.0 Request processed in 46us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996969.402743:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1780996969.402766:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1780996969.402790:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126813696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996969.402827:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126813696:12345-0@lo:400:kworker.0 Request processed in 42us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996969.402895:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126812672 00000100:00100000:1.0:1780996969.402900:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126812672 00000100:00100000:2.0:1780996969.402922:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:2.0:1780996969.402933:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126814208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996969.402938:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1780996969.402949:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126812672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996969.402968:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126814208:12345-0@lo:400:kworker.0 Request processed in 39us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996969.402975:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:1.0:1780996969.403009:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126812672:12345-0@lo:400:kworker.0 Request processed in 62us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996969.403017:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1780996969.403031:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126814208:0@lo:400:kworker.0 00000100:00100000:2.0:1780996969.403056:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126812672:0@lo:400:kworker.0 00000100:00100000:2.0:1780996969.403067:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126813184:0@lo:400:kworker.0 00000100:00100000:2.0:1780996969.403075:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126813696:0@lo:400:kworker.0 00000100:00100000:0.0:1780996969.406872:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00080000:0.0:1780996969.406933:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780996969.894445:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126814464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780996969.894524:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996969.894574:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780996969.894581:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126814592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780996969.894608:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996969.894641:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126814592 00000100:00100000:0.0:1780996969.894648:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126814592 00000100:00100000:2.0:1780996969.894692:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126814464 00000100:00100000:0.0:1780996969.894695:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:0.0:1780996969.894704:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126814592:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780996969.894709:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126814464 00002000:00000024:0.0:1780996969.894738:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996969.894747:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:2.0:1780996969.894756:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126814464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780996969.894793:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:0.0:1780996969.894800:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126814592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996969.894808:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00100000:2.0:1780996969.894840:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126814464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996969.894847:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00000100:00100000:0.0:1780996969.894860:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126814592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780996969.894877:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126814464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780996969.895013:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780996969.895024:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126814720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780996969.895052:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996969.895099:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126814720 00000100:00100000:2.0:1780996969.895104:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126814720 00000100:00100000:2.0:1780996969.895138:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:2.0:1780996969.895146:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126814720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780996969.895163:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996969.895218:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126814720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996969.895225:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:3.0:1780996969.895345:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126814720:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1780996970.214426:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1780996970.415862:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000001:00080000:0.0:1780996970.415880:0:9294:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969449 is committed 00000001:00100000:1.0:1780996970.424971:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000001:00080000:1.0:1780996970.424988:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969449 is committed 00010000:00010000:2.0:1780996971.249185:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1780996971.434816:0:81952:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000100:00100000:2.0:1780996971.941516:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780996971.941537:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126814848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780996971.941603:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996971.941609:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126814976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780996971.941652:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996971.950974:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126814848 00000100:00100000:2.0:1780996971.950992:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126814848 00000100:00100000:2.0:1780996971.951086:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126814976 00000100:00100000:2.0:1780996971.951090:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126814976 00000100:00100000:2.0:1780996971.951112:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942 00000100:00100000:2.0:1780996971.951127:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126814848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780996971.951164:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996971.951254:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126814848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (9651us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996971.951262:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942 00000100:00100000:2.0:1780996971.951296:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:2.0:1780996971.951303:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126814976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780996971.951319:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996971.951355:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126814976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (9703us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996971.951362:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:2.0:1780996971.951416:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126814976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780996971.951464:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126814848:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780996971.951651:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780996971.951656:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1780996972.264206:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1780996973.143820:0:82000:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1780996973.288384:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996974.309705:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996974.341649:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996974.341696:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996974.341735:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996974.341897:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996974.341930:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996974.341969:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110331904 00000100:00100000:3.0:1780996974.341979:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110331904 00000100:00100000:3.0:1780996974.342034:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110332032 00000100:00100000:3.0:1780996974.342037:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110332032 00000100:00100000:3.0:1780996974.342061:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1081 00000100:00100000:3.0:1780996974.342084:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110331904:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996974.342169:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110331904:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 88us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996974.342178:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1081 00000100:00100000:3.0:1780996974.342195:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1082 00000100:00100000:3.0:1780996974.342201:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110332032:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996974.342226:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110332032:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996974.342232:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1082 00000100:00080000:3.0:1780996974.342408:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780996974.342412:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780996974.343707:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110332160 00000100:00100000:1.0:1780996974.343716:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110332160 00000100:00100000:1.0:1780996974.343782:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110332288 00000100:00100000:1.0:1780996974.343785:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110332288 00000100:00100000:1.0:1780996974.343809:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2436 00000100:00100000:1.0:1780996974.343817:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110332160:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996974.343870:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110332160:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 55us (2173us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996974.343878:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2436 00000100:00100000:1.0:1780996974.343905:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2437 00000100:00100000:1.0:1780996974.343911:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110332288:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996974.343934:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110332288:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 23us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996974.343950:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2437 00000100:00100000:0.0:1780996974.345152:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110331776 00000100:00100000:0.0:1780996974.345161:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110331776 00000100:00100000:0.0:1780996974.345306:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:0.0:1780996974.345316:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110331776:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996974.345386:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110331776:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 72us (3650us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996974.345392:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00080000:1.0:1780996974.345644:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780996974.345650:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996974.501666:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780996974.501688:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126815104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780996974.501776:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996974.501818:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126815488:0@lo:400:kworker.0 00000100:00100000:1.0:1780996974.501853:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996974.501869:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126815616:0@lo:400:kworker.0 00000100:00100000:1.0:1780996974.501880:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126816000:0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.501907:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996974.501919:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996974.501932:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126816128:0@lo:400:kworker.0 00000100:00100000:1.0:1780996974.501946:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126816512:0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.501960:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996974.501982:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996974.501998:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126816640:0@lo:400:kworker.0 00000100:00100000:1.0:1780996974.502020:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126816000 00000100:00100000:1.0:1780996974.502027:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126816000 00000100:00100000:0.0:1780996974.502027:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996974.502062:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126815488 00000100:00100000:0.0:1780996974.502068:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126815488 00000100:00100000:1.0:1780996974.502085:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126816128 00000100:00100000:1.0:1780996974.502090:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126816128 00000100:00100000:0.0:1780996974.502116:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126815616 00000100:00100000:1.0:1780996974.502118:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126816512 00000100:00100000:0.0:1780996974.502121:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126815616 00000100:00100000:1.0:1780996974.502123:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126816512 00000100:00100000:0.0:1780996974.502156:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126816640 00000100:00100000:1.0:1780996974.502157:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438 00000100:00100000:0.0:1780996974.502162:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126816640 00000100:00100000:1.0:1780996974.502169:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126816000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.502188:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1780996974.502197:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126815488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996974.502226:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126816000:12345-0@lo:400:kworker.0 Request processed in 58us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996974.502234:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438 00000100:00100000:0.0:1780996974.502240:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126815488:12345-0@lo:400:kworker.0 Request processed in 43us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996974.502248:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1780996974.502255:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439 00000100:00100000:1.0:1780996974.502266:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126816128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.502299:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1780996974.502325:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126816128:12345-0@lo:400:kworker.0 Request processed in 62us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996974.502343:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439 00000100:00100000:1.0:1780996974.502355:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440 00000100:00100000:1.0:1780996974.502360:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126816512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.502478:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126815616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.502519:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126815616:12345-0@lo:400:kworker.0 Request processed in 212us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996974.502528:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126816512:12345-0@lo:400:kworker.0 Request processed in 166us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996974.502542:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1780996974.502544:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440 00000100:00100000:0.0:1780996974.502565:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00080000:1.0:1780996974.502570:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780996974.502575:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126816640:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1780996974.502577:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780996974.502581:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780996974.502584:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996974.502606:0:3498:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:1.0:1780996974.502622:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126816512:0@lo:400:kworker.0 00000100:00100000:3.0:1780996974.502678:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126815360:0@lo:400:kworker.0 00000100:00100000:2.0:1780996974.502705:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126815232:0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.505646:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126816640:12345-0@lo:400:kworker.0 Request processed in 3066us (3611us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996974.505661:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:0.0:1780996974.505767:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126815616:0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.505781:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126816128:0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.505791:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126816640:0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.505878:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126815104 00000100:00100000:0.0:1780996974.505884:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126815104 00000100:00100000:0.0:1780996974.505924:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:0.0:1780996974.505932:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126815104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780996974.505968:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780996974.506025:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126815104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (4250us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996974.506032:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000100:00100000:1.0:1780996974.506789:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126815488:0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.506969:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126816000:0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.506987:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126815104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780996974.508452:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996974.508543:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126815872:0@lo:400:kworker.0 00000100:00100000:3.0:1780996974.508577:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996974.508613:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126816384:0@lo:400:kworker.0 00000100:00100000:3.0:1780996974.508637:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996974.508667:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126816384 00000100:00100000:3.0:1780996974.508673:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126816384 00000100:00100000:3.0:1780996974.508736:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2441 00000100:00100000:3.0:1780996974.508755:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126816384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996974.508802:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126816384:12345-0@lo:400:kworker.0 Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996974.508809:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2441 00000100:00080000:3.0:1780996974.508832:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780996974.508853:0:3497:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:3.0:1780996974.508866:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126816384:0@lo:400:kworker.0 00000100:00100000:1.0:1780996974.509558:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126815872 00000100:00100000:1.0:1780996974.509564:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126815872 00000100:00100000:1.0:1780996974.509600:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:1.0:1780996974.509607:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126815872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996974.509650:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126815872:12345-0@lo:400:kworker.0 Request processed in 44us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996974.509656:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 00000100:00100000:2.0:1780996974.510042:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996974.510238:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126815744:0@lo:400:kworker.0 00000100:00100000:2.0:1780996974.510286:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996974.510357:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126815232 00000100:00100000:1.0:1780996974.510363:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126815232 00000100:00100000:3.0:1780996974.511113:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126815872:0@lo:400:kworker.0 00000100:00100000:1.0:1780996974.511679:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1780996974.511688:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126815232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996974.511754:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126815232:12345-0@lo:400:kworker.0 Request processed in 67us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996974.511773:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1780996974.515345:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126816256:0@lo:400:kworker.0 00000100:00100000:2.0:1780996974.515419:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996974.518996:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126815360 00000100:00100000:0.0:1780996974.519010:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126815360 00000100:00080000:1.0:1780996974.519266:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780996974.519491:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126815744 00000100:00100000:0.0:1780996974.519496:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126815744 00000100:00100000:0.0:1780996974.519539:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:0.0:1780996974.519563:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126815360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.519669:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126815360:12345-0@lo:400:kworker.0 Request processed in 108us (11221us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996974.519676:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:0.0:1780996974.519694:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1780996974.519701:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126815744:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1780996974.519801:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780996974.519871:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126815360:0@lo:400:kworker.0 00000100:00100000:0.0:1780996974.520235:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126815744:12345-0@lo:400:kworker.0 Request processed in 535us (9964us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996974.520243:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1780996974.520636:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126815232:0@lo:400:kworker.0 00000100:00100000:2.0:1780996974.520649:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126815744:0@lo:400:kworker.0 00000100:00100000:3.0:1780996974.520731:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126816256 00000100:00100000:3.0:1780996974.520737:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126816256 00000100:00100000:3.0:1780996974.520789:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1780996974.520796:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126816256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996974.520881:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126816256:12345-0@lo:400:kworker.0 Request processed in 84us (5461us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996974.520888:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1780996974.523167:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126816256:0@lo:400:kworker.0 00000100:00100000:2.0:1780996975.014418:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126816768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780996975.014498:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996975.014615:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126816768 00000100:00100000:1.0:1780996975.014623:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126816768 00000100:00100000:1.0:1780996975.014677:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00000100:00100000:1.0:1780996975.014686:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126816768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780996975.014731:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:1.0:1780996975.014793:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126816768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996975.014800:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00000100:00100000:1.0:1780996975.014852:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126816768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780996975.015600:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780996975.015612:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126817024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780996975.015651:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996975.015690:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126816896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780996975.015724:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996975.015852:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126817024 00000100:00100000:2.0:1780996975.015858:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126817024 00000100:00100000:2.0:1780996975.015907:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126816896 00000100:00100000:2.0:1780996975.015911:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126816896 00000100:00100000:2.0:1780996975.015927:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:2.0:1780996975.015947:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126817024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780996975.015971:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996975.016011:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126817024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996975.016017:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:2.0:1780996975.016031:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:2.0:1780996975.016037:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126816896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780996975.016066:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996975.016095:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126816896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996975.016101:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:0.0:1780996975.016325:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126817024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780996975.016354:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126816896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1780996975.336264:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996975.360511:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996975.360612:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110332416 00000100:00100000:1.0:1780996975.360623:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110332416 00000100:00100000:1.0:1780996975.360687:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1085 00000100:00100000:1.0:1780996975.360697:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65070:x1867507110332416:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:1.0:1780996975.360729:0:65272:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:1.0:1780996975.360818:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65070:x1867507110332416:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 122us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996975.360825:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1085 00000100:00100000:3.0:1780996975.362844:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996975.363023:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110332544 00000100:00100000:0.0:1780996975.363034:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110332544 00000100:00100000:0.0:1780996975.363095:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1086 00000100:00100000:0.0:1780996975.363105:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:65070:x1867507110332544:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:0.0:1780996975.363142:0:63418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780996975.363226:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:65070:x1867507110332544:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 122us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996975.363233:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1086 00000100:00100000:3.0:1780996975.365352:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996975.365879:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110332672 00000100:00100000:2.0:1780996975.365895:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110332672 00000100:00100000:2.0:1780996975.365952:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1946 00000100:00100000:2.0:1780996975.365961:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:65070:x1867507110332672:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1780996975.365984:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996975.366048:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:65070:x1867507110332672:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 88us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996975.366055:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1946 00000100:00100000:1.0:1780996975.368907:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996975.369374:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110332800 00000100:00100000:3.0:1780996975.369384:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110332800 00000100:00100000:3.0:1780996975.369436:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1947 00000100:00100000:3.0:1780996975.369445:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:65070:x1867507110332800:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:3.0:1780996975.369468:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996975.369526:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:65070:x1867507110332800:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 82us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996975.369533:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1947 00000100:00100000:3.0:1780996975.405582:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996975.405795:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110333056 00000100:00100000:1.0:1780996975.405805:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110333056 00000100:00100000:1.0:1780996975.405868:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1087 00000100:00100000:1.0:1780996975.405878:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65086:x1867507110333056:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780996975.405922:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996975.405945:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c03059888 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8aab expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406028:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305988f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406051:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305988f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406062:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305988f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406075:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059896 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406081:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406098:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406172:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305988f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406179:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305988f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406185:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305988f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406191:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305988f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406204:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780996975.406208:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305988f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406215:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305988f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406227:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3b00) 00010000:00010000:1.0:1780996975.406230:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780996975.406234:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305988f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406240:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305988f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406253:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406259:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059896 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406265:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059896 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406319:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780996975.406322:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059896 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406327:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059896 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406345:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff96888760f800) 00010000:00010000:1.0:1780996975.406347:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780996975.406350:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059896 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406355:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059896 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406385:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c03059888 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aab expref: 8 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406395:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3b00) 00010000:00010000:1.0:1780996975.406398:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780996975.406401:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c03059888 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aab expref: 8 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996975.406411:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0400, rc 0) 00000100:00100000:1.0:1780996975.406469:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65086:x1867507110333056:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 593us (897us total) trans 0 rc 301/301 00000100:00100000:1.0:1780996975.406477:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1087 00000100:00100000:1.0:1780996975.413120:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996975.413314:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110333184 00000100:00100000:0.0:1780996975.413324:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110333184 00000100:00100000:0.0:1780996975.413370:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1088 00000100:00100000:0.0:1780996975.413379:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65086:x1867507110333184:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1780996975.413441:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305989d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413456:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305989d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413466:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305989d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413482:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413488:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413494:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413557:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c030598ab lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413565:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c030598ab lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413571:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c030598ab lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780996975.413606:0:63584:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780996975.413630:0:63584:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c030598ab lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413643:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305989d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413650:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305989d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413657:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305989d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413676:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305989d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413682:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780996975.413686:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305989d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413694:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305989d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413705:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3b00) 00010000:00010000:0.0:1780996975.413708:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780996975.413712:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305989d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413719:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305989d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413742:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413748:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413759:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413765:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780996975.413768:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413774:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413781:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9689896fe200) 00010000:00010000:0.0:1780996975.413783:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780996975.413785:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413791:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413805:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c030598ab lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413811:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c030598ab lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413817:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c030598ab lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413822:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780996975.413824:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c030598ab lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413838:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c030598ab lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413844:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9689896fe400) 00010000:00010000:0.0:1780996975.413846:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780996975.413849:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c030598ab lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996975.413854:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c030598ab lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996975.413924:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65086:x1867507110333184:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 545us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996975.413931:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1088 00010000:00010000:3.0:1780996976.357573:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996977.061736:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780996977.061761:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126817152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780996977.061826:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996977.062022:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780996977.062032:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126817280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780996977.062065:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996977.062113:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126817152 00000100:00100000:0.0:1780996977.062122:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126817152 00000100:00100000:0.0:1780996977.062183:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126817280 00000100:00100000:0.0:1780996977.062187:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126817280 00000100:00100000:0.0:1780996977.062203:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:0.0:1780996977.062213:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126817152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780996977.062242:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780996977.062316:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126817152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996977.062324:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:2.0:1780996977.062369:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:2.0:1780996977.062380:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126817280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780996977.062398:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996977.062435:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126817280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996977.062441:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:3.0:1780996977.062528:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126817152:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1780996977.062565:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780996977.062569:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996977.062586:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126817280:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1780996977.387152:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996978.406026:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996979.434306:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996979.461569:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996979.461619:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996979.461662:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996979.461824:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110333312 00000100:00100000:3.0:1780996979.461834:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110333312 00000100:00100000:3.0:1780996979.461906:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:3.0:1780996979.461917:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110333312:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996979.461985:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110333312:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 70us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996979.461992:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:0.0:1780996979.462321:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110333568 00000100:00100000:0.0:1780996979.462326:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110333568 00000100:00100000:0.0:1780996979.462376:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1089 00000100:00100000:0.0:1780996979.462383:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110333568:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996979.462434:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110333568:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 51us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996979.462441:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1089 00000100:00100000:1.0:1780996979.462789:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110333824 00000100:00100000:1.0:1780996979.462795:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110333824 00000100:00100000:1.0:1780996979.462838:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2442 00000100:00100000:1.0:1780996979.462846:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110333824:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996979.462987:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110333824:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 141us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996979.462994:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2442 00000100:00100000:1.0:1780996979.463042:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996979.463082:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996979.463105:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110333696 00000100:00100000:1.0:1780996979.463109:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110333696 00000100:00100000:1.0:1780996979.463132:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2443 00000100:00100000:1.0:1780996979.463138:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110333696:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996979.463167:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110333696:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996979.463172:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2443 00000100:00100000:2.0:1780996979.463291:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110333440 00000100:00100000:2.0:1780996979.463295:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110333440 00000100:00100000:2.0:1780996979.463338:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1090 00000100:00100000:2.0:1780996979.463345:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110333440:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780996979.463376:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110333440:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996979.463383:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1090 00000100:00080000:3.0:1780996979.463539:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780996979.463544:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780996979.463546:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780996979.463548:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996979.621547:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780996979.622496:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126817536:0@lo:400:kworker.0 00000100:00100000:0.0:1780996979.622563:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996979.622606:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780996979.622611:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126817664:0@lo:400:kworker.0 00000100:00100000:0.0:1780996979.622635:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996979.622682:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126817536 00000100:00100000:0.0:1780996979.622689:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126817536 00000100:00100000:0.0:1780996979.622735:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1780996979.622743:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126817536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996979.622788:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126817536:12345-0@lo:400:kworker.0 Request processed in 46us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996979.622795:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1780996979.622822:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126817664 00000100:00100000:0.0:1780996979.622825:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126817664 00000100:00100000:0.0:1780996979.622869:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1780996979.622875:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507126817664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996979.622903:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507126817664:12345-0@lo:400:kworker.0 Request processed in 28us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996979.622909:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1780996979.622938:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126817664:0@lo:400:kworker.0 00000100:00100000:0.0:1780996979.622946:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126817536:0@lo:400:kworker.0 00000100:00080000:2.0:1780996979.623049:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780996979.627040:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126817792:0@lo:400:kworker.0 00000100:00100000:3.0:1780996979.627116:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996979.627167:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126817408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780996979.627197:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996979.627404:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126817408 00000100:00100000:2.0:1780996979.627414:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126817408 00000100:00100000:2.0:1780996979.627476:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:2.0:1780996979.627496:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126817408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780996979.627536:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1780996979.627588:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126817408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996979.627596:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00000100:00100000:0.0:1780996979.631625:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126817792 00000100:00100000:0.0:1780996979.631664:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126817792 00000100:00100000:0.0:1780996979.631764:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1780996979.631775:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126817792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996979.631873:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126817792:12345-0@lo:400:kworker.0 Request processed in 99us (4756us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996979.631880:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00080000:2.0:1780996979.631975:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996979.632210:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126817792:0@lo:400:kworker.0 00000100:00100000:3.0:1780996979.632228:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126817408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780996979.633466:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126817920:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.633523:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996979.633560:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126818432:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.633585:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996979.633604:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507126818944:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.633625:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996979.633655:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1780996979.633661:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126818304:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.633694:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996979.633719:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126818816:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.633753:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996979.633781:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126818432 00000100:00100000:2.0:1780996979.633787:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126818432 00000100:00100000:2.0:1780996979.633846:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126818304 00000100:00100000:2.0:1780996979.633849:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126818304 00000100:00100000:2.0:1780996979.633870:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126818816 00000100:00100000:2.0:1780996979.633872:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126818816 00000100:00100000:2.0:1780996979.633892:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:2.0:1780996979.633900:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126818432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.633946:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126818432:12345-0@lo:400:kworker.0 Request processed in 47us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996979.633953:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00000100:00100000:2.0:1780996979.633966:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445 00000100:00100000:2.0:1780996979.633971:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126818304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.633999:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126818304:12345-0@lo:400:kworker.0 Request processed in 28us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996979.634017:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445 00000100:00100000:2.0:1780996979.634029:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446 00000100:00100000:2.0:1780996979.634035:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126818816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634059:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126818816:12345-0@lo:400:kworker.0 Request processed in 25us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996979.634064:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446 00000100:00100000:2.0:1780996979.634082:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126817920 00000100:00100000:2.0:1780996979.634085:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126817920 00000100:00100000:2.0:1780996979.634111:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126818944 00000100:00100000:2.0:1780996979.634113:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126818944 00000100:00100000:2.0:1780996979.634127:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:2.0:1780996979.634133:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126817920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634169:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126817920:12345-0@lo:400:kworker.0 Request processed in 36us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996979.634176:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:2.0:1780996979.634187:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:2.0:1780996979.634192:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507126818944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634214:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507126818944:12345-0@lo:400:kworker.0 Request processed in 23us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996979.634219:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:2.0:1780996979.634238:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126818176:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634322:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996979.634341:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126818688:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634362:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996979.634382:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1780996979.634387:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126818048:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634407:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996979.634424:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126818560:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634444:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996979.634468:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126818688 00000100:00100000:2.0:1780996979.634472:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126818688 00000100:00100000:2.0:1780996979.634495:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2447 00000100:00100000:2.0:1780996979.634501:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126818688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634533:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126818688:12345-0@lo:400:kworker.0 Request processed in 32us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996979.634538:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2447 00000100:00100000:2.0:1780996979.634553:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126818048 00000100:00100000:2.0:1780996979.634562:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126818048 00000100:00100000:2.0:1780996979.634586:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126818560 00000100:00100000:2.0:1780996979.634589:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126818560 00000100:00100000:2.0:1780996979.634604:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1780996979.634609:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126818048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634639:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126818048:12345-0@lo:400:kworker.0 Request processed in 29us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996979.634644:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1780996979.634656:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1780996979.634662:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126818560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634691:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126818560:12345-0@lo:400:kworker.0 Request processed in 29us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996979.634696:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00080000:2.0:1780996979.634723:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780996979.634727:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780996979.634729:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780996979.634731:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780996979.634776:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126818048:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634786:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126818560:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634794:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126818688:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634825:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126818304:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634835:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126818816:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634844:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126817920:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634854:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126818432:0@lo:400:kworker.0 00000100:00100000:2.0:1780996979.634876:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507126818944:0@lo:400:kworker.0 00000100:00100000:1.0:1780996979.638143:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126818176 00000100:00100000:1.0:1780996979.638158:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126818176 00000100:00100000:1.0:1780996979.638227:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:1.0:1780996979.638237:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126818176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996979.638378:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126818176:12345-0@lo:400:kworker.0 Request processed in 144us (4110us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996979.638386:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00000100:00100000:3.0:1780996979.639002:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126818176:0@lo:400:kworker.0 00000100:00100000:0.0:1780996979.997411:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996979.997448:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996979.997468:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996979.997508:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996979.997540:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110333952 00000100:00100000:0.0:1780996979.997549:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110333952 00000100:00100000:0.0:1780996979.997595:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110334336 00000100:00100000:0.0:1780996979.997598:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110334336 00000100:00100000:0.0:1780996979.997621:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1089 00000100:00100000:0.0:1780996979.997630:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110333952:12345-192.168.206.51@tcp:17:kworker.0 00000100:00100000:0.0:1780996979.997729:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110333952:12345-192.168.206.51@tcp:17:kworker.0 Request processed in 100us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996979.997736:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1089 00000100:00100000:0.0:1780996979.997754:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1090 00000100:00100000:0.0:1780996979.997760:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2396:x1867507110334336:12345-192.168.206.51@tcp:17:kworker.0 00000100:00100000:0.0:1780996979.997794:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2396:x1867507110334336:12345-192.168.206.51@tcp:17:kworker.0 Request processed in 34us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996979.997801:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1090 00000100:00100000:0.0:1780996979.997819:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110334080 00000100:00100000:0.0:1780996979.997823:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110334080 00000100:00100000:0.0:1780996979.997857:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110334208 00000100:00100000:0.0:1780996979.997869:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110334208 00000100:00100000:0.0:1780996979.997894:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5909 00000100:00100000:0.0:1780996979.997899:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110334080:12345-192.168.206.51@tcp:17:kworker.0 00000100:00100000:0.0:1780996979.997942:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110334080:12345-192.168.206.51@tcp:17:kworker.0 Request processed in 43us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996979.997948:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5909 00000100:00100000:0.0:1780996979.997960:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5910 00000100:00100000:0.0:1780996979.997966:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110334208:12345-192.168.206.51@tcp:17:kworker.0 00000100:00100000:0.0:1780996979.997999:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110334208:12345-192.168.206.51@tcp:17:kworker.0 Request processed in 33us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996979.998004:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5910 00000100:00100000:3.0:1780996980.135388:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126819072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780996980.135460:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996980.135527:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126819072 00000100:00100000:3.0:1780996980.135535:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126819072 00000100:00100000:3.0:1780996980.135580:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:3.0:1780996980.135587:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126819072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780996980.135606:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996980.135656:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126819072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996980.135663:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:3.0:1780996980.135716:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126819072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780996980.136046:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780996980.136054:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126819200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780996980.136097:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996980.136126:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126819200 00000100:00100000:3.0:1780996980.136130:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126819200 00000100:00100000:3.0:1780996980.136158:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:3.0:1780996980.136164:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126819200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780996980.136189:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445269504 avail 1299030016 00000100:00100000:3.0:1780996980.136224:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126819200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996980.136230:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000100:00100000:3.0:1780996980.136260:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126819200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780996980.139117:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126819328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780996980.139181:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996980.141372:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126819328 00000100:00100000:1.0:1780996980.141384:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126819328 00000100:00100000:1.0:1780996980.141477:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:1.0:1780996980.141486:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126819328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780996980.141508:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996980.141595:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126819328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (2413us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996980.141602:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:2.0:1780996980.141666:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126819328:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1780996980.455582:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996981.477501:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780996982.181535:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780996982.181558:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126819456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780996982.181646:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996982.181788:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126819456 00000100:00100000:3.0:1780996982.181796:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126819456 00000100:00100000:3.0:1780996982.181861:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:3.0:1780996982.181872:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126819456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780996982.181899:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996982.181948:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126819456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996982.181956:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:3.0:1780996982.182014:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126819456:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1780996982.182134:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780996982.182466:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126819584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780996982.182495:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996982.183037:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126819584 00000100:00100000:2.0:1780996982.183043:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126819584 00000100:00100000:2.0:1780996982.183093:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00100000:2.0:1780996982.183101:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126819584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780996982.183122:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996982.183164:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126819584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996982.183170:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00080000:0.0:1780996982.183661:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780996982.183706:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126819584:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780996982.501676:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1780996982.767049:0:82197:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 05:23:01 (1780996981) 00000100:00100000:3.0:1780996982.844036:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996982.844238:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110334464 00000100:00100000:2.0:1780996982.844249:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110334464 00000100:00100000:2.0:1780996982.844420:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1091 00000100:00100000:2.0:1780996982.844431:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65668:x1867507110334464:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780996982.844455:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780996982.844478:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c030598b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ab2 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844542:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030598b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844557:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030598b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844568:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030598b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844595:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c030598c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844603:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c030598c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844610:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c030598c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1780996982.844809:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1780996982.844880:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030598b9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844889:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030598b9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844895:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030598b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844901:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030598b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844907:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780996982.844911:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030598b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844918:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030598b9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844930:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3b00) 00010000:00010000:2.0:1780996982.844933:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780996982.844937:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030598b9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844950:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030598b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844963:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c030598c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844969:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c030598c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844974:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c030598c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844979:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780996982.844982:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c030598c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844988:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c030598c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.844996:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff96898962cc00) 00010000:00010000:2.0:1780996982.844999:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780996982.845001:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c030598c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.845007:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c030598c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.845037:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c030598b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ab2 expref: 8 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.845058:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3b00) 00010000:00010000:2.0:1780996982.845060:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780996982.845064:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c030598b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ab2 expref: 8 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996982.845073:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455800, rc 0) 00000100:00100000:2.0:1780996982.845139:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65668:x1867507110334464:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 710us (1114us total) trans 0 rc 301/301 00000100:00100000:2.0:1780996982.845146:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1091 00000100:00100000:1.0:1780996982.853139:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996982.853208:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110334720 00000100:00100000:0.0:1780996982.853219:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110334720 00000100:00100000:0.0:1780996982.853314:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1092 00000100:00100000:0.0:1780996982.853325:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65668:x1867507110334720:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:0.0:1780996982.853576:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780996982.853602:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c03059873 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aa4 expref: 7 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.854214:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3b00) 00010000:00010000:0.0:1780996982.856957:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780996982.857223:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c030598c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.857243:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c030598c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.857255:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c030598c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.857294:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c030598ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.857303:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c030598ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.857310:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c030598ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860371:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598d5 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860394:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598d5 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860406:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598d5 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780996982.860433:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003da93a55 reply state 000000003cefeb4e transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598d5 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860458:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598d5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860467:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff96898d864f00) 00010000:00010000:0.0:1780996982.860470:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780996982.860476:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1780996982.860483:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1780996982.860492:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c030598c7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860499:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c030598c7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860506:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c030598c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860513:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c030598c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860520:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780996982.860525:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c030598c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860533:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c030598c7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860544:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864400) 00010000:00010000:0.0:1780996982.860547:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780996982.860557:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c030598c7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860563:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c030598c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780996982.860585:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003da93a55 reply state 000000003cefeb4e transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c030598ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860593:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c030598ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.860600:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff96898d864900) 00010000:00010000:0.0:1780996982.860602:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780996982.860604:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1780996982.861796:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:65668:x1867507110334720:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 8467us (8659us total) trans 98784247809 rc 0/0 00000100:00100000:0.0:1780996982.861808:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1092 00000100:00100000:0.0:1780996982.883867:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996982.886127:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110334848 00000100:00100000:3.0:1780996982.886144:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110334848 00000100:00100000:3.0:1780996982.886219:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1093 00000100:00100000:3.0:1780996982.886247:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:65671:x1867507110334848:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1780996982.886303:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780996982.886333:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c030598dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ab9 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.886398:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c030598e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.886413:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c030598e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.886425:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c030598e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780996982.886480:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1780996982.886484:0:63584:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780996982.886500:0:63584:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c030598e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.886521:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c030598dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ab9 expref: 10 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.886538:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c030598e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ab9 expref: 9 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.886547:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689964dc500) 00010000:00010000:3.0:1780996982.886550:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780996982.886553:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2e00, rc 0) 00000100:00100000:3.0:1780996982.886629:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:65671:x1867507110334848:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 375us (2761us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996982.886646:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1093 00000100:00100000:1.0:1780996982.894106:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996982.894188:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110334976 00000100:00100000:3.0:1780996982.894199:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110334976 00000100:00100000:3.0:1780996982.894265:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1094 00000100:00100000:3.0:1780996982.894294:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:65671:x1867507110334976:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1780996982.894317:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780996982.894339:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2c00/0x30fd811c030598ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ac0 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894417:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c030598f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894432:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c030598f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894444:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c030598f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894455:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c030598f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894462:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c030598f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894469:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c030598f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894544:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c030598ff lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894569:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c030598ff lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894577:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c030598ff lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780996982.894629:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1780996982.894634:0:63418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780996982.894653:0:63418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c030598ff lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894664:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c030598f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894671:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c030598f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894677:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c030598f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894684:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c030598f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894699:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996982.894704:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c030598f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894711:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c030598f1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894723:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689964dc500) 00010000:00010000:3.0:1780996982.894732:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996982.894738:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c030598f1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894745:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c030598f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894760:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c030598f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894766:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c030598f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894771:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c030598f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894776:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996982.894778:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c030598f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894784:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c030598f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894792:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff96898d864900) 00010000:00010000:3.0:1780996982.894794:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996982.894797:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c030598f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894803:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c030598f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894829:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2c00/0x30fd811c030598ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ac0 expref: 11 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894854:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c030598ff lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ac0 expref: 10 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.894861:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff96898d864f00) 00010000:00010000:3.0:1780996982.894863:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780996982.894865:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9200, rc 0) 00000100:00100000:3.0:1780996982.894927:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:65671:x1867507110334976:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 636us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996982.894935:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1094 00000100:00100000:3.0:1780996982.897649:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996982.901255:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110335232 00000100:00100000:1.0:1780996982.901458:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110335232 00000100:00100000:0.0:1780996982.904634:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1095 00000100:00100000:0.0:1780996982.904650:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:65671:x1867507110335232:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1780996982.904670:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780996982.904897:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c03059906 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ac7 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780996982.905004:0:65272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1780996982.905113:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c03059906 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ac7 expref: 12 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.905129:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689964dc500) 00010000:00010000:0.0:1780996982.905139:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780996982.905145:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c03059906 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ac7 expref: 12 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996982.905158:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02a00, rc 0) 00000100:00100000:0.0:1780996982.905227:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:65671:x1867507110335232:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 582us (7586us total) trans 98784247810 rc 301/301 00000100:00100000:0.0:1780996982.905234:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1095 00000100:00100000:1.0:1780996982.917374:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996982.917480:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110335488 00000100:00100000:3.0:1780996982.917495:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110335488 00000100:00100000:3.0:1780996982.917573:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1096 00000100:00100000:3.0:1780996982.917587:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:65671:x1867507110335488:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:3.0:1780996982.917675:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780996982.917721:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c030598ff lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ac0 expref: 11 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.917742:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff96898d864f00) 00010000:00010000:3.0:1780996982.917747:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780996982.917768:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059914 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.917782:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059914 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.917792:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059914 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780996982.917982:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001743ae96 reply state 000000006ef11553 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059914 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.917997:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059914 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996982.918003:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff96898d864f00) 00010000:00010000:3.0:1780996982.918006:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1780996982.918008:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1780996982.918017:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000100:00100000:3.0:1780996982.918179:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:65671:x1867507110335488:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 596us (813us total) trans 98784247811 rc 0/0 00000100:00100000:3.0:1780996982.918187:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1096 00000100:00100000:1.0:1780996982.925118:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996982.925199:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110335744 00000100:00100000:2.0:1780996982.925210:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110335744 00000100:00100000:2.0:1780996982.925300:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 216 00000100:00100000:2.0:1780996982.925311:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889fe7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:65671:x1867507110335744:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1780996982.925523:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889fe7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:65671:x1867507110335744:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 215us (412us total) trans 98784247812 rc 0/0 00000100:00100000:2.0:1780996982.925531:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 216 00010000:00010000:2.0:1780996983.526648:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1780996983.789117:0:81482:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247812 is committed 00010000:00010000:3.0:1780996983.789211:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c030598ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789225:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c030598ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789234:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c030598ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789240:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996983.789246:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c030598ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789254:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c030598ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789300:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff96898d864900) 00010000:00010000:3.0:1780996983.789316:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996983.789321:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c030598ce lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789337:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c030598ce lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789363:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598d5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789370:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598d5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789376:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598d5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789380:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996983.789384:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598d5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789390:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598d5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789398:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff96898d864f00) 00010000:00010000:3.0:1780996983.789401:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996983.789404:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598d5 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789410:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c030598d5 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789424:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059914 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789441:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059914 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789447:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059914 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789452:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996983.789455:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059914 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789461:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059914 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789470:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff96898d864f00) 00010000:00010000:3.0:1780996983.789472:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780996983.789475:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059914 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996983.789480:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059914 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780996983.850407:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996983.851609:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110335872 00000100:00100000:3.0:1780996983.853569:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110335872 00000100:00100000:3.0:1780996983.853644:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1097 00000100:00100000:3.0:1780996983.853656:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65686:x1867507110335872:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:3.0:1780996983.853709:0:63418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445265408 avail 1299025920 00000100:00100000:3.0:1780996983.853865:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65686:x1867507110335872:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 211us (3467us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996983.853875:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1097 00000100:00100000:0.0:1780996983.858998:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996983.859445:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110336000 00000100:00100000:3.0:1780996983.859456:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110336000 00000100:00100000:3.0:1780996983.859526:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1098 00000100:00100000:3.0:1780996983.859538:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:65686:x1867507110336000:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:3.0:1780996983.859579:0:63417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1780996983.859651:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:65686:x1867507110336000:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 115us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996983.859658:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1098 00000100:00080000:0.0:1780996983.859720:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996983.865142:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996983.865226:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110336128 00000100:00100000:0.0:1780996983.865237:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110336128 00000100:00100000:0.0:1780996983.865325:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1954 00000100:00100000:0.0:1780996983.865334:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:65686:x1867507110336128:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1780996983.865365:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780996983.865424:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:65686:x1867507110336128:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 91us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996983.865431:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1954 00000100:00080000:3.0:1780996983.865636:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780996983.883941:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996983.884259:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110336256 00000100:00100000:0.0:1780996983.884299:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110336256 00000100:00100000:0.0:1780996983.884373:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1955 00000100:00100000:0.0:1780996983.884384:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:65686:x1867507110336256:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1780996983.884420:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780996983.884489:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:65686:x1867507110336256:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 107us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996983.884497:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1955 00000100:00080000:3.0:1780996983.884744:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780996984.003642:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996984.003740:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110336512 00000100:00100000:2.0:1780996984.003750:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110336512 00000100:00100000:2.0:1780996984.003824:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1099 00000100:00100000:2.0:1780996984.003835:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65693:x1867507110336512:12345-192.168.206.51@tcp:36:mcreate.0 00010000:00010000:2.0:1780996984.003889:0:80049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780996984.003915:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c030598e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ab9 expref: 7 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.003946:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689964dc500) 00010000:00010000:2.0:1780996984.003957:0:80049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780996984.004013:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305991b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004027:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305991b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004036:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305991b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004046:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c03059922 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004053:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c03059922 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004059:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c03059922 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004444:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305991b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004452:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305991b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004459:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305991b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004465:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780996984.004469:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305991b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004482:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305991b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004491:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898962c800) 00010000:00010000:2.0:1780996984.004494:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780996984.004498:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305991b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004504:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305991b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780996984.004516:0:80049:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a9de64c1 reply state 000000002298b611 transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c03059922 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004526:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c03059922 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996984.004533:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898962c300) 00010000:00010000:2.0:1780996984.004535:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780996984.004537:0:80049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780996984.004607:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:65693:x1867507110336512:12345-192.168.206.51@tcp:36:mcreate.0 Request processed in 774us (973us total) trans 98784247813 rc 0/0 00000100:00100000:2.0:1780996984.004615:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1099 00000100:00080000:3.0:1780996984.005253:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780996984.040699:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996984.040976:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110336640 00000100:00100000:3.0:1780996984.040986:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110336640 00000100:00100000:3.0:1780996984.041050:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1100 00000100:00100000:3.0:1780996984.041062:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:65696:x1867507110336640:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:3.0:1780996984.041091:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780996984.041119:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059929 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ace expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.041203:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059930 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.041220:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.041246:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780996984.041503:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1780996984.041508:0:63418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780996984.041533:0:63418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.041557:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8c00/0x30fd811c03059929 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ace expref: 10 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.041574:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059930 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ace expref: 9 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.041582:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689964dca00) 00010000:00010000:3.0:1780996984.041585:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780996984.041589:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9a00, rc 0) 00000100:00100000:3.0:1780996984.041943:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:65696:x1867507110336640:12345-192.168.206.51@tcp:101:rm.0 Request processed in 882us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996984.041952:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1100 00000100:00100000:1.0:1780996984.054944:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996984.055210:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110336768 00000100:00100000:3.0:1780996984.055220:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110336768 00000100:00100000:3.0:1780996984.055431:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1101 00000100:00100000:3.0:1780996984.055443:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:65696:x1867507110336768:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:3.0:1780996984.055463:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780996984.055484:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c03059937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ad5 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.055549:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9000/0x30fd811c0305993e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.057996:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9000/0x30fd811c0305993e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058029:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9000/0x30fd811c0305993e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058054:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9e00/0x30fd811c03059945 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058065:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9e00/0x30fd811c03059945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058071:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9e00/0x30fd811c03059945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058168:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8200/0x30fd811c0305994c lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058176:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8200/0x30fd811c0305994c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058182:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8200/0x30fd811c0305994c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780996984.058233:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x4:0x0]: returning size 0 00000004:00200000:3.0:1780996984.058237:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780996984.058289:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8200/0x30fd811c0305994c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058302:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8200/0x30fd811c0305994c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058329:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9000/0x30fd811c0305993e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058345:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9000/0x30fd811c0305993e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058352:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9000/0x30fd811c0305993e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058358:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9000/0x30fd811c0305993e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058365:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996984.058369:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9000/0x30fd811c0305993e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058377:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9000/0x30fd811c0305993e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058389:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689964dca00) 00010000:00010000:3.0:1780996984.058392:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996984.058396:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9000/0x30fd811c0305993e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058402:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9000/0x30fd811c0305993e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058416:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9e00/0x30fd811c03059945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058423:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9e00/0x30fd811c03059945 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058436:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9e00/0x30fd811c03059945 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058441:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780996984.058444:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9e00/0x30fd811c03059945 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058451:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9e00/0x30fd811c03059945 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058459:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898962c300) 00010000:00010000:3.0:1780996984.058462:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780996984.058465:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9e00/0x30fd811c03059945 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058471:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9e00/0x30fd811c03059945 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058505:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c03059937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ad5 expref: 11 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058520:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8200/0x30fd811c0305994c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ad5 expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996984.058527:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9689964dc000) 00010000:00010000:3.0:1780996984.058530:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780996984.058532:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8200, rc 0) 00000100:00100000:3.0:1780996984.058608:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:65696:x1867507110336768:12345-192.168.206.51@tcp:101:rm.0 Request processed in 3166us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996984.058637:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1101 00000100:00100000:0.0:1780996984.073628:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780996984.075681:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110337024 00000100:00100000:0.0:1780996984.075713:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110337024 00000100:00100000:0.0:1780996984.075776:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1102 00000100:00100000:0.0:1780996984.075788:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:65696:x1867507110337024:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:0.0:1780996984.075857:0:80049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1780996984.075887:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8200/0x30fd811c0305994c lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ad5 expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.075905:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9689964dc000) 00010000:00010000:0.0:1780996984.075923:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059930 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ace expref: 9 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.075933:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689964dca00) 00010000:00010000:0.0:1780996984.075939:0:80049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780996984.075963:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059953 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.075976:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059953 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.075986:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059953 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.075997:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305995a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.076005:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305995a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.076591:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305995a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.076677:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c03059961 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.076697:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c03059961 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.076705:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c03059961 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.076903:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c03059968 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.076913:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c03059968 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.076922:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c03059968 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.076930:0:80049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c03059968 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.076937:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c03059968 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.076944:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c03059968 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.076968:0:80049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780996984.076990:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c03059961 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077001:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c03059961 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077009:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c03059961 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077087:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780996984.077092:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c03059961 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077100:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c03059961 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077112:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff96898d864400) 00010000:00010000:0.0:1780996984.077115:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1780996984.077119:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c03059961 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077124:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c03059961 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077143:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059953 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077149:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059953 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077154:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059953 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077158:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780996984.077166:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059953 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077171:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059953 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077179:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864300) 00010000:00010000:0.0:1780996984.077181:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780996984.077184:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059953 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077190:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02200/0x30fd811c03059953 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780996984.077204:0:80049:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009272c5a7 reply state 00000000a8cc86a4 transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305995a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077215:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305995a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.077221:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898962c300) 00010000:00010000:0.0:1780996984.077224:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780996984.077227:0:80049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780996984.077328:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:65696:x1867507110337024:12345-192.168.206.51@tcp:36:rm.0 Request processed in 1540us (3708us total) trans 98784247814 rc 0/0 00000100:00100000:0.0:1780996984.077338:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1102 00010000:00010000:0.0:1780996984.084960:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780996984.084975:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c03059968 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.084987:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780996984.084991:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c03059968 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.085007:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c03059968 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.085096:0:14480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff96898d864400) 00010000:00010000:0.0:1780996984.085100:0:14480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1780996984.085105:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c03059968 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.085111:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c03059968 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996984.085134:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996984.085136:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996984.085138:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996984.556148:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996984.583791:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996984.586453:0:81489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110337152 00000100:00100000:3.0:1780996984.586470:0:81489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110337152 00000100:00100000:3.0:1780996984.586533:0:81489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1780996984.586544:0:81489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+9:2396:x1867507110337152:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996984.586630:0:81489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+9:2396:x1867507110337152:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 87us (2847us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996984.586638:0:81489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1780996984.741764:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126819712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780996984.741844:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996984.742014:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126819712 00000100:00100000:0.0:1780996984.742023:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126819712 00000100:00100000:0.0:1780996984.742078:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:0.0:1780996984.742087:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126819712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780996984.742122:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780996984.742179:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126819712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996984.742185:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00000100:00100000:3.0:1780996984.742265:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126819712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780996984.751869:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126819840:0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.751959:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996984.753080:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126819968:0@lo:400:kworker.0 00000100:00100000:2.0:1780996984.753128:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996984.753177:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126819968 00000100:00100000:2.0:1780996984.753186:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126819968 00000100:00100000:2.0:1780996984.753244:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:2.0:1780996984.753261:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126819968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996984.753340:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126819968:12345-0@lo:400:kworker.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996984.753348:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00080000:2.0:1780996984.753370:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780996984.753404:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126819968:0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.766670:0:81492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126819840 00000100:00100000:1.0:1780996984.766696:0:81492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126819840 00000100:00100000:1.0:1780996984.766774:0:81492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1780996984.766789:0:81492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126819840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.766890:0:81492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126819840:12345-0@lo:400:kworker.0 Request processed in 106us (14930us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996984.766898:0:81492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1780996984.767195:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126819840:0@lo:400:kworker.0 00000100:00100000:0.0:1780996984.790812:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126820096:0@lo:400:kworker.0 00000100:00100000:0.0:1780996984.790908:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996984.791117:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126820096 00000100:00100000:3.0:1780996984.791127:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126820096 00000100:00100000:3.0:1780996984.791201:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1780996984.791213:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126820096:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1780996984.791411:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780996984.793646:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126820224:0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.793730:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996984.793790:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126820224 00000100:00100000:1.0:1780996984.793812:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126820224 00000100:00100000:1.0:1780996984.793871:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1780996984.793879:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126820224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.793931:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126820224:12345-0@lo:400:kworker.0 Request processed in 52us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996984.793938:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1780996984.793995:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126820224:0@lo:400:kworker.0 00000100:00100000:3.0:1780996984.794810:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126820096:12345-0@lo:400:kworker.0 Request processed in 3597us (3898us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996984.794821:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1780996984.800508:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126820096:0@lo:400:kworker.0 00000100:00080000:2.0:1780996984.801180:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780996984.801246:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780996984.801261:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126820352:0@lo:400:kworker.0 00000100:00100000:2.0:1780996984.801345:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996984.801389:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126820352 00000100:00100000:2.0:1780996984.801396:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126820352 00000100:00100000:2.0:1780996984.801448:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1780996984.801457:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126820352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996984.801524:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126820352:12345-0@lo:400:kworker.0 Request processed in 68us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996984.801532:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00080000:2.0:1780996984.801556:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780996984.801579:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126820352:0@lo:400:kworker.0 00000100:00100000:3.0:1780996984.801719:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780996984.801731:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126820480:0@lo:400:kworker.0 00000100:00100000:3.0:1780996984.801767:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996984.801795:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126820480 00000100:00100000:3.0:1780996984.801799:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126820480 00000100:00100000:3.0:1780996984.801828:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:3.0:1780996984.801834:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126820480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780996984.801889:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126820480:12345-0@lo:400:kworker.0 Request processed in 54us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996984.801895:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00000100:00100000:3.0:1780996984.801936:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126820480:0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.806769:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126820736:0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.806843:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996984.806884:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126821248:0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.806916:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996984.806954:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1780996984.806961:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126820608:0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.806995:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996984.807015:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126821120:0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.807037:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996984.807068:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126821248 00000100:00100000:1.0:1780996984.807075:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126821248 00000100:00100000:1.0:1780996984.807123:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:1.0:1780996984.807132:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126821248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.807183:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126821248:12345-0@lo:400:kworker.0 Request processed in 52us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996984.807190:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:1.0:1780996984.807215:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126820736 00000100:00100000:1.0:1780996984.807219:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126820736 00000100:00100000:1.0:1780996984.807291:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126820608 00000100:00100000:1.0:1780996984.807308:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126820608 00000100:00100000:1.0:1780996984.807334:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126821120 00000100:00100000:1.0:1780996984.807336:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126821120 00000100:00100000:1.0:1780996984.807355:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2448 00000100:00100000:1.0:1780996984.807361:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126820736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.807396:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126820736:12345-0@lo:400:kworker.0 Request processed in 36us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996984.807403:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2448 00000100:00100000:1.0:1780996984.807415:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449 00000100:00100000:1.0:1780996984.807420:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126820608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.807446:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126820608:12345-0@lo:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996984.807452:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449 00000100:00100000:1.0:1780996984.807463:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450 00000100:00100000:1.0:1780996984.807468:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126821120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.807491:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126821120:12345-0@lo:400:kworker.0 Request processed in 23us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996984.807496:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450 00000100:00100000:1.0:1780996984.807552:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126820608:0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.807562:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126821120:0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.807571:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126820736:0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.807578:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126821248:0@lo:400:kworker.0 00000100:00080000:2.0:1780996984.808014:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780996984.808019:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780996984.808031:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126820992:0@lo:400:kworker.0 00000100:00100000:2.0:1780996984.808069:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996984.808101:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780996984.808108:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507126820864:0@lo:400:kworker.0 00000100:00100000:2.0:1780996984.808145:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996984.808291:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126820992 00000100:00100000:0.0:1780996984.808297:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126820992 00000100:00100000:0.0:1780996984.808334:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451 00000100:00100000:0.0:1780996984.808339:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126820992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780996984.808373:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126820992:12345-0@lo:400:kworker.0 Request processed in 35us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996984.808379:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451 00000100:00080000:2.0:1780996984.808472:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780996984.808497:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126820992:0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.808642:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126820864 00000100:00100000:1.0:1780996984.808647:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126820864 00000100:00100000:1.0:1780996984.808677:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:1.0:1780996984.808698:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3497:x1867507126820864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996984.808739:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3497:x1867507126820864:12345-0@lo:400:kworker.0 Request processed in 42us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996984.808745:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1780996984.808913:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507126820864:0@lo:400:kworker.0 00000100:00100000:0.0:1780996985.253718:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126821376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780996985.253797:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996985.253952:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126821376 00000100:00100000:2.0:1780996985.253962:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126821376 00000100:00100000:2.0:1780996985.254031:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:2.0:1780996985.254041:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126821376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780996985.254068:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996985.254123:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126821376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996985.254131:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:0.0:1780996985.254311:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126821376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780996985.254404:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126821504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780996985.254438:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996985.254633:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126821504 00000100:00100000:2.0:1780996985.254639:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126821504 00000100:00100000:2.0:1780996985.254675:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:2.0:1780996985.254693:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126821504:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780996985.254905:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780996985.254914:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126821632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780996985.254946:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996985.255061:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126821632 00000100:00100000:3.0:1780996985.255066:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126821632 00000100:00100000:3.0:1780996985.255102:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:3.0:1780996985.255109:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126821632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780996985.255121:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996985.255159:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126821632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996985.255165:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00100000:3.0:1780996985.255193:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126821632:0@lo:13:osp-pre-0-0.0 00000004:00000024:2.0:1780996985.255305:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445265408 avail 1299025920 00010000:00000080:2.0:1780996985.255320:0:8242:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bb5b8e00 x1867507126821504/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:316/0 lens 224/368 e 0 to 0 dl 1780996996 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996985.255362:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126821504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 671us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996985.255369:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000100:00100000:3.0:1780996985.255585:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126821504:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1780996985.575877:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996986.601182:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780996987.301482:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126821760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780996987.301559:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996987.301634:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126821760 00000100:00100000:0.0:1780996987.301641:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126821760 00000100:00100000:0.0:1780996987.301708:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:0.0:1780996987.301719:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126821760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780996987.301753:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780996987.301802:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126821760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996987.301809:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00080000:0.0:1780996987.301828:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780996987.301861:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126821760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780996987.310741:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780996987.310763:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126821888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780996987.310829:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996987.310971:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126821888 00000100:00100000:0.0:1780996987.310979:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126821888 00000100:00100000:0.0:1780996987.311041:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:0.0:1780996987.311050:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126821888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780996987.311076:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780996987.311147:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126821888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996987.311155:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:0.0:1780996987.311201:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126821888:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1780996987.311797:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1780996987.622400:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996988.646984:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996989.672625:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996989.707005:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996989.707064:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996989.707099:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996989.707122:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996989.707172:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996989.707205:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110337792 00000100:00100000:1.0:1780996989.707214:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110337792 00000100:00100000:3.0:1780996989.707250:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110337536 00000100:00100000:3.0:1780996989.707254:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110337536 00000100:00100000:1.0:1780996989.707299:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110337664 00000100:00100000:1.0:1780996989.707303:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110337664 00000100:00100000:3.0:1780996989.707311:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110337408 00000100:00100000:3.0:1780996989.707313:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110337408 00000100:00100000:1.0:1780996989.707326:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2452 00000100:00100000:3.0:1780996989.707331:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1103 00000100:00100000:1.0:1780996989.707335:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110337792:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996989.707346:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110337536:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996989.707405:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110337536:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 58us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996989.707412:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1103 00000100:00100000:3.0:1780996989.707430:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1104 00000100:00100000:3.0:1780996989.707436:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2396:x1867507110337408:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000080:3.0:1780996989.707457:0:63419:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689ba184380 x1867507110337408/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:320/0 lens 224/224 e 0 to 0 dl 1780997000 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996989.707706:0:81493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110337280 00000100:00100000:2.0:1780996989.707711:0:81493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110337280 00000100:00100000:2.0:1780996989.707743:0:81493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:2.0:1780996989.707750:0:81493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:5bc603cc-b633-43af-a003-872c004686c8+9:2396:x1867507110337280:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996989.720340:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2453 00000100:00100000:1.0:1780996989.720370:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110337664:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996989.720443:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110337664:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 89us (13270us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996989.720451:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2453 00000100:00080000:1.0:1780996989.720483:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780996989.720500:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780996989.720503:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780996989.720505:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780996989.720667:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110337792:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 13332us (13566us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996989.720676:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2452 00000100:00100000:3.0:1780996989.732669:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2396:x1867507110337408:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24833us (25146us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996989.732685:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1104 00000100:00100000:2.0:1780996989.733420:0:81493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:5bc603cc-b633-43af-a003-872c004686c8+9:2396:x1867507110337280:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25664us (26419us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996989.733431:0:81493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:0.0:1780996989.872091:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126822016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780996989.872158:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996989.872629:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126822016 00000100:00100000:0.0:1780996989.872638:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126822016 00000100:00100000:0.0:1780996989.872696:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:0.0:1780996989.872706:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126822016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780996989.872740:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780996989.872787:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126822016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996989.872794:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00000100:00100000:0.0:1780996989.872839:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126822016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780996989.873589:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126822144:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.873630:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996989.873672:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126822656:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.873698:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996989.873715:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126823168:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.873734:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996989.873751:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1780996989.873756:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126822272:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.873774:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996989.873789:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126822784:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.873807:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996989.873822:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126823296:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.873858:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996989.873887:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126822400:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.873908:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996989.873926:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888917a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126822912:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.873943:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996989.873957:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126823424:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.873974:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996989.873990:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1780996989.873995:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507126822528:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.874022:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996989.874039:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888917bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126823040:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.874057:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996989.874073:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126823552:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.874091:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996989.874131:0:81488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126822144 00000100:00100000:2.0:1780996989.874136:0:81488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126822144 00000100:00100000:2.0:1780996989.874168:0:81488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1780996989.874176:0:81488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126822144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.874219:0:81488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126822144:12345-0@lo:400:kworker.0 Request processed in 43us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996989.874226:0:81488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1780996989.874254:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126822656 00000100:00100000:2.0:1780996989.874258:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126822656 00000100:00100000:2.0:1780996989.874302:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126823168 00000100:00100000:2.0:1780996989.874305:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126823168 00000100:00100000:2.0:1780996989.874315:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126822272 00000100:00100000:2.0:1780996989.874317:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126822272 00000100:00100000:2.0:1780996989.874327:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126822400 00000100:00100000:2.0:1780996989.874329:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126822400 00000100:00100000:2.0:1780996989.874339:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126822528 00000100:00100000:2.0:1780996989.874341:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126822528 00000100:00100000:2.0:1780996989.874350:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126823552 00000100:00100000:2.0:1780996989.874352:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126823552 00000100:00100000:2.0:1780996989.874363:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1780996989.874369:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126822656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.874398:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126822656:12345-0@lo:400:kworker.0 Request processed in 29us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996989.874412:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1780996989.874425:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1780996989.874431:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126823168:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780996989.874445:0:65272:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfaab100 x1867507126823168/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:320/0 lens 224/224 e 0 to 0 dl 1780997000 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996989.874471:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126823168:12345-0@lo:400:kworker.0 Request processed in 40us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996989.874477:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1780996989.874487:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1780996989.874492:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507126822272:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780996989.874501:0:65272:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfaaaa00 x1867507126822272/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:320/0 lens 224/224 e 0 to 0 dl 1780997000 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996989.874522:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507126822272:12345-0@lo:400:kworker.0 Request processed in 30us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996989.874527:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1780996989.874536:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1780996989.874542:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126822400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.874567:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126822400:12345-0@lo:400:kworker.0 Request processed in 25us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996989.874572:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1780996989.874582:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1780996989.874587:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507126822528:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780996989.874596:0:65272:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc86e680 x1867507126822528/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:320/0 lens 224/224 e 0 to 0 dl 1780997000 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996989.874631:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507126822528:12345-0@lo:400:kworker.0 Request processed in 44us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996989.874637:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1780996989.874647:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1780996989.874668:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126823552:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780996989.874678:0:65272:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc86df80 x1867507126823552/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:320/0 lens 224/224 e 0 to 0 dl 1780997000 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996989.874703:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126823552:12345-0@lo:400:kworker.0 Request processed in 50us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996989.874708:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1780996989.874735:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126822784 00000100:00100000:2.0:1780996989.874738:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126822784 00000100:00100000:2.0:1780996989.874761:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:2.0:1780996989.874767:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126822784:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780996989.874779:0:80061:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfaabb80 x1867507126822784/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:320/0 lens 224/224 e 0 to 0 dl 1780997000 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996989.874804:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126822784:12345-0@lo:400:kworker.0 Request processed in 38us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996989.874810:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00000100:00100000:2.0:1780996989.874829:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126823296 00000100:00100000:2.0:1780996989.874832:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126823296 00000100:00100000:2.0:1780996989.874857:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126822912 00000100:00100000:2.0:1780996989.874859:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126822912 00000100:00100000:2.0:1780996989.874876:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126823424 00000100:00100000:2.0:1780996989.874878:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126823424 00000100:00100000:2.0:1780996989.874894:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126823040 00000100:00100000:2.0:1780996989.874902:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126823040 00000100:00100000:2.0:1780996989.874925:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2454 00000100:00100000:2.0:1780996989.874931:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126823296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.874963:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126823296:12345-0@lo:400:kworker.0 Request processed in 33us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996989.874969:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2454 00000100:00100000:2.0:1780996989.874980:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455 00000100:00100000:2.0:1780996989.874986:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126822912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875014:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126822912:12345-0@lo:400:kworker.0 Request processed in 27us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996989.875021:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455 00000100:00100000:2.0:1780996989.875031:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456 00000100:00100000:2.0:1780996989.875037:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126823424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875060:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126823424:12345-0@lo:400:kworker.0 Request processed in 25us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996989.875065:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456 00000100:00100000:2.0:1780996989.875074:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457 00000100:00100000:2.0:1780996989.875080:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126823040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875102:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126823040:12345-0@lo:400:kworker.0 Request processed in 23us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996989.875108:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457 00000100:00080000:2.0:1780996989.875148:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780996989.875152:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780996989.875154:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780996989.875156:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780996989.875200:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507126822528:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875220:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888917bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126823040:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875228:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126823552:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875237:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126822400:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875246:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888917a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126822912:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875255:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126823424:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875315:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126822272:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875325:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126822784:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875334:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126823296:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875342:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126822144:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875352:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126822656:0@lo:400:kworker.0 00000100:00100000:2.0:1780996989.875362:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126823168:0@lo:400:kworker.0 00000100:00100000:1.0:1780996990.376215:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126823680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780996990.376309:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996990.376395:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126823680 00000100:00100000:0.0:1780996990.376405:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126823680 00000100:00100000:0.0:1780996990.376466:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:0.0:1780996990.376476:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126823680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780996990.376509:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445265408 avail 1299025920 00010000:00000080:0.0:1780996990.376525:0:23042:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689ba186300 x1867507126823680/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:321/0 lens 224/368 e 0 to 0 dl 1780997001 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780996990.376571:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126823680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996990.376593:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00100000:0.0:1780996990.376656:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126823680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780996990.377910:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780996990.377924:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126823808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780996990.377984:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996990.378106:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126823808 00000100:00100000:3.0:1780996990.378113:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126823808 00000100:00100000:3.0:1780996990.378157:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:3.0:1780996990.378165:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126823808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780996990.378191:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996990.378246:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126823808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996990.378253:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00100000:1.0:1780996990.378372:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126823808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780996990.384221:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780996990.384854:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126823936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780996990.384926:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996990.385096:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126823936 00000100:00100000:0.0:1780996990.385106:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126823936 00000100:00100000:2.0:1780996990.385413:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:2.0:1780996990.385424:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126823936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780996990.385461:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780996990.385548:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126823936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996990.385556:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00100000:1.0:1780996990.385858:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126823936:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1780996990.674138:0:81482:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247814 is committed 00010000:00010000:1.0:1780996990.675258:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c03059922 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.675290:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c03059922 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.675299:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c03059922 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.675306:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780996990.675310:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c03059922 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.675318:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c03059922 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.675334:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898962c300) 00010000:00010000:1.0:1780996990.675337:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780996990.675341:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c03059922 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.675355:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c03059922 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.675371:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305995a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.675377:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305995a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.675383:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305995a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.675388:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780996990.675391:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305995a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.675397:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305995a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.675416:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898962c300) 00010000:00010000:1.0:1780996990.675418:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780996990.675421:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305995a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.675426:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c0305995a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996990.694448:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996991.723883:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1780996992.197219:0:82592:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1780996992.310132:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996992.310520:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110337920 00000100:00100000:2.0:1780996992.310530:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110337920 00000100:00100000:2.0:1780996992.310599:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1103 00000100:00100000:2.0:1780996992.310610:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:65764:x1867507110337920:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:2.0:1780996992.310629:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780996992.310659:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305996f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8adc expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.310723:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c03059976 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.310737:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c03059976 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.310750:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c03059976 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780996992.310796:0:65272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780996992.310800:0:65272:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780996992.310831:0:65272:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c03059976 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.310977:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305996f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8adc expref: 8 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.310993:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c03059976 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8adc expref: 7 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.311003:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898a563a00) 00010000:00010000:2.0:1780996992.311006:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780996992.311016:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455000, rc 0) 00010000:00000080:2.0:1780996992.311025:0:65272:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b78c1f80 x1867507110337920/t0(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:323/0 lens 576/688 e 0 to 0 dl 1780997003 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780996992.311093:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65764:x1867507110337920:12345-192.168.206.51@tcp:101:touch.0 Request processed in 485us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996992.311100:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1103 00000100:00080000:2.0:1780996992.311124:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780996992.315141:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996992.315345:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110338048 00000100:00100000:1.0:1780996992.315357:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110338048 00000100:00100000:1.0:1780996992.315445:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1104 00000100:00100000:1.0:1780996992.315456:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:65764:x1867507110338048:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780996992.315478:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780996992.315499:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305997d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ae3 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315562:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059984 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315590:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315601:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315691:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305998b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315700:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305998b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315707:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305998b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315787:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1800/0x30fd811c03059992 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315795:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1800/0x30fd811c03059992 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315814:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1800/0x30fd811c03059992 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780996992.315862:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1780996992.315866:0:63418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780996992.315888:0:63418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1800/0x30fd811c03059992 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315902:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059984 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315908:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059984 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315914:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059984 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315921:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059984 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315927:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780996992.315942:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059984 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315951:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059984 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315962:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898a563a00) 00010000:00010000:1.0:1780996992.315965:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780996992.315969:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059984 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.315989:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0c00/0x30fd811c03059984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.316005:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305998b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.316011:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305998b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.316017:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305998b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.316022:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780996992.316026:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305998b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.316033:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305998b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.316040:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9689bc1aff00) 00010000:00010000:1.0:1780996992.316043:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780996992.316045:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305998b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.316050:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305998b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.316081:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305997d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ae3 expref: 9 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.316106:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1800/0x30fd811c03059992 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ae3 expref: 8 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996992.316114:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9689bc1afc00) 00010000:00010000:1.0:1780996992.316116:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1780996992.316118:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1800, rc 0) 00010000:00000080:1.0:1780996992.316126:0:63418:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc86fb80 x1867507110338048/t0(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:323/0 lens 592/688 e 0 to 0 dl 1780997003 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780996992.316368:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:65764:x1867507110338048:12345-192.168.206.51@tcp:101:touch.0 Request processed in 914us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996992.316376:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1104 00000100:00100000:1.0:1780996992.320376:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996992.320530:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110338304 00000100:00100000:2.0:1780996992.320540:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110338304 00000100:00100000:2.0:1780996992.320614:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1105 00000100:00100000:2.0:1780996992.320627:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:65764:x1867507110338304:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:2.0:1780996992.320661:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780996992.320682:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c03059999 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8aea expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.320789:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c030599a0 lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.320804:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c030599a0 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.320816:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c030599a0 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.320829:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c030599a7 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.320836:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c030599a7 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.320855:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c030599a7 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321489:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030599ae lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321500:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030599ae lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321508:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030599ae lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780996992.321553:0:63584:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1780996992.321557:0:63584:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 0 -> 1780996992 00000004:00010000:2.0:1780996992.321560:0:63584:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 0 -> 1780996992 00000004:00010000:2.0:1780996992.321562:0:63584:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 0 -> 1780996992 00000004:00010000:2.0:1780996992.321565:0:63584:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:2.0:1780996992.321569:0:63584:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:2.0:1780996992.321575:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c030599a0 lrc: 4/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321582:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c030599a0 lrc: 4/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321589:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c030599a0 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321716:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c030599a0 lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321723:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780996992.321734:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c030599a0 lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321741:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c030599a0 lrc: 5/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321755:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9689bc1afc00) 00010000:00010000:2.0:1780996992.321758:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780996992.321763:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c030599a0 lrc: 3/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321769:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c030599a0 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780996992.321781:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009be9864b reply state 00000000afabcbb2 transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c030599a7 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321792:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c030599a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321798:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff96898a563900) 00010000:00010000:2.0:1780996992.321800:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780996992.321802:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780996992.321833:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c03059999 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aea expref: 11 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321849:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030599ae lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aea expref: 10 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.321856:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff96898a563400) 00010000:00010000:2.0:1780996992.321858:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1780996992.321866:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454800, rc 0) 00010000:00000080:2.0:1780996992.321875:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b78c1c00 x1867507110338304/t98784247815(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:323/0 lens 752/824 e 0 to 0 dl 1780997003 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780996992.321964:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:65764:x1867507110338304:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1341us (1597us total) trans 98784247815 rc 0/0 00000100:00100000:2.0:1780996992.321973:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1105 00000100:00100000:3.0:1780996992.325822:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996992.325914:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110338560 00000100:00100000:2.0:1780996992.325925:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110338560 00000100:00100000:2.0:1780996992.325987:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1106 00000100:00100000:2.0:1780996992.325998:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:65764:x1867507110338560:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:2.0:1780996992.326122:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.326139:0:65272:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030599ae lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aea expref: 11 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.326148:0:65272:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.326182:0:65272:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030599ae lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aea expref: 11 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996992.326197:0:65272:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030599ae lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aea expref: 11 pid: 63584 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780996992.326213:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:65272:1867507126824064:192.168.206.51@tcp:104: 00000100:00100000:2.0:1780996992.326325:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780996992.332068:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996992.332181:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:65272:1867507126824064:192.168.206.51@tcp:104: 00010000:00010000:3.0:1780996992.332208:0:65272:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996992.333087:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110338688 00000100:00100000:0.0:1780996992.333099:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110338688 00010000:00010000:0.0:1780996992.333148:0:6338:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030599ae lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aea expref: 12 pid: 63584 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996992.333182:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2552 00000100:00100000:0.0:1780996992.333191:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2395:x1867507110338688:12345-192.168.206.51@tcp:102:ldlm_bl.0 00010000:00010000:0.0:1780996992.333207:0:6338:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030599ae lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aea expref: 12 pid: 63584 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996992.333218:0:6338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030599ae lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aea expref: 12 pid: 63584 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996992.333229:0:6338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030599ae lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aea expref: 12 pid: 63584 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996992.333237:0:6338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff96898a563400) 00010000:00010000:0.0:1780996992.333240:0:6338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1780996992.333250:0:6338:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996992.333259:0:6338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996992.333265:0:6338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996992.333309:0:6338:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030599ae lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aea expref: 12 pid: 63584 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996992.333352:0:65272:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996992.333361:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780996992.333381:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2395:x1867507110338688:12345-192.168.206.51@tcp:102:ldlm_bl.0 Request processed in 190us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996992.333390:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2552 00000004:00010000:3.0:1780996992.333483:0:65272:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1780996992.333488:0:65272:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 1780996992 -> 1780996992 00000004:00010000:3.0:1780996992.333491:0:65272:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 1780996992 -> 1780996992 00000004:00010000:3.0:1780996992.333494:0:65272:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 1780996992 -> 1780996992 00000004:00010000:3.0:1780996992.333497:0:65272:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:3.0:1780996992.333503:0:65272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052e7f92f reply state 0000000017244f26 transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996992.333516:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996992.333523:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff96898a563400) 00010000:00010000:3.0:1780996992.333525:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780996992.333528:0:65272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1780996992.333580:0:65272:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bb5bb480 x1867507110338560/t98784247816(0) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:323/0 lens 488/456 e 0 to 0 dl 1780997003 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780996992.333631:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:65764:x1867507110338560:12345-192.168.206.51@tcp:36:touch.0 Request processed in 7636us (7821us total) trans 98784247816 rc 0/0 00000100:00100000:3.0:1780996992.333647:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1106 00000100:00100000:2.0:1780996992.351433:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996992.351573:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110338944 00000100:00100000:3.0:1780996992.351583:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110338944 00000100:00100000:3.0:1780996992.351661:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:3.0:1780996992.351685:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:65764:x1867507110338944:12345-192.168.206.51@tcp:35:touch.0 00010000:00000080:3.0:1780996992.351880:0:63421:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc86f480 x1867507110338944/t98784247817(0) o35->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:323/0 lens 392/456 e 0 to 0 dl 1780997003 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780996992.351956:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:65764:x1867507110338944:12345-192.168.206.51@tcp:35:touch.0 Request processed in 275us (534us total) trans 98784247817 rc 0/0 00000100:00100000:3.0:1780996992.351965:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:0.0:1780996992.426650:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126824192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780996992.426717:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996992.434034:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126824192 00000100:00100000:3.0:1780996992.434048:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126824192 00000100:00100000:3.0:1780996992.434140:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962 00000100:00100000:3.0:1780996992.434155:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126824192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780996992.434193:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1780996992.434237:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780996992.434314:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126824192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 165us (7596us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996992.434321:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962 00000100:00100000:2.0:1780996992.434426:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126824192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780996992.434535:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126824320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780996992.434576:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996992.435722:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126824320 00000100:00100000:1.0:1780996992.435737:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126824320 00000100:00100000:1.0:1780996992.435790:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:1.0:1780996992.435799:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126824320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780996992.435826:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1780996992.435934:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996992.436069:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126824320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 270us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996992.436077:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00100000:2.0:1780996992.436159:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126824320:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1780996992.741504:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996993.772580:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996994.801409:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996994.819607:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996994.819661:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996994.819707:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996994.819729:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996994.819755:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780996994.822170:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110339200 00000100:00100000:2.0:1780996994.822190:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110339200 00000100:00100000:2.0:1780996994.822293:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110339328 00000100:00100000:2.0:1780996994.822298:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110339328 00000100:00100000:2.0:1780996994.822327:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1111 00000100:00100000:2.0:1780996994.822338:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:2396:x1867507110339200:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000080:2.0:1780996994.822381:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bb5b9c00 x1867507110339200/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:325/0 lens 224/224 e 0 to 0 dl 1780997005 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996994.822452:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:2396:x1867507110339200:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 116us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996994.822459:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1111 00000100:00100000:2.0:1780996994.822480:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1112 00000100:00100000:2.0:1780996994.822487:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110339328:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780996994.822513:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110339328:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (2784us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996994.822520:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1112 00000100:00100000:2.0:1780996994.822538:0:81487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110339072 00000100:00100000:2.0:1780996994.822542:0:81487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110339072 00000100:00100000:2.0:1780996994.822597:0:81487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:2.0:1780996994.822604:0:81487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+9:2396:x1867507110339072:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780996994.822658:0:81487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+9:2396:x1867507110339072:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 56us (2951us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996994.822665:0:81487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00080000:0.0:1780996994.826258:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780996994.826267:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780996994.827419:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110339456 00000100:00100000:0.0:1780996994.827432:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110339456 00000100:00100000:0.0:1780996994.827511:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110339584 00000100:00100000:0.0:1780996994.827515:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110339584 00000100:00100000:0.0:1780996994.827547:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2458 00000100:00100000:3.0:1780996994.827743:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2459 00000100:00100000:3.0:1780996994.827755:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110339584:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780996994.827843:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110339584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 92us (8087us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996994.827852:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2459 00000100:00100000:0.0:1780996994.827960:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110339456:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996994.827994:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110339456:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 426us (8332us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996994.828001:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2458 00000100:00080000:2.0:1780996994.828066:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780996994.828073:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:2.0:1780996994.832457:0:82689:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1780996994.832521:0:82689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.832537:0:82689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.832545:0:82689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.832566:0:82689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.832638:0:82689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1780996994.832644:0:82689:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1780996994.832672:0:82689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1780996994.832676:0:82689:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1780996994.832682:0:82689:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1780996994.832708:0:82689:0:(import.c:65:import_set_state_nolock()) ffff96888969a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1780996994.832742:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126824448:0@lo:39:umount.0 00000100:00100000:2.0:1780996994.832804:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996994.832854:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126824448 00000100:00100000:2.0:1780996994.832861:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126824448 00000100:00100000:2.0:1780996994.832917:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1780996994.832925:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1867507126824448:12345-0@lo:39:umount.0 00000020:00000080:2.0:1780996994.832950:0:80049:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059658 00000100:00080000:2.0:1780996994.832965:0:80049:0:(import.c:65:import_set_state_nolock()) ffff96888a013800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1780996994.835880:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780996994.835908:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996994.835921:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3600 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:0.0:1780996994.835925:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996994.835938:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780996994.835945:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780996994.835950:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1780996994.835953:0:14480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1780996994.835956:0:14480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1780996994.836009:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996994.836016:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780996994.836055:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996994.836063:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968983ce3600/0x30fd811c03059540 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059547 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996994.836079:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996994.836081:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996994.836083:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780996994.836128:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780996994.836157:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126824576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780996994.836226:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780996994.836519:0:6337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126824576 00000100:00100000:0.0:1780996994.836527:0:6337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126824576 00000100:00100000:0.0:1780996994.836740:0:6337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1780996994.836750:0:6337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b620cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126824576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780996994.836764:0:6337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780996994.836780:0:6337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2600/0x30fd811c03059547 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059540 expref: 23 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780996994.836793:0:6337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780996994.836832:0:6337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b620cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3498:x1867507126824576:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996994.836839:0:6337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1780996994.836946:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126824576:0@lo:103:ldlm_bl.0 00010000:00000080:2.0:1780996994.837142:0:80049:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc86c000 x1867507126824448/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:325/0 lens 224/224 e 0 to 0 dl 1780997005 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996994.837193:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3495:x1867507126824448:12345-0@lo:39:umount.0 Request processed in 4269us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996994.837202:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000020:00000080:2.0:1780996994.837211:0:80049:0:(genops.c:906:class_export_put()) final put ffff9689a5876000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1780996994.837356:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888969a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1780996994.837412:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126824448:0@lo:39:umount.0 00000020:00000080:1.0:1780996994.837462:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689a5876000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1780996994.837514:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888a013800 for lustre-MDT0000 00010000:00010000:3.0:1780996994.837719:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780996994.837758:0:82689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1780996994.837763:0:82689:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1780996994.837768:0:82689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1780996994.839955:0:82689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.839978:0:82689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.839986:0:82689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.839994:0:82689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840072:0:82689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780996994.840080:0:82689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840088:0:82689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840095:0:82689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840100:0:82689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.840131:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780996994.840139:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.840146:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03a00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780996994.840151:0:6339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.840161:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780996994.840169:0:6339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780996994.840175:0:6339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1780996994.840178:0:6339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1780996994.840219:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.840226:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1780996994.840303:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1780996994.840404:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.840412:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c03059460 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059467 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.840451:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780996994.840455:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.840460:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3800 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780996994.840464:0:6339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.840470:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780996994.840477:0:6339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780996994.840483:0:6339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1780996994.840485:0:6339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1780996994.840499:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.840505:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780996994.840605:0:82689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:3.0:1780996994.840611:0:82689:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1780996994.840619:0:82689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840635:0:82689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840649:0:82689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840656:0:82689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840667:0:82689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780996994.840678:0:82689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840685:0:82689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840691:0:82689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840697:0:82689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840709:0:82689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1780996994.840712:0:82689:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1780996994.840716:0:82689:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1780996994.840746:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780996994.840751:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840758:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2000 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780996994.840761:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840775:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780996994.840782:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780996994.840787:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1780996994.840789:0:6340:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1780996994.840791:0:6340:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1780996994.840809:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840815:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780996994.840832:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840838:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c03059532 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059539 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840849:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780996994.840852:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840857:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02600 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780996994.840860:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840866:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780996994.840883:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780996994.840888:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1780996994.840890:0:6340:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1780996994.840892:0:6340:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1780996994.840907:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840913:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780996994.840919:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840926:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059452 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059459 expref: -99 pid: 81481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.840935:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996994.840936:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780996994.840938:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780996994.840956:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126825088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780996994.841032:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996994.841077:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780996994.841083:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126824960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780996994.841104:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996994.841130:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126825088 00000100:00100000:3.0:1780996994.841136:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126825088 00000100:00100000:3.0:1780996994.841175:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126824960 00000100:00100000:3.0:1780996994.841178:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126824960 00000100:00100000:3.0:1780996994.841201:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1780996994.841218:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126825088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780996994.841232:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780996994.841247:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce3000/0x30fd811c03059459 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059452 expref: 23 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.841260:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780996994.841317:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3499:x1867507126825088:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996994.841326:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1780996994.841341:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1780996994.841348:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3499:x1867507126824960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780996994.841357:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780996994.841366:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02800/0x30fd811c03059539 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059532 expref: 21 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780996994.841374:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780996994.841395:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3499:x1867507126824960:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996994.841401:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1780996994.841430:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126824960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780996994.841439:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126825088:0@lo:103:ldlm_bl.0 00000020:01000004:3.0:1780996994.841466:0:82689:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1780996994.841470:0:82689:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1780996994.841475:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1780996994.841481:0:82689:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000004:00000080:3.0:1780996994.843319:0:82689:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:0.0:1780996994.843562:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780996994.843569:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996994.846988:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126824832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780996994.847080:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996994.847138:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126824704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780996994.847160:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996994.847210:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126824832 00000100:00100000:2.0:1780996994.847218:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126824832 00000100:00100000:2.0:1780996994.847264:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126824704 00000100:00100000:2.0:1780996994.847289:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126824704 00000100:00100000:2.0:1780996994.847316:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:2.0:1780996994.847324:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3497:x1867507126824832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780996994.847338:0:18812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780996994.847357:0:18812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce3800/0x30fd811c03059586 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305957f expref: 21 pid: 81488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847390:0:18812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780996994.847426:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3497:x1867507126824832:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996994.847433:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:2.0:1780996994.847449:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:2.0:1780996994.847454:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3497:x1867507126824704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780996994.847461:0:18812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780996994.847469:0:18812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03000/0x30fd811c03059467 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059460 expref: 19 pid: 81489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847478:0:18812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780996994.847499:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3497:x1867507126824704:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996994.847505:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000001:00080000:2.0:1780996994.847771:0:81482:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00010000:00010000:2.0:1780996994.847799:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c030599a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847808:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c030599a7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847816:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c030599a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847823:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780996994.847828:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c030599a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847845:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c030599a7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847857:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff96898a563900) 00010000:00010000:2.0:1780996994.847860:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780996994.847865:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c030599a7 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847871:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c030599a7 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847892:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847899:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847905:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847911:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780996994.847913:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847919:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847927:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff96898a563400) 00010000:00010000:2.0:1780996994.847930:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780996994.847932:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996994.847945:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c030599bc lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780996994.847989:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126824832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780996994.847999:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126824704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780996994.848759:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.848771:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305957f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059586 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.848787:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996994.848789:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996994.848792:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1780996994.849559:0:82689:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1780996994.849576:0:82689:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689a5875000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1780996994.849582:0:82689:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689a5873000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1780996994.849586:0:82689:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff968886f5c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1780996994.849590:0:82689:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689bc9e1000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1780996994.849597:0:82689:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689bc9e0000 285c134c-d3a6-4c01-bb4d-8148c50d5f95 192.168.206.51@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 98784247817 stale:0 00000020:00080000:3.0:1780996994.849602:0:82689:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff968886bdcd40) has exports, disconnecting them 00000020:00080000:3.0:1780996994.849606:0:82689:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689a5875000), last request at 1780996964 00000020:00000080:3.0:1780996994.849613:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059651 00000100:00080000:3.0:1780996994.849633:0:82689:0:(import.c:65:import_set_state_nolock()) ffff9689a5873800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1780996994.849695:0:82689:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689a5875000): rc 0 00000020:00000080:3.0:1780996994.849698:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689a5875000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1780996994.849840:0:82689:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689a5873000), last request at 1780996989 00000020:00000080:3.0:1780996994.849845:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305964a 00000100:00080000:3.0:1780996994.849849:0:82689:0:(import.c:65:import_set_state_nolock()) ffff9689a5871800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1780996994.849872:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1780996994.849900:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689a5875000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1780996994.849949:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689a5873800 for lustre-MDT0000 00000020:00080000:3.0:1780996994.850230:0:82689:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689a5873000): rc 0 00000020:00000080:3.0:1780996994.850232:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689a5873000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1780996994.850246:0:82689:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff968886f5c800), last request at 1780996989 00000020:00000080:3.0:1780996994.850250:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059643 00000100:00080000:3.0:1780996994.850256:0:82689:0:(import.c:65:import_set_state_nolock()) ffff968886f58000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1780996994.850302:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689a5873000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1780996994.850333:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689a5871800 for lustre-MDT0000 00010000:00010000:0.0:1780996994.850387:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1780996994.850656:0:82689:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff968886f5c800): rc 0 00000020:00000080:3.0:1780996994.850659:0:82689:0:(genops.c:906:class_export_put()) final put ffff968886f5c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1780996994.850671:0:82689:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689bc9e1000), last request at 1780996958 00000020:00000080:3.0:1780996994.850680:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c030594b4 00000100:00080000:3.0:1780996994.850692:0:82689:0:(import.c:65:import_set_state_nolock()) ffff96888969e000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1780996994.850719:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968886f5c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1780996994.850750:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968886f58000 for lustre-MDT0000 00010000:00010000:0.0:1780996994.850799:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1780996994.850892:0:82689:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bc9e1000): rc 0 00000020:00000080:3.0:1780996994.850895:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689bc9e1000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1780996994.850965:0:82689:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.206.51@tcp (ffff9689bc9e0000), last request at 1780996994 00000020:00000080:3.0:1780996994.850970:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c030594ad 00000020:00010000:3.0:1780996994.850977:0:82689:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689bc9e0000: total 1 00000100:00080000:3.0:1780996994.850981:0:82689:0:(import.c:65:import_set_state_nolock()) ffff9689bb5a4800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1780996994.851008:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc9e1000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1780996994.851045:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888969e000 for lustre-MDT0000 00000020:00010000:1.0:1780996994.851077:0:6339:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689bc9e0000: total 0 00010000:00010000:1.0:1780996994.851130:0:6339:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689bc9e0000, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1780996994.851165:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c03059976 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8adc expref: 7 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.851191:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c030599ae lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aea expref: 6 pid: 63584 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.851210:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1800/0x30fd811c03059992 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ae3 expref: 5 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780996994.851222:0:6339:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689bc9e0000, canceled 3 locks, left on hash table 0. 00000020:00080000:3.0:1780996994.856225:0:82689:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.206.51@tcp (ffff9689bc9e0000): rc 0 00000004:00000080:3.0:1780996994.856236:0:82689:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa8c8c2ad3ae0 00000100:00080000:3.0:1780996994.856263:0:82689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1780996994.856282:0:82689:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1780996994.857189:0:82689:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1780996994.857224:0:82689:0:(import.c:65:import_set_state_nolock()) ffff9689bca5b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1780996994.857340:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126825216:0@lo:39:umount.0 00000100:00100000:2.0:1780996994.857417:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996994.861509:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126825216 00000100:00100000:2.0:1780996994.861526:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126825216 00000100:00100000:2.0:1780996994.861705:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:2.0:1780996994.861715:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126825216:12345-0@lo:39:umount.0 00000020:00000080:2.0:1780996994.861748:0:80061:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c030594e5 00000100:00080000:2.0:1780996994.861757:0:80061:0:(import.c:65:import_set_state_nolock()) ffff968990cc2000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1780996994.861835:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780996994.862071:0:82689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1780996994.862077:0:82689:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 3 00000004:00080000:3.0:1780996994.862100:0:82689:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:3.0:1780996994.862162:0:82689:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1780996994.862185:0:82689:0:(import.c:65:import_set_state_nolock()) ffff9689bcb9d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1780996994.862201:0:82689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1780996994.862203:0:82689:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 3 00000004:00080000:3.0:1780996994.862213:0:82689:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:3.0:1780996994.862307:0:82689:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1780996994.862316:0:82689:0:(import.c:65:import_set_state_nolock()) ffff968983330800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1780996994.862364:0:82689:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff968886bdcd40) has no exports 00000020:00080000:3.0:1780996994.862805:0:82689:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff968886bdcd40) has no exports 00000001:00000004:2.0:1780996994.868647:0:80061:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378729 00000100:00100000:2.0:1780996994.869202:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3495:x1867507126825216:12345-0@lo:39:umount.0 Request processed in 7484us (11780us total) trans 81604378730 rc 0/0 00000100:00100000:2.0:1780996994.869215:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00010000:00010000:2.0:1780996994.869251:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996994.869281:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126825344:0@lo:9:umount.0 00000100:00100000:2.0:1780996994.869319:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996994.869351:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126825344 00000100:00100000:2.0:1780996994.869372:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126825344 00000100:00100000:2.0:1780996994.869415:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5911 00000100:00100000:2.0:1780996994.869422:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126825344:12345-0@lo:9:umount.0 00000020:00000080:2.0:1780996994.869445:0:25170:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059501 00000100:00080000:2.0:1780996994.869452:0:25170:0:(import.c:65:import_set_state_nolock()) ffff968986140800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1780996994.870038:0:25170:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:2.0:1780996994.870434:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3495:x1867507126825344:12345-0@lo:9:umount.0 Request processed in 1010us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996994.870443:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5911 00000100:00080000:2.0:1780996994.870470:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780996994.870507:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780996994.870540:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcb9d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1780996994.870554:0:3495:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:2.0:1780996994.870556:0:3495:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780996994.870560:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126825344:0@lo:9:umount.0 00000100:00100000:2.0:1780996994.870717:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126825472:0@lo:9:umount.0 00000100:00100000:2.0:1780996994.870978:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996994.871007:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126825472 00000100:00100000:2.0:1780996994.871012:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126825472 00000100:00100000:2.0:1780996994.871046:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5912 00000100:00100000:2.0:1780996994.871052:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126825472:12345-0@lo:9:umount.0 00000020:00000080:2.0:1780996994.871070:0:25179:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305951d 00000100:00080000:2.0:1780996994.871231:0:25179:0:(import.c:65:import_set_state_nolock()) ffff96888b416800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1780996994.871265:0:25179:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:2.0:1780996994.871363:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3495:x1867507126825472:12345-0@lo:9:umount.0 Request processed in 310us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996994.871370:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5912 00000100:00080000:2.0:1780996994.871384:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780996994.871404:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780996994.871424:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968983330800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1780996994.871435:0:3495:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:2.0:1780996994.871437:0:3495:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780996994.871440:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126825472:0@lo:9:umount.0 00000100:00080000:2.0:1780996994.871461:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bca5b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1780996994.871465:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126825216:0@lo:39:umount.0 00000020:00000080:1.0:1780996994.887060:0:6339:0:(genops.c:906:class_export_put()) final put ffff9689bc9e0000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00010000:00010000:1.0:1780996994.887141:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996994.887144:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996994.887147:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1780996994.887617:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc9e0000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-MDT0000 00000020:00000080:2.0:1780996994.887694:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bb5a4800 for lustre-MDT0000 00000020:00000080:3.0:1780996994.939053:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c030594c9 00000020:00000080:3.0:1780996994.939068:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689bcdfc800/lustre-QMT0000_UUID 00000020:01000000:3.0:1780996994.939133:0:82689:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1780996994.939715:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780996994.939727:0:82689:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1780996994.939732:0:82689:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9689bfb38000) has no exports 00000020:00000080:3.0:1780996994.940556:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c030594c2 00000020:00000080:3.0:1780996994.940566:0:82689:0:(genops.c:906:class_export_put()) final put ffff96898616c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1780996994.941789:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcdfc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1780996994.946525:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96898616c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780996994.946846:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780996994.946860:0:82689:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1780996994.946865:0:82689:0:(genops.c:906:class_export_put()) final put ffff9688888d7800/lustre-QMT0000_UUID 00000020:00000080:0.0:1780996994.946868:0:82689:0:(genops.c:865:class_export_destroy()) destroying export ffff9688888d7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1780996994.946875:0:82689:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1780996994.947193:0:82689:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968887c39a20 - data ffff9689aed5d438/ffff9689a679e000 00000020:01000000:0.0:1780996994.947355:0:82689:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968887c772a0 - data ffff9689aed5fa20/ffff9689ad8f2400 00000100:00100000:2.0:1780996994.989375:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780996994.989463:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780996994.989502:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126825728:0@lo:400:kworker.0 00000100:00100000:0.0:1780996994.989596:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996994.998102:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126825600:0@lo:400:kworker.0 00000100:00100000:2.0:1780996994.998201:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996994.998287:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126825728 00000100:00100000:2.0:1780996994.998295:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126825728 00000100:00100000:2.0:1780996994.998350:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126825600 00000100:00100000:2.0:1780996994.998353:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126825600 00000100:00100000:2.0:1780996994.998371:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1780996994.998380:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126825728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780996994.998440:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126825728:12345-0@lo:400:kworker.0 Request processed in 61us (8844us total) trans 0 rc 0/0 00000100:00100000:2.0:1780996994.998447:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1780996994.998462:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1780996994.998466:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3497:x1867507126825600:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1780996994.998471:0:63417:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1780996994.998499:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3497:x1867507126825600:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc -107/-107 00000100:00100000:2.0:1780996994.998518:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00080000:2.0:1780996994.998534:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780996994.998918:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126825728:0@lo:400:kworker.0 00000100:00080000:2.0:1780996994.998957:0:3497:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1780996994.998963:0:3497:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1780996994.998966:0:3497:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1780996994.998971:0:3497:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780996994.998975:0:3497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3491 00000100:00080000:2.0:1780996994.998981:0:3497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996994.999008:0:3497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc86dc00 x1867507126825856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780996994.999031:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126825600:0@lo:400:kworker.0 00000100:00100000:2.0:1780996994.999050:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126825856:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1780996994.999078:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996994.999101:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126825856 00000100:00100000:2.0:1780996994.999105:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126825856 00000100:00100000:2.0:1780996994.999125:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1780996994.999130:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126825856:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1780996994.999157:0:65272:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1780996995.001362:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126825984:0@lo:400:kworker.0 00000100:00100000:3.0:1780996995.001423:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996995.001494:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126826112:0@lo:400:kworker.0 00000100:00100000:3.0:1780996995.001520:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996995.001757:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a679ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126826496:0@lo:400:kworker.0 00000100:00100000:3.0:1780996995.001786:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996995.001831:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126826624:0@lo:400:kworker.0 00000100:00100000:3.0:1780996995.001854:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996995.002722:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126826496 00000100:00100000:1.0:1780996995.002732:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126826496 00000100:00100000:1.0:1780996995.002799:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460 00000100:00100000:1.0:1780996995.002808:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126826496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996995.002867:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126826496:12345-0@lo:400:kworker.0 Request processed in 60us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996995.002874:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460 00000100:00100000:1.0:1780996995.002901:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a679a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126826368:0@lo:400:kworker.0 00000100:00100000:1.0:1780996995.002929:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996995.002952:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780996995.002973:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126826240:0@lo:400:kworker.0 00000100:00100000:1.0:1780996995.003000:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996995.003027:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126826368 00000100:00100000:1.0:1780996995.003031:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126826368 00000100:00100000:1.0:1780996995.003058:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461 00000100:00100000:1.0:1780996995.003064:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126826368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996995.003097:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126826368:12345-0@lo:400:kworker.0 Request processed in 33us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996995.003103:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461 00000100:00100000:1.0:1780996995.003118:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126826240 00000100:00100000:1.0:1780996995.003121:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126826240 00000100:00100000:1.0:1780996995.003139:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:1.0:1780996995.003216:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3497:x1867507126826240:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780996995.003223:0:23042:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780996995.003249:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3497:x1867507126826240:12345-0@lo:400:kworker.0 Request processed in 105us (248us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780996995.003256:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00080000:1.0:1780996995.003315:0:3497:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1780996995.003320:0:3497:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1780996995.003324:0:3497:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1780996995.003329:0:3497:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780996995.003333:0:3497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3491 00000100:00080000:1.0:1780996995.003339:0:3497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780996995.003362:0:3497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b78c3b80 x1867507126826752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780996995.003378:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126826240:0@lo:400:kworker.0 00000100:00100000:1.0:1780996995.003399:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a679a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126826368:0@lo:400:kworker.0 00000100:00080000:3.0:1780996995.003795:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780996995.003801:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780996995.003827:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a679ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126826496:0@lo:400:kworker.0 00000100:00100000:1.0:1780996995.009322:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126825984 00000100:00100000:1.0:1780996995.009341:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126825984 00000100:00100000:1.0:1780996995.009394:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126826112 00000100:00100000:1.0:1780996995.009398:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126826112 00000100:00100000:1.0:1780996995.009431:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126826624 00000100:00100000:1.0:1780996995.009435:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126826624 00000100:00100000:1.0:1780996995.009449:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1780996995.009461:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126826112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780996995.009559:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126826112:12345-0@lo:400:kworker.0 Request processed in 101us (8037us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996995.009567:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1780996995.009602:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1780996995.009607:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3498:x1867507126825984:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780996995.009613:0:63418:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780996995.009658:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3498:x1867507126825984:12345-0@lo:400:kworker.0 Request processed in 49us (8235us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780996995.009665:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1780996995.009677:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1780996995.009681:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3499:x1867507126826624:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780996995.009686:0:63418:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780996995.009709:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3499:x1867507126826624:12345-0@lo:400:kworker.0 Request processed in 27us (7854us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780996995.009714:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1780996995.009893:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126825856:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 10760us (10813us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996995.009900:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00080000:2.0:1780996995.009947:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780996995.009983:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780996995.010001:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780996995.010006:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126825856:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1780996995.010032:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126826752:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1780996995.010070:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780996995.010131:0:3499:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1780996995.010136:0:3499:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1780996995.010139:0:3499:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1780996995.010145:0:3499:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780996995.010149:0:3499:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3491 00000100:00080000:2.0:1780996995.010155:0:3499:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780996995.010182:0:3499:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc86d180 x1867507126826880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780996995.010203:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126826624:0@lo:400:kworker.0 00000100:00100000:2.0:1780996995.010219:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126826112:0@lo:400:kworker.0 00000100:00100000:2.0:1780996995.010241:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126826880:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1780996995.010265:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780996995.010408:0:3498:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780996995.010412:0:3498:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1780996995.010416:0:3498:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1780996995.010419:0:3498:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780996995.010422:0:3498:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3491 00000100:00080000:3.0:1780996995.010426:0:3498:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780996995.010440:0:3498:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a679ad80 x1867507126827008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780996995.010451:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126825984:0@lo:400:kworker.0 00000100:00100000:2.0:1780996995.016037:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a679ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126827008:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1780996995.016111:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780996995.016145:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126826880 00000100:00100000:2.0:1780996995.016154:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126826880 00000100:00100000:2.0:1780996995.016188:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126827008 00000100:00100000:2.0:1780996995.016191:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126827008 00000100:00100000:2.0:1780996995.016211:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1780996995.016217:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126826880:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1780996995.016251:0:63419:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1780996995.016310:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126826880:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 91us (6043us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996995.016317:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1780996995.016334:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1780996995.016338:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126827008:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1780996995.016346:0:63419:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1780996995.016370:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126827008:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 30us (259us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780996995.016376:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00080000:2.0:1780996995.016416:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780996995.016421:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780996995.016425:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a679ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126827008:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1780996995.016436:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780996995.016439:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780996995.016442:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126826880:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1780996995.016831:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126826752 00000100:00100000:1.0:1780996995.016837:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126826752 00000100:00100000:1.0:1780996995.016865:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:1.0:1780996995.016876:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126826752:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1780996995.016885:0:8242:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1780996995.016929:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126826752:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 52us (6859us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780996995.016935:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00080000:3.0:1780996995.017007:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780996995.017012:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780996995.017015:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126826752:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1780996995.032704:0:82689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780996995.032713:0:82689:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1780996995.032728:0:82689:0:(client.c:3169:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9689b10c0700 x1867507126825216/t81604378730(81604378730) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997004 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780996995.032751:0:82689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1780996995.037826:0:82689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780996995.037834:0:82689:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 4 00000004:00080000:2.0:1780996995.037889:0:82689:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780996995.037893:0:82689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1780996995.046893:0:81501:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1780996995.046901:0:81501:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 1 count 1 00000040:00080000:3.0:1780996995.046920:0:81501:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:2.0:1780996995.047872:0:82689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780996995.047895:0:82689:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 4 00000004:00080000:2.0:1780996995.047915:0:82689:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780996995.047918:0:82689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1780996995.048184:0:81503:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1780996995.048189:0:81503:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 1 count 1 00000040:00080000:1.0:1780996995.048200:0:81503:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:3.0:1780996995.057036:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305947c 00000020:00000080:3.0:1780996995.057047:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689869ca000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1780996995.057812:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059491 00000020:00000080:3.0:1780996995.057819:0:82689:0:(genops.c:906:class_export_put()) final put ffff968990f72000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1780996995.057824:0:82689:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1780996995.057829:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780996995.057838:0:82689:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1780996995.057842:0:82689:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff968886bd8000) has no exports 00000004:01000000:3.0:1780996995.057988:0:82689:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1780996995.057996:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059516 00000020:00000080:3.0:1780996995.058000:0:82689:0:(genops.c:906:class_export_put()) final put ffff968983332800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1780996995.058004:0:82689:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1780996995.058007:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780996995.058012:0:82689:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1780996995.058014:0:82689:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff968990fe0000) has no exports 00000020:00000080:3.0:1780996995.058019:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305950f 00000020:00000080:3.0:1780996995.058022:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689868b9000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1780996995.058462:0:82689:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1780996995.058467:0:82689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1780996995.058471:0:82689:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 5 00000004:00080000:3.0:1780996995.058477:0:82689:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780996995.058479:0:82689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1780996995.058508:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780996995.058514:0:82689:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1780996995.058521:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c030594fa 00000020:00000080:3.0:1780996995.058525:0:82689:0:(genops.c:906:class_export_put()) final put ffff96898616f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1780996995.058529:0:82689:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1780996995.058532:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780996995.058535:0:82689:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1780996995.058658:0:82689:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9689bfb3b380) has no exports 00000020:00000080:3.0:1780996995.058663:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c030594f3 00000020:00000080:3.0:1780996995.058666:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689bcb9b000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1780996995.058956:0:82689:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1780996995.058959:0:82689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1780996995.058961:0:82689:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 5 00000004:00080000:3.0:1780996995.058965:0:82689:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780996995.058966:0:82689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1780996995.058990:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780996995.058995:0:82689:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1780996995.059004:0:82689:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1780996995.059009:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c030594de 00000020:00000080:3.0:1780996995.059013:0:82689:0:(genops.c:906:class_export_put()) final put ffff968987775000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1780996995.059016:0:82689:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1780996995.059019:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780996995.059022:0:82689:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1780996995.059024:0:82689:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9688858c19c0) has no exports 00000020:00000080:3.0:1780996995.059029:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c030594d7 00000020:00000080:3.0:1780996995.059031:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689bca5a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780996995.059244:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689869ca000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780996995.059253:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968990f72000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1780996995.059258:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968983332800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1780996995.059263:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689868b9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780996995.059293:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968983330800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1780996995.059299:0:13646:0:(genops.c:906:class_export_put()) final put ffff96898616d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780996995.059301:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96898616d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1780996995.059304:0:13646:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780996995.059379:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96898616f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1780996995.059384:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcb9b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780996995.059387:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bcb9d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1780996995.059390:0:13646:0:(genops.c:906:class_export_put()) final put ffff9689886b4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780996995.059392:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689886b4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1780996995.059395:0:13646:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780996995.059418:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968987775000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1780996995.059422:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bca5a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1780996995.066735:0:82689:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1780996995.066744:0:82689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780996995.066749:0:82689:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1780996995.066756:0:82689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780996995.066816:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780996995.066828:0:82689:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780996995.066857:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780996995.066860:0:82689:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780996995.066865:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689886b5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780996995.066870:0:82689:0:(genops.c:865:class_export_destroy()) destroying export ffff9689886b5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1780996995.066882:0:82689:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780996995.066985:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059498 00000020:00000080:2.0:1780996995.066991:0:82689:0:(genops.c:906:class_export_put()) final put ffff968990f71800/lustre-MDD0000_UUID 00000020:01000000:2.0:1780996995.066996:0:82689:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1780996995.067000:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780996995.067004:0:82689:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1780996995.067008:0:82689:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff968886bd99c0) has no exports 00000020:00000080:2.0:1780996995.067029:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780996995.067032:0:82689:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1780996995.067035:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305949f 00000020:00000080:2.0:1780996995.067038:0:82689:0:(genops.c:906:class_export_put()) final put ffff968990f70800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1780996995.067044:0:82689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689ba675000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1780996995.067047:0:82689:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689ba675000 3 00000020:01000004:2.0:1780996995.067051:0:82689:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9689ba675000 from lustre-MDT0000 00000020:00000080:2.0:1780996995.067067:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780996995.067070:0:82689:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1780996995.067072:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689869cb800/lustre-MDT0000_UUID 00000020:00000080:2.0:1780996995.067074:0:82689:0:(genops.c:865:class_export_destroy()) destroying export ffff9689869cb800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1780996995.067081:0:82689:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1780996995.067128:0:82689:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1780996995.067132:0:82689:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1780996995.067135:0:82689:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1780996995.067137:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780996995.067140:0:82689:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1780996995.067146:0:82689:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff968990f97000 bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780996995.067154:0:82689:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff968990f91800 5bc603cc-b633-43af-a003-872c004686c8 192.168.206.51@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780996995.067158:0:82689:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff96888ac53380) has exports, disconnecting them 00000020:00080000:2.0:1780996995.067161:0:82689:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff968990f97000), last request at 1780996958 00000020:00000080:2.0:1780996995.067180:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305944b 00000020:00010000:2.0:1780996995.067185:0:82689:0:(genops.c:1942:obd_stale_export_put()) Put export ffff968990f97000: total 2 00000100:00080000:2.0:1780996995.067189:0:82689:0:(import.c:65:import_set_state_nolock()) ffff968990f94800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780996995.067200:0:82689:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff968990f97000): rc 0 00000020:00080000:2.0:1780996995.067202:0:82689:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.206.51@tcp (ffff968990f91800), last request at 1780996957 00000020:00010000:2.0:1780996995.067243:0:37626:0:(genops.c:1928:obd_stale_export_get()) Get export ffff968990f97000: total 2 00010000:00010000:2.0:1780996995.067265:0:37626:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff968990f97000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1780996995.067311:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce2e00/0x30fd811c030595be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030595b7 expref: 14 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067330:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c0200/0x30fd811c030595a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305959b expref: 13 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067340:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03800/0x30fd811c03059620 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059619 expref: 12 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067350:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c1600/0x30fd811c030595b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030595a9 expref: 11 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067359:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c0800/0x30fd811c0305962e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059627 expref: 10 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067382:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2a00/0x30fd811c0305963c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059635 expref: 9 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067392:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c1c00/0x30fd811c030595cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030595c5 expref: 8 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067402:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c1e00/0x30fd811c030595da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030595d3 expref: 7 pid: 81488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067411:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c1000/0x30fd811c030595e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030595e1 expref: 6 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067421:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce3400/0x30fd811c030595f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030595ef expref: 5 pid: 81489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067430:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce3200/0x30fd811c03059612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305960b expref: 4 pid: 81493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067440:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c0600/0x30fd811c03059604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030595fd expref: 3 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067449:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c0a00/0x30fd811c03059594 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305958d expref: 2 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067456:0:37626:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff968990f97000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1780996995.067474:0:37626:0:(genops.c:906:class_export_put()) final put ffff968990f97000/bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 00010000:00010000:2.0:1780996995.067480:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996995.067482:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996995.067484:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1780996995.067501:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059444 00000020:00010000:2.0:1780996995.067505:0:82689:0:(genops.c:1942:obd_stale_export_put()) Put export ffff968990f91800: total 3 00000100:00080000:2.0:1780996995.067508:0:82689:0:(import.c:65:import_set_state_nolock()) ffff968990f92800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780996995.067518:0:82689:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.206.51@tcp (ffff968990f91800): rc 0 00000020:00080000:2.0:1780996995.067522:0:82689:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff96888ac53380) has no exports 00000020:00010000:2.0:1780996995.067529:0:14480:0:(genops.c:1928:obd_stale_export_get()) Get export ffff968990f91800: total 3 00010000:00010000:2.0:1780996995.067531:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996995.067550:0:14480:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff968990f91800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1780996995.067568:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2200/0x30fd811c0305956a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a8f expref: 5 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067581:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02e00/0x30fd811c03059578 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a9d expref: 4 pid: 81489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067593:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce3e00/0x30fd811c03059563 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a88 expref: 3 pid: 81492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067606:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb3600/0x30fd811c03059571 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8a96 expref: 2 pid: 81487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780996995.067616:0:14480:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff968990f91800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1780996995.067641:0:14480:0:(genops.c:906:class_export_put()) final put ffff968990f91800/5bc603cc-b633-43af-a003-872c004686c8 00010000:00010000:2.0:1780996995.067646:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996995.067647:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996995.067649:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996995.067713:0:81493:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff9689b790b600:81493] 4 exiting: rc = 0 00000100:00100000:1.0:1780996995.067717:0:81489:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff968889f84600:81489] 2 exiting: rc = 0 00000020:00000080:1.0:1780996995.067787:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bca5b800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1780996995.067810:0:13646:0:(genops.c:906:class_export_put()) final put ffff9689869cf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780996995.067813:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689869cf800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1780996995.067824:0:13646:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780996995.067875:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968990f71800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1780996995.067878:0:13646:0:(genops.c:906:class_export_put()) final put ffff9689868b8800/lustre-MDD0000_UUID 00000020:00000080:1.0:1780996995.067880:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689868b8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1780996995.067883:0:13646:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1780996995.067908:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968990f70800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780996995.067912:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968990f97000/bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 for MGS 00000100:00100000:2.0:1780996995.067946:0:81488:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff968888505600:81488] 1 exiting: rc = 0 00000020:00000080:1.0:1780996995.067955:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968990f91800/5bc603cc-b633-43af-a003-872c004686c8 for MGS 00000020:00000080:1.0:1780996995.067971:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968990f94800 for MGS 00000020:00000080:1.0:1780996995.067975:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968990f92800 for MGS 00000100:00100000:2.0:1780996995.067995:0:81492:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9689b790ba00:81492] 3 exiting: rc = 0 00000100:00100000:2.0:1780996995.068049:0:81487:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff96898457be00:81487] 0 exiting: rc = 1 00000100:00100000:2.0:1780996995.068104:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068118:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068124:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068130:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068136:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068143:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068148:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068153:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068159:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068164:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068169:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068174:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068180:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068185:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068190:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068195:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068201:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068207:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068213:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068218:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068223:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068228:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068233:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068238:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068244:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068249:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068254:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068260:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068265:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068287:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068294:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068299:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068305:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068311:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068316:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068321:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068334:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068339:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068346:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068351:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068357:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068362:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068367:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068373:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068378:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068384:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068389:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068395:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068401:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068407:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068413:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068419:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068424:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068430:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068434:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068440:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068445:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068451:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068456:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068464:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068471:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068478:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068483:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1780996995.068489:0:82689:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1780996995.071051:0:82689:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9689bb20e8a0 - data ffff9689ae230798/ffff9689a67cfc00 00000020:01000000:2.0:1780996995.071199:0:82689:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9689bb20e840 - data ffff968990b5abd0/ffff9688868e5400 00000020:00000080:2.0:1780996995.076448:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305943d 00000020:00000080:2.0:1780996995.076465:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689891af000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1780996995.076486:0:82689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689ba675000 from MGS, refs=2 00000020:01000004:2.0:1780996995.076490:0:82689:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689ba675000 2 00000020:01000004:2.0:1780996995.076512:0:82689:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9689ba675000 from MGS 00000020:00000080:2.0:1780996995.076536:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780996995.076555:0:82689:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1780996995.076560:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689891a8000/MGS 00000020:00000080:2.0:1780996995.076562:0:82689:0:(genops.c:865:class_export_destroy()) destroying export ffff9689891a8000/MGS for MGS 00000020:01000000:2.0:1780996995.076570:0:82689:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1780996995.076651:0:82689:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1780996995.076655:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780996995.076661:0:82689:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1780996995.076668:0:82689:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff96888969f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780996995.076674:0:82689:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9689aeba19c0) has exports, disconnecting them 00000020:00080000:2.0:1780996995.076680:0:82689:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff96888969f000), last request at 1780996958 00000020:00000080:2.0:1780996995.076684:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059555 00000020:00080000:2.0:1780996995.076701:0:82689:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96888969f000): rc 0 00000020:00000080:2.0:1780996995.076705:0:82689:0:(genops.c:906:class_export_put()) final put ffff96888969f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1780996995.076853:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689891af000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780996995.076868:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96888969f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1780996995.122945:0:82689:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1780996995.122953:0:82689:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1780996995.122957:0:82689:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1780996995.122965:0:82689:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1780996995.124296:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780996995.124638:0:82689:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1780996995.124649:0:82689:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689ba675000 1 00000020:00000080:3.0:1780996995.124655:0:82689:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305942f 00000020:00000080:3.0:1780996995.124663:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689891ae800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780996995.126707:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888969a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1780996995.126722:0:13646:0:(genops.c:906:class_export_put()) final put ffff96898d684000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1780996995.126725:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96898d684000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1780996995.126743:0:13646:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1780996995.127447:0:82689:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1780996995.127480:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780996995.127487:0:82689:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1780996995.127491:0:82689:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff968886ec19c0) has no exports 00000020:00000080:1.0:1780996995.127607:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689891ae800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780996995.249134:0:82689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780996995.249147:0:82689:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1780996995.249153:0:82689:0:(genops.c:906:class_export_put()) final put ffff9689ba676800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780996995.249157:0:82689:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba676800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1780996995.249163:0:82689:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1780996995.249534:0:82689:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9689ba677000 00000020:02000400:1.0:1780996995.249592:0:82689:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1780996995.813494:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780996996.837394:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780996997.545835:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126827136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780996997.545904:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780996997.546425:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126827136 00000100:00100000:1.0:1780996997.546439:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126827136 00000100:00100000:1.0:1780996997.546495:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:1.0:1780996997.546505:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126827136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780996997.546533:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780996997.546582:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126827136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996997.546589:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00080000:1.0:1780996997.546641:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780996997.546685:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126827136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780996997.551852:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126827264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780996997.551933:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780996997.552185:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126827264 00000100:00100000:3.0:1780996997.552195:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126827264 00000100:00100000:3.0:1780996997.552257:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965 00000100:00100000:3.0:1780996997.552266:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126827264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780996997.552413:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780996997.552460:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126827264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 195us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996997.552468:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965 00000100:00080000:1.0:1780996997.552582:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780996997.552633:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126827264:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1780996997.861445:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996998.885821:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780996999.915342:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1780996999.945334:0:3490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110339712 offset 0 length 224: 4 00000100:00100000:3.0:1780996999.945384:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996999.945496:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996999.946726:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110340224 00000100:00100000:1.0:1780996999.946741:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110340224 00000100:00080000:2.0:1780996999.946969:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780996999.947075:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2462 00000100:00100000:1.0:1780996999.947088:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110340224:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780996999.947170:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110340224:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 85us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1780996999.947179:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2462 00000100:00100000:1.0:1780996999.951338:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780996999.955508:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996999.955703:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110340096 00000100:00100000:3.0:1780996999.955714:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110340096 00000100:00100000:3.0:1780996999.955791:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2463 00000100:00100000:3.0:1780996999.955802:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110340096:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:1.0:1780996999.956059:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780996999.956135:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110339968 00000100:00100000:0.0:1780996999.956142:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110339968 00000100:00100000:0.0:1780996999.956190:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110339840 00000100:00100000:0.0:1780996999.956193:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110339840 00000100:00100000:0.0:1780996999.956214:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1115 00000100:00100000:0.0:1780996999.956222:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110339968:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780996999.956308:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110339968:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 87us (10923us total) trans 0 rc 0/0 00000100:00100000:0.0:1780996999.956315:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1115 00000100:00100000:0.0:1780996999.956332:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1114 00000100:00100000:0.0:1780996999.956336:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1867507110339840:12345-192.168.206.51@tcp:400:kworker.0 00000020:00080000:0.0:1780996999.956343:0:63417:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.206.51@tcp 00000100:00100000:0.0:1780996999.956366:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1867507110339840:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (5039us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780996999.956374:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1114 00000100:00080000:1.0:1780996999.956676:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780996999.956960:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110340096:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1158us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1780996999.956969:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2463 00000100:00100000:1.0:1780996999.961942:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780996999.963855:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110340352 00000100:00100000:3.0:1780996999.963874:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110340352 00000100:00100000:3.0:1780996999.963955:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1115 00000100:00100000:3.0:1780996999.963966:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1867507110340352:12345-192.168.206.51@tcp:38:ptlrpcd_01_01.0 00010000:00020000:3.0:1780996999.963999:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780996999.964079:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1867507110340352:12345-192.168.206.51@tcp:38:ptlrpcd_01_01.0 Request processed in 114us (2145us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780996999.964087:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1115 00000100:00080000:2.0:1780997000.101535:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997000.101544:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997000.101547:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997000.101555:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3522 00000100:00080000:2.0:1780997000.101561:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780997000.101567:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997000.101601:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b1008380 x1867507126827520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997000.101658:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997000.101662:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997000.101663:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997000.101668:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3522 00000100:00080000:2.0:1780997000.101671:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780997000.101675:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997000.101688:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfaab480 x1867507126827776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997000.101712:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997000.101715:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997000.101717:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997000.101720:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3522 00000100:00080000:2.0:1780997000.101723:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780997000.101727:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997000.101738:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968889179c00 x1867507126828032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997000.101759:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997000.101762:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997000.101764:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997000.101767:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3522 00000100:00080000:2.0:1780997000.101769:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780997000.101773:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997000.101781:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96888917bb80 x1867507126828416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997000.102001:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126827648:0@lo:400:kworker.0 00000100:00100000:0.0:1780997000.102080:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997000.102121:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1780997000.102127:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126827392:0@lo:400:kworker.0 00000400:00000100:0.0:1780997000.102147:0:3499:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126827392 offset 0 length 224: 4 00000100:00100000:0.0:1780997000.102168:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888917a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126828288:0@lo:400:kworker.0 00000100:00100000:0.0:1780997000.102193:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997000.102227:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126828288 00000100:00100000:0.0:1780997000.102234:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126828288 00000100:00100000:0.0:1780997000.102330:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464 00000100:00100000:0.0:1780997000.102340:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126828288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997000.102393:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126828288:12345-0@lo:400:kworker.0 Request processed in 55us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997000.102399:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464 00000100:00100000:0.0:1780997000.102445:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888917a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126828288:0@lo:400:kworker.0 00000100:00100000:0.0:1780997000.102468:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126827648 00000100:00100000:0.0:1780997000.102472:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126827648 00000100:00100000:0.0:1780997000.102500:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1780997000.102506:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126827648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997000.102554:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126827648:12345-0@lo:400:kworker.0 Request processed in 48us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997000.102560:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1780997000.102587:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126827648:0@lo:400:kworker.0 00000100:00100000:1.0:1780997000.102792:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126827520:0@lo:38:kworker.0 00000100:00100000:1.0:1780997000.102840:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997000.102867:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126827776:0@lo:38:kworker.0 00000100:00100000:1.0:1780997000.102889:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997000.102905:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126828032:0@lo:38:kworker.0 00000100:00100000:1.0:1780997000.102930:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997000.102946:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888917bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126828416:0@lo:38:kworker.0 00000100:00100000:1.0:1780997000.102965:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997000.102992:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126827904:0@lo:400:kworker.0 00000100:00100000:1.0:1780997000.103012:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997000.103029:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997000.103034:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126828160:0@lo:400:kworker.0 00000100:00100000:1.0:1780997000.103053:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997000.103080:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126828032 00000100:00100000:1.0:1780997000.103084:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126828032 00000100:00100000:1.0:1780997000.103104:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:1.0:1780997000.103108:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126828032:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997000.103132:0:23042:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997000.103169:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126828032:12345-0@lo:38:kworker.0 Request processed in 59us (238us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997000.103175:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00000100:00100000:1.0:1780997000.103198:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126827520 00000100:00100000:1.0:1780997000.103202:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126827520 00000100:00100000:1.0:1780997000.103217:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126827776 00000100:00100000:1.0:1780997000.103220:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126827776 00000100:00100000:1.0:1780997000.103229:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126828416 00000100:00100000:1.0:1780997000.103232:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126828416 00000100:00100000:1.0:1780997000.103249:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126827904 00000100:00100000:1.0:1780997000.103252:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126827904 00000100:00100000:1.0:1780997000.103292:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1780997000.103300:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126827904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997000.103352:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126827904:12345-0@lo:400:kworker.0 Request processed in 54us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997000.103358:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1780997000.103370:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:1.0:1780997000.103374:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126827520:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997000.103384:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997000.103406:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126827520:12345-0@lo:38:kworker.0 Request processed in 30us (566us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997000.103412:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:1.0:1780997000.103421:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1780997000.103426:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126827776:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997000.103434:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997000.103455:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126827776:12345-0@lo:38:kworker.0 Request processed in 28us (565us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997000.103460:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1780997000.103470:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1780997000.103473:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126828416:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997000.103482:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997000.103502:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126828416:12345-0@lo:38:kworker.0 Request processed in 28us (537us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997000.103507:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00080000:1.0:1780997000.103543:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997000.103547:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997000.103568:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126827904:0@lo:400:kworker.0 00000100:00080000:1.0:1780997000.103602:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997000.103607:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997000.103610:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126827520:0@lo:38:kworker.0 00000100:00080000:1.0:1780997000.103619:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997000.103622:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997000.103625:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126827776:0@lo:38:kworker.0 00000100:00080000:1.0:1780997000.103632:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997000.103634:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997000.103637:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126828032:0@lo:38:kworker.0 00000100:00080000:1.0:1780997000.103644:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997000.103647:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997000.103650:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888917bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126828416:0@lo:38:kworker.0 00000100:00100000:2.0:1780997000.104053:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126828160 00000100:00100000:2.0:1780997000.104059:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126828160 00000100:00100000:2.0:1780997000.104101:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465 00000100:00100000:2.0:1780997000.104108:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126828160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997000.104164:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126828160:12345-0@lo:400:kworker.0 Request processed in 57us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997000.104171:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465 00000100:00100000:2.0:1780997000.104200:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126828160:0@lo:400:kworker.0 00000100:00080000:1.0:1780997000.104535:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1780997000.623344:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780997000.623353:0:8226:0:(genops.c:906:class_export_put()) final put ffff968986140000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780997000.626754:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968986140000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1780997000.626832:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968986140800 for lustre-OST0000 00000001:00100000:0.0:1780997000.636832:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780997000.636842:0:9294:0:(genops.c:906:class_export_put()) final put ffff96888b410000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780997000.636944:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96888b410000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1780997000.637000:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888b416800 for lustre-OST0001 00000001:00100000:2.0:1780997000.639683:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1780997000.639697:0:72364:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378730 is committed 00000020:00000080:2.0:1780997000.639703:0:72364:0:(genops.c:906:class_export_put()) final put ffff968990cc0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780997000.639803:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968990cc0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1780997000.639877:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968990cc2000 for lustre-MDT0001 00010000:00010000:1.0:1780997000.934131:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997001.958124:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997002.661551:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a679b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126828544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997002.661637:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997002.661688:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126828672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997002.661734:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997002.661793:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126828544 00000100:00100000:2.0:1780997002.661802:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126828544 00000100:00100000:2.0:1780997002.661948:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126828672 00000100:00100000:2.0:1780997002.661952:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126828672 00000100:00100000:2.0:1780997002.661973:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:2.0:1780997002.661982:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126828544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997002.662012:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997002.662056:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126828544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997002.662064:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00100000:2.0:1780997002.662096:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:2.0:1780997002.662103:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126828672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780997002.662120:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997002.662224:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126828672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997002.662231:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000100:00100000:2.0:1780997002.662294:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126828672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997002.662500:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a679b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126828544:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1780997002.662637:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997002.662642:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780997002.981557:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997004.005599:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997005.029483:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997005.062475:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:0.0:1780997005.062537:0:3491:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110340480 offset 0 length 224: 4 00000100:00100000:0.0:1780997005.062556:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997005.062603:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997005.062654:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997005.062795:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110340736 00000100:00100000:2.0:1780997005.062810:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110340736 00000100:00100000:1.0:1780997005.062829:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110340608 00000100:00100000:1.0:1780997005.062837:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110340608 00000100:00100000:3.0:1780997005.062937:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110340864 00000100:00100000:3.0:1780997005.062941:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110340864 00000100:00100000:1.0:1780997005.063060:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1118 00000100:00100000:1.0:1780997005.063085:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110340736:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:0.0:1780997005.063207:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780997005.063213:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997005.063251:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110340992 00000100:00100000:3.0:1780997005.063256:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110340992 00000100:00100000:3.0:1780997005.063332:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5913 00000100:00100000:3.0:1780997005.063341:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2393:x1867507110340864:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:3.0:1780997005.063367:0:25168:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305987a 00000100:00080000:3.0:1780997005.063379:0:25168:0:(import.c:65:import_set_state_nolock()) ffff96888b417800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780997005.063438:0:25168:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:2.0:1780997005.065605:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1119 00000100:00100000:2.0:1780997005.065620:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2393:x1867507110340608:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:2.0:1780997005.065654:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997005.070115:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110340736:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 7013us (7632us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997005.070137:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1118 00000100:00100000:3.0:1780997005.070292:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+2:2393:x1867507110340864:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 6949us (7685us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997005.070304:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5913 00000100:00100000:3.0:1780997005.070335:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5914 00000100:00100000:3.0:1780997005.070357:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2393:x1867507110340992:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:3.0:1780997005.070401:0:25168:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059881 00000100:00080000:3.0:1780997005.070416:0:25168:0:(import.c:65:import_set_state_nolock()) ffff96888b412000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1780997005.071418:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2393:x1867507110340608:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 5788us (8850us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997005.071431:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1119 00010000:00010000:2.0:1780997005.071475:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997005.071526:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1780997005.072707:0:25168:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969449 00000100:00080000:0.0:1780997005.073372:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997005.073743:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+2:2393:x1867507110340992:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 3389us (11079us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997005.073758:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5914 00000100:00080000:0.0:1780997005.224362:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997005.224371:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997005.224375:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997005.224384:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3527 00000100:00080000:0.0:1780997005.224392:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780997005.224400:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997005.224431:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9688895f8e00 x1867507126828928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997005.224484:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997005.224497:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997005.224500:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997005.224504:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3527 00000100:00080000:0.0:1780997005.224507:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780997005.224511:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997005.224525:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba2e3800 x1867507126829184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997005.224543:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997005.224548:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997005.224549:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997005.224553:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3527 00000100:00080000:0.0:1780997005.224556:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780997005.224560:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997005.224607:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bff6dc00 x1867507126829440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997005.224635:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997005.224641:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997005.224643:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997005.224647:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3527 00000100:00080000:0.0:1780997005.224650:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780997005.224654:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997005.224665:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b1123b80 x1867507126829824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997005.224709:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126828928:0@lo:38:kworker.0 00000100:00100000:0.0:1780997005.224718:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126829056:0@lo:400:kworker.0 00000100:00100000:1.0:1780997005.224792:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126828800:0@lo:400:kworker.0 00000100:00100000:2.0:1780997005.224801:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126829568:0@lo:400:kworker.0 00000100:00100000:0.0:1780997005.225474:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997005.225606:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997005.225616:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126829312:0@lo:400:kworker.0 00000100:00100000:0.0:1780997005.225647:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997005.225688:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126829056 00000100:00100000:0.0:1780997005.225700:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126829056 00000100:00100000:0.0:1780997005.225771:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126829312 00000100:00100000:0.0:1780997005.225775:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126829312 00000100:00100000:0.0:1780997005.225801:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1780997005.225811:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126829056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997005.227694:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126829056:12345-0@lo:400:kworker.0 Request processed in 1871us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997005.227715:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1780997005.227760:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1780997005.227778:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126829312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997005.227939:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126829312:12345-0@lo:400:kworker.0 Request processed in 170us (2290us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997005.227947:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00080000:0.0:1780997005.227994:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997005.228047:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126829312:0@lo:400:kworker.0 00000100:00100000:0.0:1780997005.228062:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126829056:0@lo:400:kworker.0 00000100:00100000:3.0:1780997005.229191:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997005.229250:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126829184:0@lo:38:kworker.0 00000100:00100000:3.0:1780997005.229316:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997005.229343:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126829440:0@lo:38:kworker.0 00000100:00100000:3.0:1780997005.229373:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997005.229410:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126829824:0@lo:38:kworker.0 00000100:00100000:3.0:1780997005.229435:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997005.229489:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126829440 00000100:00100000:3.0:1780997005.229497:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126829440 00000100:00100000:0.0:1780997005.229601:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126828928 00000100:00100000:0.0:1780997005.229606:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126828928 00000100:00100000:3.0:1780997005.229612:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:3.0:1780997005.229619:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126829440:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1780997005.229631:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126829184 00000100:00100000:0.0:1780997005.229634:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126829184 00000100:00100000:0.0:1780997005.229646:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126829824 00000100:00100000:0.0:1780997005.229649:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126829824 00010000:00020000:3.0:1780997005.229660:0:80061:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997005.229662:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1780997005.229667:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126828928:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997005.229675:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997005.229711:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126829440:12345-0@lo:38:kworker.0 Request processed in 90us (335us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997005.229711:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126828928:12345-0@lo:38:kworker.0 Request processed in 41us (526us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997005.229719:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00100000:0.0:1780997005.229719:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1780997005.229736:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:0.0:1780997005.229740:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126829184:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997005.229749:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997005.229750:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1780997005.229755:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126829824:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997005.229764:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997005.229770:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126829184:12345-0@lo:38:kworker.0 Request processed in 30us (455us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997005.229776:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:3.0:1780997005.229784:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126829824:12345-0@lo:38:kworker.0 Request processed in 28us (349us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997005.229790:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00080000:3.0:1780997005.229825:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997005.229831:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997005.229834:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126828928:0@lo:38:kworker.0 00000100:00080000:3.0:1780997005.229844:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997005.229847:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997005.229850:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126829184:0@lo:38:kworker.0 00000100:00080000:3.0:1780997005.229858:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997005.229861:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997005.229864:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126829440:0@lo:38:kworker.0 00000100:00080000:3.0:1780997005.229881:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997005.229885:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997005.229888:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126829824:0@lo:38:kworker.0 00000400:00000100:1.0:1780997005.241617:0:3497:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126828800 offset 0 length 224: 4 00000100:00100000:1.0:1780997005.241696:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126829696:0@lo:400:kworker.0 00000100:00100000:1.0:1780997005.241754:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997005.241851:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126829696 00000100:00100000:3.0:1780997005.241863:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126829696 00000100:00100000:3.0:1780997005.241961:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466 00000100:00100000:3.0:1780997005.241974:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126829696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997005.242041:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126829696:12345-0@lo:400:kworker.0 Request processed in 70us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997005.242049:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466 00000100:00100000:2.0:1780997005.242152:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997005.242619:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997005.245498:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126829696:0@lo:400:kworker.0 00000100:00100000:3.0:1780997005.245715:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126829568 00000100:00100000:3.0:1780997005.245727:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126829568 00000100:00100000:3.0:1780997005.245954:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467 00000100:00100000:3.0:1780997005.245967:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888917bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126829568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997005.246092:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888917bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126829568:12345-0@lo:400:kworker.0 Request processed in 127us (3939us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997005.246100:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467 00000100:00100000:2.0:1780997005.246336:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126829568:0@lo:400:kworker.0 00000100:00080000:0.0:1780997005.246412:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1780997006.055518:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997007.078875:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997007.782465:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997007.782490:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126829952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997007.782578:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997007.782697:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126829952 00000100:00100000:0.0:1780997007.782706:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126829952 00000100:00100000:0.0:1780997007.782783:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:0.0:1780997007.782793:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126829952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997007.782827:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997007.782877:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126829952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997007.782885:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00100000:0.0:1780997007.782939:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126829952:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1780997007.783073:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997007.785533:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126830080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997007.785614:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997007.785723:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126830080 00000100:00100000:1.0:1780997007.785732:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126830080 00000100:00100000:1.0:1780997007.785823:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:1.0:1780997007.785834:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126830080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780997007.785873:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1780997007.786025:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997007.789459:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126830080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3618us (3834us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997007.789609:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:0.0:1780997007.790400:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126830080:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1780997008.102079:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997009.132625:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997010.155126:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997010.187234:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:0.0:1780997010.187297:0:3491:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110341120 offset 0 length 224: 4 00000100:00100000:0.0:1780997010.187390:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997010.187423:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110341248 00000100:00100000:0.0:1780997010.187433:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110341248 00000100:00100000:0.0:1780997010.187471:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110341376 00000100:00100000:0.0:1780997010.187474:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110341376 00000100:00100000:0.0:1780997010.187517:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1121 00000100:00100000:0.0:1780997010.187528:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110341376:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997010.187627:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110341376:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997010.187636:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1121 00000100:00100000:0.0:1780997010.187663:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1123 00000100:00100000:0.0:1780997010.187668:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1867507110341248:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:0.0:1780997010.187690:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997010.187719:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1867507110341248:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 49us (496us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997010.187725:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1123 00000100:00080000:2.0:1780997010.188054:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997010.342004:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997010.342012:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997010.342015:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997010.342024:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3532 00000100:00080000:3.0:1780997010.342039:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780997010.342045:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997010.342066:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6798000 x1867507126830336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997010.342100:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997010.342114:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997010.342116:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997010.342120:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3532 00000100:00080000:3.0:1780997010.342122:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780997010.342126:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997010.342139:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6799f80 x1867507126830592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997010.342162:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997010.342165:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997010.342167:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997010.342171:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3532 00000100:00080000:3.0:1780997010.342173:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780997010.342177:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997010.342188:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6799180 x1867507126830848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997010.342206:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997010.342209:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997010.342211:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997010.342214:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3532 00000100:00080000:3.0:1780997010.342216:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780997010.342219:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997010.342227:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a679a300 x1867507126831232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997010.342261:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126830336:0@lo:38:kworker.0 00000100:00100000:3.0:1780997010.342342:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997010.342370:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126830592:0@lo:38:kworker.0 00000100:00100000:3.0:1780997010.342391:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997010.342404:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126830848:0@lo:38:kworker.0 00000100:00100000:3.0:1780997010.342425:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997010.342441:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a679a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126831232:0@lo:38:kworker.0 00000100:00100000:3.0:1780997010.342462:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997010.342492:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a679b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126830720:0@lo:400:kworker.0 00000100:00100000:3.0:1780997010.342515:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997010.342531:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780997010.342549:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a679ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126830976:0@lo:400:kworker.0 00000100:00100000:3.0:1780997010.342573:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997010.342603:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126830336 00000100:00100000:3.0:1780997010.342609:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126830336 00000100:00100000:3.0:1780997010.342636:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126830592 00000100:00100000:3.0:1780997010.342639:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126830592 00000100:00100000:3.0:1780997010.342651:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126831232 00000100:00100000:3.0:1780997010.342654:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126831232 00000100:00100000:3.0:1780997010.342661:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126830720 00000100:00100000:3.0:1780997010.342663:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126830720 00000100:00100000:3.0:1780997010.342698:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1780997010.342706:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126830720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997010.342755:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126830720:12345-0@lo:400:kworker.0 Request processed in 50us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997010.342762:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1780997010.342787:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1780997010.342791:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126830336:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997010.342808:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997010.342843:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126830336:12345-0@lo:38:kworker.0 Request processed in 50us (502us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997010.342850:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1780997010.342861:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1780997010.342865:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126830592:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997010.342874:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997010.343084:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126830592:12345-0@lo:38:kworker.0 Request processed in 217us (692us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997010.343091:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1780997010.343104:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1780997010.343108:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126831232:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997010.343118:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997010.343145:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126831232:12345-0@lo:38:kworker.0 Request processed in 35us (681us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997010.343151:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1780997010.343170:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126830848 00000100:00100000:3.0:1780997010.343174:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126830848 00000100:00100000:3.0:1780997010.343193:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:3.0:1780997010.343198:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126830848:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997010.343208:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997010.343233:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126830848:12345-0@lo:38:kworker.0 Request processed in 34us (807us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997010.343249:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00100000:3.0:1780997010.343266:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126830976 00000100:00100000:3.0:1780997010.343289:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126830976 00000100:00100000:3.0:1780997010.343319:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468 00000100:00100000:3.0:1780997010.343325:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126830976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997010.343355:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126830976:12345-0@lo:400:kworker.0 Request processed in 31us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997010.343360:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468 00000100:00080000:3.0:1780997010.343378:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780997010.343382:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997010.343416:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a679ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126830976:0@lo:400:kworker.0 00000100:00100000:3.0:1780997010.343427:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a679b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126830720:0@lo:400:kworker.0 00000100:00080000:3.0:1780997010.343454:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997010.343459:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997010.343462:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126830336:0@lo:38:kworker.0 00000100:00080000:3.0:1780997010.343470:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997010.343473:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997010.343475:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126830592:0@lo:38:kworker.0 00000100:00080000:3.0:1780997010.343483:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997010.343485:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997010.343488:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126830848:0@lo:38:kworker.0 00000100:00080000:3.0:1780997010.343494:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997010.343497:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997010.343499:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a679a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126831232:0@lo:38:kworker.0 00000100:00100000:0.0:1780997010.343632:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126830208:0@lo:400:kworker.0 00000400:00000100:0.0:1780997010.343663:0:3496:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126830208 offset 0 length 224: 4 00000100:00100000:0.0:1780997010.343744:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126831104:0@lo:400:kworker.0 00000100:00100000:0.0:1780997010.343769:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997010.343790:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997010.343795:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126830464:0@lo:400:kworker.0 00000100:00100000:0.0:1780997010.343818:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997010.343855:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126830464 00000100:00100000:0.0:1780997010.343858:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126830464 00000100:00100000:0.0:1780997010.343904:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1780997010.343911:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126830464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997010.343949:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126830464:12345-0@lo:400:kworker.0 Request processed in 39us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997010.343955:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1780997010.343991:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126831104 00000100:00100000:0.0:1780997010.343995:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126831104 00000100:00100000:0.0:1780997010.344019:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2469 00000100:00100000:0.0:1780997010.344025:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adeddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126831104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997010.344067:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adeddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126831104:12345-0@lo:400:kworker.0 Request processed in 42us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997010.344082:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2469 00000100:00080000:0.0:1780997010.344101:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997010.344115:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997010.344133:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126830464:0@lo:400:kworker.0 00000100:00100000:0.0:1780997010.344143:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126831104:0@lo:400:kworker.0 00000001:00100000:3.0:1780997010.348779:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:3.0:1780997010.348788:0:9294:0:(genops.c:906:class_export_put()) final put ffff96888b411800/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:1.0:1780997010.348885:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96888b411800/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-OST0001 00000020:00000080:1.0:1780997010.348928:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888b412000 for lustre-OST0001 00000001:00100000:0.0:1780997010.354186:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:0.0:1780997010.354197:0:8226:0:(genops.c:906:class_export_put()) final put ffff96888b417000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:2.0:1780997010.354529:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96888b417000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-OST0000 00000020:00000080:2.0:1780997010.354595:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888b417800 for lustre-OST0000 00010000:00010000:0.0:1780997011.178623:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997012.200755:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997012.903932:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997012.903956:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126831360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997012.904027:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997012.904069:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126831360 00000100:00100000:1.0:1780997012.904083:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126831360 00000100:00100000:1.0:1780997012.904137:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:1.0:1780997012.904146:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126831360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997012.904176:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997012.904215:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126831360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997012.904222:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00080000:1.0:1780997012.904242:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997012.904294:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126831360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997012.906613:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126831488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997012.906677:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997012.906758:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126831488 00000100:00100000:1.0:1780997012.906768:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126831488 00000100:00100000:1.0:1780997012.906838:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:1.0:1780997012.906848:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888917a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126831488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780997012.906873:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1780997012.909319:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997012.913830:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888917a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126831488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6966us (7133us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997012.913848:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:2.0:1780997012.914059:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126831488:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1780997013.228670:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997014.247157:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997015.270498:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997015.304088:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997015.304139:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:3.0:1780997015.304170:0:3490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110341504 offset 0 length 224: 4 00000100:00100000:2.0:1780997015.304253:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110341760 00000100:00100000:2.0:1780997015.304266:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110341760 00000100:00100000:2.0:1780997015.304363:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110341632 00000100:00100000:2.0:1780997015.304367:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110341632 00000100:00100000:2.0:1780997015.304391:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1124 00000100:00100000:2.0:1780997015.304412:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110341760:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997015.304530:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110341760:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 129us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997015.304538:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1124 00000100:00100000:2.0:1780997015.304561:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1127 00000100:00100000:2.0:1780997015.304566:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1867507110341632:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:2.0:1780997015.304594:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997015.304625:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1867507110341632:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 57us (485us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997015.304632:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1127 00000100:00080000:3.0:1780997015.305166:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997015.467900:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997015.467922:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997015.467927:0:38:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997015.467939:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3537 00000100:00080000:2.0:1780997015.467946:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997015.467955:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997015.468088:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126831616:0@lo:400:kworker.0 00000100:00100000:2.0:1780997015.468560:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bce81c00 x1867507126831744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997015.468613:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997015.468617:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997015.468620:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997015.468624:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3537 00000100:00080000:2.0:1780997015.468627:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997015.468631:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997015.468645:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bce83100 x1867507126832000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1780997015.468766:0:3499:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126831616 offset 0 length 224: 4 00000100:00080000:2.0:1780997015.468895:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997015.468899:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997015.468901:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997015.468905:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3537 00000100:00080000:2.0:1780997015.468908:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997015.468912:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997015.468931:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfb48a80 x1867507126832256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997015.468970:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1780997015.469003:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126832512:0@lo:400:kworker.0 00000100:00100000:0.0:1780997015.469055:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997015.469081:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780997015.469087:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126832384:0@lo:400:kworker.0 00000100:00100000:0.0:1780997015.469108:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997015.469140:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126832512 00000100:00100000:0.0:1780997015.469150:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126832512 00000100:00100000:0.0:1780997015.469220:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126832384 00000100:00100000:0.0:1780997015.469231:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126832384 00000100:00100000:0.0:1780997015.469261:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470 00000100:00100000:0.0:1780997015.469305:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adeded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126832512:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1780997015.469346:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997015.469348:0:38:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997015.469352:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3537 00000100:00080000:2.0:1780997015.469355:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997015.469359:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997015.469369:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adeded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126832512:12345-0@lo:400:kworker.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997015.469376:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfb48e00 x1867507126832640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997015.469377:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470 00000100:00100000:0.0:1780997015.469397:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471 00000100:00100000:0.0:1780997015.469404:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126832384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997015.469557:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126832384:12345-0@lo:400:kworker.0 Request processed in 152us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997015.469570:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471 00000100:00100000:0.0:1780997015.469627:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126832384:0@lo:400:kworker.0 00000100:00100000:0.0:1780997015.469639:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126832512:0@lo:400:kworker.0 00000100:00100000:2.0:1780997015.469757:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126831872:0@lo:400:kworker.0 00000100:00100000:2.0:1780997015.469801:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997015.469839:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997015.469846:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126832128:0@lo:400:kworker.0 00000100:00100000:2.0:1780997015.469870:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997015.469900:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126831872 00000100:00100000:0.0:1780997015.469906:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126831872 00000100:00100000:2.0:1780997015.469909:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126832128 00000100:00100000:2.0:1780997015.469912:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126832128 00000100:00100000:0.0:1780997015.469951:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:0.0:1780997015.469959:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126831872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997015.470000:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126831872:12345-0@lo:400:kworker.0 Request processed in 43us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997015.470007:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:0.0:1780997015.470019:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1780997015.470025:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126832128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997015.470051:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126832128:12345-0@lo:400:kworker.0 Request processed in 27us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997015.470057:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00080000:3.0:1780997015.470125:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997015.470132:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780997015.470134:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997015.470149:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126831744:0@lo:38:kworker.0 00000100:00100000:3.0:1780997015.470183:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997015.470419:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126832000:0@lo:38:kworker.0 00000100:00100000:3.0:1780997015.470456:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997015.470493:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126831744 00000100:00100000:2.0:1780997015.470498:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126831744 00000100:00100000:2.0:1780997015.470534:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1780997015.470539:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126831744:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997015.470564:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997015.470605:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126831744:12345-0@lo:38:kworker.0 Request processed in 63us (421us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997015.470612:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1780997015.470619:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126832256:0@lo:38:kworker.0 00000100:00100000:2.0:1780997015.470622:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126832000 00000100:00100000:2.0:1780997015.470626:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126832000 00000100:00100000:3.0:1780997015.470652:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997015.470672:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126832640:0@lo:38:kworker.0 00000100:00100000:3.0:1780997015.470694:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780997015.471420:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997015.471488:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997015.471494:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126831744:0@lo:38:kworker.0 00000100:00100000:0.0:1780997015.471576:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126832640 00000100:00100000:0.0:1780997015.471582:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126832640 00000100:00100000:2.0:1780997015.471585:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1780997015.471592:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126832000:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997015.471629:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997015.471681:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:0.0:1780997015.471686:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126832640:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997015.471696:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997015.471737:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126832640:12345-0@lo:38:kworker.0 Request processed in 49us (1041us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997015.471744:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:3.0:1780997015.471877:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126832256 00000100:00100000:3.0:1780997015.471881:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126832256 00000100:00100000:3.0:1780997015.471945:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:3.0:1780997015.471950:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126832256:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997015.471961:0:80061:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997015.472001:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126832256:12345-0@lo:38:kworker.0 Request processed in 50us (1349us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997015.472007:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:2.0:1780997015.472064:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126832000:12345-0@lo:38:kworker.0 Request processed in 471us (1606us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997015.472071:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00080000:3.0:1780997015.472072:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997015.472075:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997015.472078:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126832000:0@lo:38:kworker.0 00000100:00080000:3.0:1780997015.472089:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997015.472092:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997015.472095:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126832256:0@lo:38:kworker.0 00000100:00080000:3.0:1780997015.472103:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997015.472106:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997015.472109:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126832640:0@lo:38:kworker.0 00000100:00100000:0.0:1780997015.472570:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126832128:0@lo:400:kworker.0 00000100:00100000:0.0:1780997015.472600:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126831872:0@lo:400:kworker.0 00010000:00010000:3.0:1780997016.296793:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1780997016.388836:0:3489:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110341888 offset 0 length 520: 4 00000100:00100000:3.0:1780997016.391514:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997016.391643:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110342144 00000100:00100000:2.0:1780997016.391657:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110342144 00000100:00100000:2.0:1780997016.391735:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1127 00000100:00100000:2.0:1780997016.391747:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110342144:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997016.391860:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110342144:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 104us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997016.391869:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1127 00000100:00100000:1.0:1780997016.399172:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997016.399246:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110342016 00000100:00100000:3.0:1780997016.399261:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110342016 00000100:00100000:3.0:1780997016.399349:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1131 00000100:00100000:3.0:1780997016.399361:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110342016:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:3.0:1780997016.399403:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997016.399661:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110342016:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 299us (506us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997016.399670:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1131 00000100:00000400:1.0:1780997016.487625:0:3499:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780997000/real 1780997000] req@ffff9689bc86d180 x1867507126827392/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997016 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997016.487661:0:3499:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9689bc86d180 x1867507126827392/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997016 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997016.487687:0:3499:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1780997016.487691:0:3499:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1780997016.487695:0:3499:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.151@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1780997016.487698:0:3499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1780997016.487702:0:3499:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689bc86d180 x1867507126827392/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997016 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997016.487711:0:3499:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689b100b800 x1867507126828800/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997016.487725:0:3499:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689a6799500 x1867507126830208/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997026 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997016.487742:0:3499:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689bce83b80 x1867507126831616/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997031 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1780997016.487751:0:3499:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1780997016.487754:0:3499:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1780997016.487755:0:3499:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1780997016.487757:0:3499:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1780997016.487784:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126831616:0@lo:400:kworker.0 00000100:00100000:1.0:1780997016.487790:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126827392:0@lo:400:kworker.0 00000100:00100000:0.0:1780997016.487871:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126830208:0@lo:400:kworker.0 00000100:00100000:2.0:1780997016.487935:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126828800:0@lo:400:kworker.0 00000100:00080000:1.0:1780997016.488012:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997016.488018:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1780997016.488021:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997016.488026:0:13646:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3486 00000100:00080000:1.0:1780997016.488037:0:13646:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997016.488074:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc86d180 x1867507126832768/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997016.488176:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126832768:0@lo:250:kworker.0 00000400:00000100:2.0:1780997016.488234:0:3495:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126832768 offset 0 length 520: 4 00000100:00080000:1.0:1780997016.488363:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997016.488376:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997016.488379:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997016.488383:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3543 00000100:00080000:1.0:1780997016.488386:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997016.488390:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997016.488408:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc957b80 x1867507126832896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997016.488525:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126833024:0@lo:400:kworker.0 00000100:00100000:0.0:1780997016.488566:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780997016.488604:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997016.488608:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997016.488610:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997016.488614:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3543 00000100:00080000:1.0:1780997016.488617:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997016.488621:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997016.488634:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc955180 x1867507126833152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997016.488690:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126833024 00000100:00100000:2.0:1780997016.488700:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126833024 00000100:00100000:2.0:1780997016.488752:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1780997016.488761:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126833024:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1780997016.493998:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997016.494013:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997016.494020:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997016.494031:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3543 00000100:00080000:1.0:1780997016.494039:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997016.494049:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997016.494133:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc955500 x1867507126833408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997016.494209:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997016.494232:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997016.494234:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997016.494239:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3543 00000100:00080000:1.0:1780997016.494242:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997016.494246:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997016.494262:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc956300 x1867507126833792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997016.494338:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126833664:0@lo:400:kworker.0 00000100:00100000:1.0:1780997016.494672:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997016.494733:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780997016.494740:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126833536:0@lo:400:kworker.0 00000100:00100000:1.0:1780997016.494767:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997016.494988:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126833024:12345-0@lo:400:kworker.0 Request processed in 6224us (6418us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997016.495004:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1780997016.495072:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126833664 00000100:00100000:2.0:1780997016.495083:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126833664 00000100:00100000:2.0:1780997016.495137:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126833536 00000100:00100000:2.0:1780997016.495140:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126833536 00000100:00100000:2.0:1780997016.495178:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:2.0:1780997016.495188:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126833664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997016.495254:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126833664:12345-0@lo:400:kworker.0 Request processed in 67us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997016.495261:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000100:00100000:2.0:1780997016.495295:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473 00000100:00100000:2.0:1780997016.495303:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126833536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997016.495335:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126833536:12345-0@lo:400:kworker.0 Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997016.495342:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473 00000100:00100000:2.0:1780997016.495373:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126833280:0@lo:400:kworker.0 00000100:00100000:2.0:1780997016.495407:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997016.495888:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126833280 00000100:00100000:2.0:1780997016.495893:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126833280 00000100:00100000:2.0:1780997016.495925:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1780997016.495932:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126833280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997016.495973:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126833280:12345-0@lo:400:kworker.0 Request processed in 41us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997016.495980:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1780997016.496035:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126833280:0@lo:400:kworker.0 00000100:00100000:2.0:1780997016.496069:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126832896:0@lo:38:kworker.0 00000100:00100000:2.0:1780997016.496102:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997016.496124:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126833152:0@lo:38:kworker.0 00000100:00100000:2.0:1780997016.496149:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997016.496170:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126833408:0@lo:38:kworker.0 00000100:00100000:2.0:1780997016.496208:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997016.496231:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126833792:0@lo:38:kworker.0 00000100:00100000:2.0:1780997016.496254:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997016.496308:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126832896 00000100:00100000:2.0:1780997016.496312:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126832896 00000100:00100000:2.0:1780997016.496330:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126833152 00000100:00100000:2.0:1780997016.496332:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126833152 00000100:00100000:2.0:1780997016.496341:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126833792 00000100:00100000:2.0:1780997016.496343:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126833792 00000100:00100000:2.0:1780997016.496355:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1780997016.496360:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126832896:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997016.496383:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997016.496420:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126832896:12345-0@lo:38:kworker.0 Request processed in 58us (316us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997016.497523:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1780997016.497559:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1780997016.497568:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126833152:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997016.497593:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997016.497650:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126833152:12345-0@lo:38:kworker.0 Request processed in 81us (1499us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997016.497657:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1780997016.497670:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1780997016.497674:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126833792:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997016.497686:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997016.497712:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126833792:12345-0@lo:38:kworker.0 Request processed in 37us (1457us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997016.497728:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1780997016.497760:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126833408 00000100:00100000:2.0:1780997016.497769:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126833408 00000100:00100000:2.0:1780997016.497938:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:2.0:1780997016.497943:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126833408:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997016.497955:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997016.497986:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126833408:12345-0@lo:38:kworker.0 Request processed in 42us (1778us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997016.497993:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00000100:00080000:2.0:1780997016.498061:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997016.498069:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997016.498073:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126832896:0@lo:38:kworker.0 00000100:00080000:2.0:1780997016.498084:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997016.498088:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997016.498091:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126833152:0@lo:38:kworker.0 00000100:00080000:2.0:1780997016.498101:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997016.498258:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997016.498261:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126833408:0@lo:38:kworker.0 00000100:00080000:2.0:1780997016.498513:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997016.498519:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997016.498522:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126833792:0@lo:38:kworker.0 00000100:00100000:2.0:1780997016.498588:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126833536:0@lo:400:kworker.0 00000100:00100000:2.0:1780997016.498607:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126833664:0@lo:400:kworker.0 00000100:00100000:0.0:1780997016.499253:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126833024:0@lo:400:kworker.0 00010000:00010000:1.0:1780997017.317608:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997018.025025:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997018.025055:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126833920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997018.025134:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997018.025245:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126833920 00000100:00100000:3.0:1780997018.025255:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126833920 00000100:00100000:3.0:1780997018.025349:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:3.0:1780997018.025369:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126833920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997018.025397:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1780997018.025518:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997018.026443:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126833920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1071us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997018.026453:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1780997018.026612:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126833920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997018.027514:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126834048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997018.027560:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997018.027643:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126834048 00000100:00100000:3.0:1780997018.027651:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126834048 00000100:00100000:3.0:1780997018.027698:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:3.0:1780997018.027706:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126834048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997018.027732:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997018.034572:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126834048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6857us (7001us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997018.034589:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00080000:0.0:1780997018.035350:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997018.035675:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126834048:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780997018.347068:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997019.372551:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1780997019.900076:0:83311:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1780997019.900083:0:83311:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1780997019.900084:0:83311:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1780997019.900197:0:83311:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9689a5872000 00000020:01000004:2.0:1780997019.900216:0:83311:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1780997019.900232:0:83311:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1780997019.900248:0:83311:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff968990fe4d40) 00000020:00000080:2.0:1780997019.901643:0:83311:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1780997020.063474:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1780997020.063798:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1780997020.068230:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1780997020.068873:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1780997020.069088:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1780997020.070108:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1780997020.071228:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1780997020.072976:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1780997020.073838:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1780997020.074089:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1780997020.074636:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1780997020.075061:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1780997020.075262:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1780997020.075563:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1780997020.076939:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1780997020.087362:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1780997020.087636:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1780997020.088027:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1780997020.088294:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1780997020.088944:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1780997020.089201:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.089867:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1780997020.092048:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.092892:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1780997020.093167:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.093515:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.093821:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.094020:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.094212:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.094593:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.095011:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1780997020.095820:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1780997020.096131:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1780997020.096914:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1780997020.097241:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.097806:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.098013:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1780997020.098209:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1780997020.098508:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.098912:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1780997020.101030:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.101657:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1780997020.101965:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.102216:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1780997020.102504:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1780997020.102831:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1780997020.103079:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1780997020.104165:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1780997020.104774:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1780997020.105308:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1780997020.106104:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1780997020.106321:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1780997020.106551:0:83311:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:3.0:1780997020.107129:0:83311:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1780997020.107405:0:83311:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1780997020.107413:0:83311:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1780997020.107423:0:83311:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c030599ca 00000020:01000004:3.0:1780997020.107428:0:83311:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1780997020.107439:0:83311:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1780997020.107444:0:83311:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9689a5872000 from MGS 00000020:01000004:3.0:1780997020.107457:0:83311:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1780997020.107467:0:83311:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9689aeba3380) 00000020:00000080:3.0:1780997020.107489:0:83311:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1780997020.107553:0:83311:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689a5872000 from MGS, refs=2 00080000:01000000:3.0:1780997020.107558:0:83311:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1780997020.107563:0:83311:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c030599d8 00010000:00010000:3.0:1780997020.107689:0:83311:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1780997020.120547:0:83311:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1780997020.122621:0:83315:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1780997020.123544:0:83311:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1780997020.123609:0:83311:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1780997020.124779:0:83311:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1780997020.125035:0:83311:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1780997020.125207:0:83311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1780997020.125214:0:83311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1780997020.138799:0:83311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1780997020.138812:0:83311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1780997020.145509:0:83311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1780997020.145525:0:83311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1780997020.147244:0:83311:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1780997020.147332:0:83311:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1780997020.147335:0:83311:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1780997020.147339:0:83311:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1780997020.147345:0:83311:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96898d0e6000 already not connected (conn 65, was 0): CONNECTING 00000100:00100000:3.0:1780997020.147351:0:83311:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00010000:00010000:3.0:1780997020.391036:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997021.413450:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997021.443928:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997021.444034:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110342400 00000100:00100000:3.0:1780997021.444046:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110342400 00000100:00100000:3.0:1780997021.444119:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1130 00000100:00100000:3.0:1780997021.444131:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110342400:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997021.444220:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110342400:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 92us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997021.444227:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1130 00000100:00080000:0.0:1780997021.444293:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997021.444740:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997021.444808:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110342272 00000100:00100000:2.0:1780997021.444816:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110342272 00000100:00100000:2.0:1780997021.444853:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1135 00000100:00100000:2.0:1780997021.444859:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110342272:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:2.0:1780997021.444879:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997021.444922:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110342272:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 62us (183us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997021.444949:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1135 00000100:00080000:1.0:1780997021.606080:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997021.606090:0:13646:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1780997021.606093:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997021.606097:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997021.606100:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997021.606108:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3544 00000100:00080000:1.0:1780997021.606113:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997021.606119:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997021.606158:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc954380 x1867507126834176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997021.606226:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997021.606245:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997021.606247:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997021.606250:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3544 00000100:00080000:1.0:1780997021.606253:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997021.606256:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997021.606267:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780997021.606284:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc957480 x1867507126834432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997021.606301:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997021.606304:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997021.606305:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1780997021.606306:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126834304:0@lo:400:kworker.0 00000100:00080000:1.0:1780997021.606309:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3544 00000100:00080000:1.0:1780997021.606311:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997021.606315:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997021.606325:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc956d80 x1867507126834688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997021.606356:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997021.606360:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997021.606361:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997021.606364:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3544 00000100:00080000:1.0:1780997021.606366:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997021.606370:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997021.606378:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc956680 x1867507126835072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997021.606400:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997021.606419:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126834816:0@lo:400:kworker.0 00000100:00100000:0.0:1780997021.606444:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126834560:0@lo:400:kworker.0 00000100:00100000:0.0:1780997021.606464:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997021.606520:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126834304 00000100:00100000:0.0:1780997021.606528:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126834304 00000100:00100000:1.0:1780997021.606677:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997021.606685:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126834560 00000100:00100000:0.0:1780997021.606689:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126834560 00000100:00100000:1.0:1780997021.606700:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997021.606705:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126834944:0@lo:400:kworker.0 00000100:00100000:1.0:1780997021.606729:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997021.606729:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:0.0:1780997021.606738:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126834304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997021.606756:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126834816 00000100:00100000:1.0:1780997021.606759:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126834816 00000100:00100000:1.0:1780997021.606785:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126834944 00000100:00100000:1.0:1780997021.606788:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126834944 00000100:00100000:0.0:1780997021.606804:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126834304:12345-0@lo:400:kworker.0 Request processed in 68us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997021.606808:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474 00000100:00100000:0.0:1780997021.606813:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1780997021.606815:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126834816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997021.606828:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1780997021.606833:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126834560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997021.606848:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126834816:12345-0@lo:400:kworker.0 Request processed in 34us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997021.606854:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474 00000100:00100000:0.0:1780997021.606855:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126834560:12345-0@lo:400:kworker.0 Request processed in 23us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997021.606865:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475 00000100:00100000:0.0:1780997021.606867:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1780997021.606870:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126834944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997021.606897:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126834944:12345-0@lo:400:kworker.0 Request processed in 26us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997021.606903:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475 00000100:00080000:0.0:1780997021.606922:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997021.606925:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780997021.606927:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997021.606936:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126834944:0@lo:400:kworker.0 00000100:00100000:0.0:1780997021.606942:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126834560:0@lo:400:kworker.0 00000100:00100000:1.0:1780997021.606946:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126834816:0@lo:400:kworker.0 00000100:00100000:0.0:1780997021.606967:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126834304:0@lo:400:kworker.0 00000100:00100000:1.0:1780997021.606995:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126834176:0@lo:38:kworker.0 00000100:00100000:1.0:1780997021.607020:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997021.607044:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126834432:0@lo:38:kworker.0 00000100:00100000:1.0:1780997021.607063:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997021.607077:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126834688:0@lo:38:kworker.0 00000100:00100000:1.0:1780997021.607108:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997021.607124:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126835072:0@lo:38:kworker.0 00000100:00100000:1.0:1780997021.607142:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997021.607179:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126834176 00000100:00100000:1.0:1780997021.607182:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126834176 00000100:00100000:1.0:1780997021.607201:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126834432 00000100:00100000:1.0:1780997021.607203:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126834432 00000100:00100000:3.0:1780997021.607212:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126835072 00000100:00100000:1.0:1780997021.607214:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1780997021.607215:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126835072 00000100:00100000:1.0:1780997021.607218:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126834176:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1780997021.607229:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1780997021.607233:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126834432:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997021.607236:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1780997021.607241:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997021.607291:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126834176:12345-0@lo:38:kworker.0 Request processed in 48us (247us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997021.607298:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1780997021.607300:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126834688 00000100:00100000:0.0:1780997021.607304:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126834688 00000100:00100000:1.0:1780997021.607309:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:1.0:1780997021.607313:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126835072:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997021.607323:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997021.607323:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:0.0:1780997021.607328:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126834688:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997021.607336:0:23042:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997021.614215:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126835072:12345-0@lo:38:kworker.0 Request processed in 6885us (7057us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997021.614235:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:0.0:1780997021.615011:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126834688:12345-0@lo:38:kworker.0 Request processed in 7677us (7897us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997021.615023:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00080000:2.0:1780997021.615038:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997021.615047:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997021.615053:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126834176:0@lo:38:kworker.0 00000100:00080000:2.0:1780997021.615078:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997021.615081:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997021.615084:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126834432:0@lo:38:kworker.0 00000100:00080000:2.0:1780997021.615097:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997021.615101:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997021.615104:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126834688:0@lo:38:kworker.0 00000100:00080000:2.0:1780997021.615117:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997021.615121:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997021.615124:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126835072:0@lo:38:kworker.0 00000100:00100000:3.0:1780997021.615784:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126834432:12345-0@lo:38:kworker.0 Request processed in 8544us (8714us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997021.615819:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00010000:00010000:2.0:1780997022.437571:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997023.142061:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126835328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997023.142068:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126835200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997023.142144:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997023.142234:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997023.142304:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126835200 00000100:00100000:3.0:1780997023.142312:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126835200 00000100:00100000:3.0:1780997023.142367:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126835328 00000100:00100000:3.0:1780997023.142371:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126835328 00000100:00100000:3.0:1780997023.142391:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:3.0:1780997023.142400:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126835200:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997023.142411:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:1.0:1780997023.142422:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126835328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997023.142434:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1780997023.142442:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997023.142497:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126835328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997023.142522:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00080000:0.0:1780997023.142539:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997023.142546:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997023.142576:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126835328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780997023.142718:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126835200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 318us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997023.142725:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:1.0:1780997023.142833:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126835200:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1780997023.461455:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997024.487416:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997025.509390:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997026.535061:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997026.563840:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997026.566314:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997026.570869:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997026.570931:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110342784 00000100:00100000:0.0:1780997026.570941:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110342784 00000100:00100000:0.0:1780997026.570981:0:83317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1780997026.570990:0:83317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2393:x1867507110342784:12345-192.168.206.51@tcp:250:kworker.0 00010000:00080000:0.0:1780997026.571017:0:83317:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 5bc603cc-b633-43af-a003-872c004686c8@192.168.206.51@tcp t0 exp 0000000000000000 cur 3554 last 0 00000020:00000080:0.0:1780997026.571045:0:83317:0:(genops.c:1406:class_connect()) connect: client 5bc603cc-b633-43af-a003-872c004686c8, cookie 0x30fd811c030599df 00000100:00080000:0.0:1780997026.571219:0:83317:0:(import.c:65:import_set_state_nolock()) ffff96888b417800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997026.571328:0:83317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+4:2393:x1867507110342784:12345-192.168.206.51@tcp:250:kworker.0 Request processed in 337us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997026.571337:0:83317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1780997026.574335:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110342656 00000100:00100000:2.0:1780997026.574350:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110342656 00000100:00080000:0.0:1780997026.574685:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997026.575895:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110342528 00000100:00100000:2.0:1780997026.575907:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110342528 00000100:00100000:2.0:1780997026.578944:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1133 00000100:00100000:2.0:1780997026.578968:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110342656:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997026.579061:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110342656:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 104us (15230us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.579082:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1133 00000100:00100000:2.0:1780997026.579104:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1139 00000100:00100000:2.0:1780997026.579108:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2393:x1867507110342528:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:2.0:1780997026.579130:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997026.579155:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2393:x1867507110342528:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 45us (12895us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997026.579161:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1139 00000100:00100000:2.0:1780997026.725627:0:3495:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780997016/real 1780997016] req@ffff9689bc86d180 x1867507126832768/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780997026 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997026.725664:0:3495:0:(client.c:2511:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9689bc86d180 x1867507126832768/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780997026 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780997026.725683:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997026.725710:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1780997026.725731:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126832768:0@lo:250:kworker.0 00000100:00080000:3.0:1780997026.726315:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997026.726322:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1780997026.726325:0:38:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997026.726331:0:38:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3544 00000100:00080000:3.0:1780997026.726336:0:38:0:(import.c:591:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1780997026.726343:0:38:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997026.726385:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6798e00 x1867507126835456/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997026.726407:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997026.726410:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997026.726412:0:38:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997026.726415:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3549 00000100:00080000:3.0:1780997026.726418:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780997026.726436:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997026.726751:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6799500 x1867507126835584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1780997026.726752:0:83311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1780997026.726770:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c03059627 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305962e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997026.726782:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c03059627 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305962e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.726788:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00080000:3.0:1780997026.726791:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997026.726796:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997026.726799:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:0.0:1780997026.726799:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:3.0:1780997026.726805:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3549 00000100:00080000:3.0:1780997026.726808:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00010000:00010000:0.0:1780997026.726811:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c03059627 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305962e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1780997026.726814:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00010000:00010000:0.0:1780997026.726835:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3000/0x30fd811c0305958d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059594 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997026.726841:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3000/0x30fd811c0305958d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059594 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.726847:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997026.726850:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997026.726854:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3000/0x30fd811c0305958d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059594 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.726862:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1a00/0x30fd811c030595a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030595b0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997026.726869:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1a00/0x30fd811c030595a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030595b0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997026.726891:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bce80700 x1867507126835840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1780997026.726896:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997026.726904:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997026.726909:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1a00/0x30fd811c030595a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030595b0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1780997026.726918:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:0.0:1780997026.726922:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968983ce2a00/0x30fd811c030595d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030595da expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1780997026.726923:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997026.726928:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997026.726934:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3549 10000000:00010000:0.0:1780997026.726935:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968983ce2a00/0x30fd811c030595d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030595da expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1780997026.726939:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 10000000:01000000:0.0:1780997026.726945:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:3.0:1780997026.726947:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00010000:00010000:0.0:1780997026.726958:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997026.726963:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968983ce2a00/0x30fd811c030595d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030595da expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997026.726965:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bce81c00 x1867507126836096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1780997026.726985:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03c00/0x30fd811c030595e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030595e8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997026.726994:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03c00/0x30fd811c030595e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030595e8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.727001:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997026.727005:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997026.727009:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03c00/0x30fd811c030595e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030595e8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.727019:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3e00/0x30fd811c030595fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059604 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1780997026.727021:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997026.727029:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997026.727031:0:38:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997026.727035:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3549 00000100:00080000:3.0:1780997026.727040:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 10000000:00010000:0.0:1780997026.727045:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3e00/0x30fd811c030595fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059604 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1780997026.727054:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 10000000:01000000:0.0:1780997026.727054:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997026.727062:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997026.727067:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3e00/0x30fd811c030595fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059604 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997026.727073:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfaad180 x1867507126836480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1780997026.727078:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305960b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059612 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997026.727103:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305960b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059612 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.727109:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997026.727113:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:3.0:1780997026.727118:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126836224:0@lo:400:kworker.0 00010000:00010000:0.0:1780997026.727118:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305960b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059612 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.727132:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3200/0x30fd811c03059635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305963c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997026.727139:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3200/0x30fd811c03059635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305963c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.727145:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997026.727148:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997026.727152:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3200/0x30fd811c03059635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305963c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.727174:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1400/0x30fd811c0305959b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030595a2 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997026.727181:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1400/0x30fd811c0305959b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030595a2 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.727187:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997026.727191:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997026.727195:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1400/0x30fd811c0305959b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030595a2 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.727205:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030595b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030595be expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997026.727210:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030595b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030595be expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.727214:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997026.727217:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997026.727220:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030595b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030595be expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.727228:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c030595c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030595cc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997026.727421:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c030595c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030595cc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.727429:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780997026.727465:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997026.727470:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c030595c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030595cc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.727479:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1200/0x30fd811c030595ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c030595f6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997026.727485:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1200/0x30fd811c030595ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c030595f6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.727490:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780997026.727493:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997026.727496:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1200/0x30fd811c030595ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c030595f6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.727505:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2800/0x30fd811c03059619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059620 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997026.727511:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2800/0x30fd811c03059619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059620 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.727517:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780997026.727520:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997026.727524:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2800/0x30fd811c03059619 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059620 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1780997026.727540:0:83311:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96898d0e6000 already not connected (conn 66, was 0): CONNECTING 00000100:00080000:0.0:1780997026.727544:0:83311:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1780997026.727945:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997026.727961:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126835968:0@lo:400:kworker.0 00000100:00100000:3.0:1780997026.727992:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780997026.728001:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126836352:0@lo:400:kworker.0 00000100:00100000:1.0:1780997026.728009:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997026.728037:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780997026.728043:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997026.728049:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126835712:0@lo:400:kworker.0 00000100:00100000:1.0:1780997026.728077:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997026.728080:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126836224 00000100:00100000:3.0:1780997026.728088:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126836224 00000100:00100000:3.0:1780997026.728142:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126836352 00000100:00100000:3.0:1780997026.728145:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126836352 00000100:00100000:3.0:1780997026.728170:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:3.0:1780997026.728179:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126836224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997026.728489:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:2.0:1780997026.728499:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126836352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997026.728557:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126836352:12345-0@lo:400:kworker.0 Request processed in 59us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.728563:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00100000:2.0:1780997026.728588:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126835456:0@lo:250:kworker.0 00000100:00100000:2.0:1780997026.728622:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.728646:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126835584:0@lo:38:kworker.0 00000100:00100000:2.0:1780997026.728680:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.728698:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126835840:0@lo:38:kworker.0 00000100:00100000:2.0:1780997026.728718:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997026.730161:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126836224:12345-0@lo:400:kworker.0 Request processed in 1976us (2959us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997026.730174:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00080000:3.0:1780997026.730668:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997026.730674:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997026.730721:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126835456 00000100:00100000:3.0:1780997026.730729:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126835456 00000100:00100000:3.0:1780997026.730773:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1780997026.730779:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3495:x1867507126835456:12345-0@lo:250:kworker.0 00010000:00080000:3.0:1780997026.730806:0:83319:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo t0 exp 0000000000000000 cur 3554 last 0 00000020:00000080:3.0:1780997026.731066:0:83319:0:(genops.c:1406:class_connect()) connect: client bdcd4e03-8d56-43b8-bfda-3b2f97e67d18, cookie 0x30fd811c030599e6 00000100:00080000:3.0:1780997026.731205:0:83319:0:(import.c:65:import_set_state_nolock()) ffff9688888d3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780997026.731267:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:3495:x1867507126835456:12345-0@lo:250:kworker.0 Request processed in 487us (2644us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997026.731311:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1780997026.731376:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126836352:0@lo:400:kworker.0 00000100:00100000:3.0:1780997026.731390:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126836224:0@lo:400:kworker.0 00000100:00100000:2.0:1780997026.736643:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126836096:0@lo:38:kworker.0 00000100:00100000:2.0:1780997026.737365:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.737392:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126836480:0@lo:38:kworker.0 00000100:00100000:2.0:1780997026.737419:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997026.749591:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126835968 00000100:00100000:0.0:1780997026.749610:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126835968 00000100:00080000:0.0:1780997026.750078:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997026.750140:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 10000000:01000000:2.0:1780997026.750154:0:3495:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00100000:0.0:1780997026.750161:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126835712 00000100:02000400:2.0:1780997026.750162:0:3495:0:(import.c:1286:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x30fd811c030599e6 00000100:00100000:0.0:1780997026.750169:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126835712 00000100:00100000:0.0:1780997026.750199:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126835584 00000100:00100000:0.0:1780997026.750203:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126835584 00000100:00100000:0.0:1780997026.750214:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126835840 00000100:00100000:0.0:1780997026.750217:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126835840 00000100:00100000:0.0:1780997026.750225:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126836480 00000100:00100000:0.0:1780997026.750227:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126836480 00000100:00100000:0.0:1780997026.750240:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1780997026.750251:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126835968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997026.750368:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126835968:12345-0@lo:400:kworker.0 Request processed in 118us (22362us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997026.750376:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1780997026.750395:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1780997026.750460:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126835712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997026.750492:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126835712:12345-0@lo:400:kworker.0 Request processed in 92us (22416us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997026.750498:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1780997026.750512:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1780997026.750516:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126835584:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997026.750537:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997026.750567:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126835584:12345-0@lo:38:kworker.0 Request processed in 49us (21886us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997026.750573:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1780997026.750598:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1780997026.750602:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126835840:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997026.750612:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997026.750652:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126835840:12345-0@lo:38:kworker.0 Request processed in 48us (21932us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997026.750658:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1780997026.750750:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1780997026.750754:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126836480:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997026.750886:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997026.751109:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126836096 00000100:00100000:3.0:1780997026.751116:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126836096 00000100:00100000:0.0:1780997026.751141:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126836480:12345-0@lo:38:kworker.0 Request processed in 383us (13719us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997026.751148:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:3.0:1780997026.751155:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126836096:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1780997026.751156:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00010000:00020000:3.0:1780997026.751172:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1780997026.751178:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997026.751345:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126835712:0@lo:400:kworker.0 00000100:00100000:3.0:1780997026.751520:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126836096:12345-0@lo:38:kworker.0 Request processed in 364us (14155us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997026.751597:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00000100:00100000:0.0:1780997026.751655:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126835968:0@lo:400:kworker.0 00000100:00080000:2.0:1780997026.761060:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:2.0:1780997026.761079:0:3495:0:(import.c:1675:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:0.0:1780997026.765753:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126835456:0@lo:250:kworker.0 00000100:00080000:0.0:1780997026.765796:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997026.765801:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997026.765804:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126835584:0@lo:38:kworker.0 00000100:00080000:0.0:1780997026.765815:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997026.765818:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997026.765821:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126835840:0@lo:38:kworker.0 00000100:00080000:0.0:1780997026.765833:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997026.765837:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997026.765840:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126836096:0@lo:38:kworker.0 00000100:00080000:0.0:1780997026.765853:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997026.765878:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997026.765881:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126836480:0@lo:38:kworker.0 00000100:00080000:0.0:1780997026.765934:0:83311:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:0.0:1780997026.765945:0:83311:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1780997026.765991:0:83311:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1780997026.765998:0:83311:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1780997026.766110:0:83311:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1780997026.766142:0:83311:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1780997026.766146:0:83311:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1780997026.766148:0:83311:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780997026.766149:0:83311:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997026.766151:0:83311:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997026.766152:0:83311:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997026.766153:0:83311:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997026.766155:0:83311:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997026.766156:0:83311:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780997026.766158:0:83311:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997026.766159:0:83311:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1780997026.766162:0:83311:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1780997026.766164:0:83311:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1780997026.766165:0:83311:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780997026.766166:0:83311:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997026.766167:0:83311:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997026.766168:0:83311:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997026.766169:0:83311:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997026.766170:0:83311:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997026.766171:0:83311:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780997026.766172:0:83311:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997026.766173:0:83311:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1780997026.766197:0:83311:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1780997026.766213:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886f21b40 going to sleep for 0 seconds 00000100:00100000:0.0:1780997026.766218:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126836608:0@lo:253:mount.lustre.0 00000020:00080000:0.0:1780997026.766231:0:83311:0:(tgt_mount.c:1425:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:0.0:1780997026.766240:0:83311:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9689a5872000 from lustre-MDT0000 10000000:01000000:0.0:1780997026.766265:0:83311:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1780997026.766267:0:83311:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1780997026.766301:0:83311:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9689a5872000 10000000:01000000:0.0:1780997026.766306:0:83311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1780997026.766310:0:83311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9689a5872000 10000000:01000000:0.0:1780997026.766312:0:83311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1780997026.766315:0:83311:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9689a5872000 from 1 10000000:01000000:0.0:1780997026.766318:0:83311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1780997026.766345:0:83311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c030599ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.766355:0:83311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c030599ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.766363:0:83311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c030599ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997026.766386:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886f219c0 going to sleep for 0 seconds 00000100:00100000:0.0:1780997026.766390:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126836736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780997026.766399:0:83311:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c030599ed lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.766406:0:83311:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c030599ed lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.766412:0:83311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c030599ed lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.766419:0:83311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c030599ed lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.766448:0:83311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c030599ed lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.766456:0:83311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02200 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:0.0:1780997026.766459:0:83311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c030599ed lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.766467:0:83311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c030599ed lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997026.766474:0:83311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c030599ed lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.766478:0:83311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997026.766481:0:83311:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997026.766487:0:83311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c030599ed lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.766493:0:83311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c030599ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.766508:0:83311:0:(mgc_request.c:1818:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:0.0:1780997026.766510:0:83311:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:3.0:1780997026.766565:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level EVICTED/10 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997026.766570:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1780997026.769350:0:83321:0:(import.c:1599:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.206.151@tcp to MGS@0@lo 00000100:00100000:2.0:1780997026.769357:0:83321:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1780997026.769374:0:83321:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:2.0:1780997026.769397:0:83321:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:2.0:1780997026.769404:0:83321:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from RECOVER to FULL 10000000:01000000:2.0:1780997026.769406:0:83321:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1780997026.769451:0:83321:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:2.0:1780997026.769454:0:83321:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) MGC192.168.206.151@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:1.0:1780997026.769651:0:38:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.206.151@tcp 10000000:01000000:1.0:1780997026.769683:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1780997026.769686:0:38:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1780997026.769688:0:38:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1780997026.769689:0:38:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997026.769691:0:38:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997026.769692:0:38:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997026.769693:0:38:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997026.769695:0:38:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1780997026.769697:0:38:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997026.769698:0:38:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1780997026.769762:0:38:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1780997026.769770:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1780997026.769772:0:38:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1780997026.769773:0:38:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1780997026.769774:0:38:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997026.769776:0:38:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997026.769777:0:38:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997026.769778:0:38:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997026.769779:0:38:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1780997026.769780:0:38:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997026.769787:0:38:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1780997026.769801:0:38:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1780997026.769806:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1780997026.769808:0:38:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1780997026.769810:0:38:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1780997026.769811:0:38:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997026.769812:0:38:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997026.769813:0:38:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997026.769814:0:38:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997026.769815:0:38:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780997026.769816:0:38:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997026.769817:0:38:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1780997026.769836:0:38:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1780997026.769863:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780997026.769868:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126836992:0@lo:253:kworker.0 00000100:00100000:1.0:1780997026.769881:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126837120:0@lo:253:kworker.0 10000000:01000000:0.0:1780997026.770029:0:83311:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9689a5872000 from 1 10000000:01000000:0.0:1780997026.770033:0:83311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1780997026.770061:0:83311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.770074:0:83311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.770095:0:83311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997026.770110:0:83311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126837248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780997026.770770:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126836864:0@lo:253:kworker.0 00000100:00100000:1.0:1780997026.771367:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997026.771385:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997026.771460:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126837120 00000100:00100000:1.0:1780997026.771467:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126836992 00000100:00100000:3.0:1780997026.771468:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126837120 00000100:00100000:1.0:1780997026.771474:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126836992 00000100:00100000:3.0:1780997026.771521:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1780997026.771529:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1780997026.771535:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:3499:x1867507126837120:12345-0@lo:253:kworker.0 00000100:00100000:1.0:1780997026.771542:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:3497:x1867507126836992:12345-0@lo:253:kworker.0 00000100:00100000:0.0:1780997026.771570:0:83311:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:3.0:1780997026.771572:0:83319:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1780997026.771584:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886f219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997026.771681:0:83317:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1780997026.771690:0:83317:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 10000000:01000000:3.0:1780997026.771770:0:83322:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:2.0:1780997026.771770:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:3.0:1780997026.771876:0:83319:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 104 00000100:00100000:2.0:1780997026.771990:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126837248 00000100:00100000:2.0:1780997026.771994:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126837248 00000100:00100000:2.0:1780997026.772016:0:83317:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1780997026.772021:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126836864 00000100:00100000:2.0:1780997026.772024:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126836864 20000000:01000000:3.0:1780997026.774471:0:83324:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1780997026.774488:0:83324:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1780997026.774491:0:83324:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1780997026.774494:0:83324:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1780997026.774734:0:83324:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1780997026.774897:0:83318:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1780997026.775171:0:83319:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1780997026.775189:0:83319:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1780997026.775707:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1780997026.775721:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:83311:x1867507126837248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997026.775738:0:83323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997026.775758:0:83323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c0c00/0x30fd811c030599fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c030599f4 expref: -99 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.775784:0:83323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c0c00/0x30fd811c030599fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c030599f4 expref: 8 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.775796:0:83323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c0c00/0x30fd811c030599fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c030599f4 expref: 8 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.775815:0:83323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0c00, rc 0) 00000100:00100000:1.0:1780997026.776087:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:83311:x1867507126837248:12345-0@lo:101:mount.lustre.0 Request processed in 370us (4516us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997026.776094:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1780997026.776127:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1780997026.776134:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3496:x1867507126836864:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1780997026.776156:0:83323:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:0.0:1780997026.776233:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126837248:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780997026.776356:0:83311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.776366:0:83311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.776385:0:83311:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1780997026.776401:0:83311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.776409:0:83311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.776417:0:83311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1780997026.776421:0:83311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1780997026.776427:0:83311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9689a5872000 10000000:01000000:0.0:1780997026.776430:0:83311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1780997026.776433:0:83311:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1780997026.776436:0:83311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1780997026.776477:0:83311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.776484:0:83311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.776493:0:83311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997026.776514:0:83311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126837376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780997026.776553:0:83311:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997026.776712:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886f219c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997026.776929:0:83317:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:2.0:1780997026.776938:0:83317:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:2.0:1780997026.777151:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126837376 00000100:00100000:2.0:1780997026.777158:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126837376 00000100:00100000:0.0:1780997026.777450:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1780997026.777459:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:83311:x1867507126837376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780997026.777469:0:83325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997026.777482:0:83325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff02200/0x30fd811c03059a09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059a02 expref: -99 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.777501:0:83325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02200/0x30fd811c03059a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059a02 expref: 9 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.777509:0:83325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff02200/0x30fd811c03059a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059a02 expref: 9 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.777516:0:83325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02200, rc 0) 00000100:00100000:0.0:1780997026.777603:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83311:x1867507126837376:12345-0@lo:101:mount.lustre.0 Request processed in 144us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997026.777609:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1780997026.777924:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126837376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997026.777941:0:83311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.777950:0:83311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997026.778020:0:83311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126837504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997026.778055:0:83311:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.778179:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886bae600 going to sleep for 11 seconds 00000100:00100000:3.0:1780997026.778216:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126837504 00000100:00100000:3.0:1780997026.778222:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126837504 00000100:00100000:3.0:1780997026.778301:0:83317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1780997026.778310:0:83317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83311:x1867507126837504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780997026.778467:0:83317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83311:x1867507126837504:12345-0@lo:501:mount.lustre.0 Request processed in 159us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997026.778476:0:83317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1780997026.778566:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126837504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997026.778595:0:83311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126837632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997026.778635:0:83311:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:1.0:1780997026.780156:0:83319:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1780997026.780170:0:83319:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1780997026.780425:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:3499:x1867507126837120:12345-0@lo:253:kworker.0 Request processed in 8893us (9058us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997026.780437:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1780997026.780733:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886bae600 going to sleep for 11 seconds 20000000:01000000:2.0:1780997026.780750:0:83322:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1780997026.780755:0:83322:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1780997026.780776:0:83322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689ba454600/0x30fd811c03059a10 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.780793:0:83322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454600/0x30fd811c03059a10 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1780997026.780802:0:83322:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000049165s 00010000:00010000:2.0:1780997026.780807:0:83322:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689ba454600/0x30fd811c03059a10 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.780828:0:83322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689ba454600/0x30fd811c03059a10 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.780834:0:83322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689ba454600/0x30fd811c03059a10 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.780842:0:83322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689ba454600/0x30fd811c03059a10 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.780847:0:83322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997026.780850:0:83322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689ba454600/0x30fd811c03059a10 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.780859:0:83322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689ba454600/0x30fd811c03059a10 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.780873:0:83322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689ba454600/0x30fd811c03059a10 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.780880:0:83322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689ba454600/0x30fd811c03059a10 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.780886:0:83322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba454600/0x30fd811c03059a10 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997026.781012:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126837632 00000100:00100000:0.0:1780997026.781027:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126837632 20000000:01000000:0.0:1780997026.781050:0:83318:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1780997026.781330:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1780997026.781338:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83311:x1867507126837632:12345-0@lo:503:mount.lustre.0 00000020:01000004:2.0:1780997026.781495:0:3499:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1780997026.781498:0:3499:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1780997026.781499:0:3499:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780997026.781500:0:3499:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780997026.781502:0:3499:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780997026.781503:0:3499:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780997026.781505:0:3499:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780997026.781513:0:3499:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780997026.781514:0:3499:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1780997026.781517:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126837120:0@lo:253:kworker.0 00000100:00100000:0.0:1780997026.782583:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83311:x1867507126837632:12345-0@lo:503:mount.lustre.0 Request processed in 1243us (3944us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997026.782596:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 20000000:01000000:0.0:1780997026.785948:0:83318:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1780997026.785969:0:83318:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1780997026.786227:0:83322:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1780997026.786233:0:83322:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1780997026.786266:0:83322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689a56c9200/0x30fd811c03059a17 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997026.786311:0:83322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c9200/0x30fd811c03059a17 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780997026.786321:0:83322:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000089653s 00010000:00010000:3.0:1780997026.786327:0:83322:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689a56c9200/0x30fd811c03059a17 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997026.786335:0:83322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689a56c9200/0x30fd811c03059a17 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997026.786343:0:83322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689a56c9200/0x30fd811c03059a17 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997026.786347:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:3497:x1867507126836992:12345-0@lo:253:kworker.0 Request processed in 14803us (14957us total) trans 0 rc 0/0 00010000:00010000:3.0:1780997026.786351:0:83322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689a56c9200/0x30fd811c03059a17 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997026.786360:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1780997026.786379:0:83322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997026.786384:0:83322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689a56c9200/0x30fd811c03059a17 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997026.786392:0:83322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689a56c9200/0x30fd811c03059a17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997026.786405:0:83322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689a56c9200/0x30fd811c03059a17 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997026.786413:0:83322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689a56c9200/0x30fd811c03059a17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997026.786420:0:83322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c9200/0x30fd811c03059a17 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1780997026.786459:0:3497:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1780997026.786462:0:3497:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1780997026.786463:0:3497:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997026.786464:0:3497:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997026.786465:0:3497:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997026.786467:0:3497:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997026.786468:0:3497:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780997026.786470:0:3497:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997026.786472:0:3497:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1780997026.786475:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126836992:0@lo:253:kworker.0 20000000:01000000:1.0:1780997026.786604:0:83323:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1780997026.786974:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126837632:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780997026.788840:0:83326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83326:1867507126837760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997026.788926:0:83326:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997026.789009:0:83326:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688874993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997026.791826:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126837760 00000100:00100000:1.0:1780997026.791841:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126837760 00000100:00100000:0.0:1780997026.791985:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1780997026.791997:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:83326:x1867507126837760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997026.792998:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:83326:x1867507126837760:12345-0@lo:502:llog_process_th.0 Request processed in 998us (4067us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997026.793018:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1780997026.793206:0:83326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83326:1867507126837760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780997026.793244:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997026.793259:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997026.793262:0:83326:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1780997026.793453:0:83326:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1780997026.793458:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780997026.793475:0:83326:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff96888ac519c0) 00000020:00000080:1.0:1780997026.793499:0:83326:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:1.0:1780997026.793507:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1780997026.793590:0:83326:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1780997026.793597:0:83326:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c03059a25 00000020:00000080:1.0:1780997026.793802:0:83326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1780997026.793807:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997026.793817:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997026.793818:0:83326:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1780997026.793822:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997026.793825:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997026.793826:0:83326:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1780997026.793829:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780997026.793837:0:83326:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff96888ac53380) 00000020:00000080:1.0:1780997026.793849:0:83326:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:1.0:1780997026.793853:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1780997026.793855:0:83326:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1780997026.793858:0:83326:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1780997026.793864:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1780997026.793910:0:83326:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689a5872000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1780997026.793921:0:83326:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff96888ac50000) 00000020:00000080:1.0:1780997026.793931:0:83326:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:1.0:1780997026.793983:0:83326:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1780997026.793988:0:83326:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c03059a3a 00000020:00000080:1.0:1780997026.794357:0:83326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1780997026.794422:0:83326:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1780997026.794429:0:83326:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x30fd811c03059a41 00080000:01000000:1.0:1780997026.794434:0:83326:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1780997026.794447:0:83326:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c03059a48 20000000:01000000:3.0:1780997026.796726:0:83323:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1780997026.796751:0:83323:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1780997026.796880:0:83322:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1780997026.796886:0:83322:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1780997026.796908:0:83322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689ba454600/0x30fd811c03059a4f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.796925:0:83322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454600/0x30fd811c03059a4f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1780997026.796934:0:83322:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000089653s 00010000:00010000:2.0:1780997026.796938:0:83322:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689ba454600/0x30fd811c03059a4f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.796944:0:83322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689ba454600/0x30fd811c03059a4f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.796950:0:83322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689ba454600/0x30fd811c03059a4f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.796957:0:83322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689ba454600/0x30fd811c03059a4f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.796963:0:83322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997026.796968:0:83322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689ba454600/0x30fd811c03059a4f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.796974:0:83322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689ba454600/0x30fd811c03059a4f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.797001:0:83322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689ba454600/0x30fd811c03059a4f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.797009:0:83322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689ba454600/0x30fd811c03059a4f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.797014:0:83322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba454600/0x30fd811c03059a4f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997026.797380:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3496:x1867507126836864:12345-0@lo:253:kworker.0 Request processed in 21242us (25606us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997026.797390:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:2.0:1780997026.797501:0:3496:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1780997026.797503:0:3496:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1780997026.797505:0:3496:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780997026.797506:0:3496:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780997026.797507:0:3496:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780997026.797509:0:3496:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780997026.797510:0:3496:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780997026.797512:0:3496:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780997026.797514:0:3496:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1780997026.797517:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126836864:0@lo:253:kworker.0 00010000:00010000:2.0:1780997026.880899:0:83326:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1780997026.881043:0:83326:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 285c134c-d3a6-4c01-bb4d-8148c50d5f95 idx: 0 lr: 94489280519 srv lr: 98784247808 lx: 0 gen 22 00000001:00080000:2.0:1780997026.881085:0:83326:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 21 00000001:00000004:2.0:1780997026.881111:0:83326:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:2.0:1780997026.881215:0:83326:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1780997026.881355:0:83326:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff968886bae540: xid 1867507110335744, transno 98784247812, client gen 22, slot idx 0 00000001:00080000:2.0:1780997026.881507:0:83326:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff968886bae240: xid 1867507110335488, transno 98784247811, client gen 22, slot idx 1 00000020:00000080:2.0:1780997026.881990:0:83326:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff968990fe19c0) 00000020:00000080:2.0:1780997026.882013:0:83326:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:2.0:1780997026.882084:0:83326:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1780997026.882097:0:83326:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c03059a6b 00000020:00000080:2.0:1780997026.886824:0:83326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1780997026.890215:0:83326:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x30fd811c03059a72 00000020:00000080:2.0:1780997026.890701:0:83326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1780997026.890712:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997026.890719:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997026.890722:0:83326:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1780997026.890724:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1780997026.890727:0:83326:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1780997026.890729:0:83326:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780997026.890730:0:83326:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780997026.890731:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1780997026.890733:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997026.890734:0:83326:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1780997026.890736:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780997026.890740:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997026.890741:0:83326:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1780997026.890745:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1780997026.890783:0:83326:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1780997026.890798:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997026.890800:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997026.890801:0:83326:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1780997026.890804:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780997026.890806:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997026.890808:0:83326:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1780997026.890810:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1780997026.890816:0:83326:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:00000080:2.0:1780997026.890837:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1780997026.890852:0:83326:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff968990fe0000) 00000020:00000080:2.0:1780997026.890870:0:83326:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1780997026.890875:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1780997026.890930:0:83326:0:(osp_dev.c:1197:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1780997026.890936:0:83326:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1780997026.890942:0:83326:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c03059a80 00010000:00080000:2.0:1780997026.890972:0:83326:0:(ldlm_lib.c:102:import_set_conn()) imp ffff968990f72000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:2.0:1780997026.893257:0:83326:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1780997026.894324:0:83326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997026.894338:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1780997026.895087:0:83326:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1780997026.895110:0:83326:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c03059a87 00000100:00080000:0.0:1780997026.895121:0:83326:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1780997026.895126:0:83326:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff968990f72000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997026.895240:0:83326:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689adedd180 x1867507126837888/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997026.895284:0:83326:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1780997026.895395:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997026.895399:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997026.895402:0:83326:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1780997026.895405:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1780997026.895408:0:83326:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1780997026.895410:0:83326:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780997026.895411:0:83326:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780997026.895413:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1780997026.895415:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997026.895417:0:83326:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1780997026.895419:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1780997026.895424:0:83326:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1780997026.895427:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997026.895428:0:83326:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1780997026.895431:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1780997026.895434:0:83326:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:0.0:1780997026.895465:0:83326:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1780997026.895468:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780997026.895486:0:83326:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff968886ec3380) 00000020:00000080:0.0:1780997026.895504:0:83326:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1780997026.895510:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1780997026.895577:0:83326:0:(osp_dev.c:1197:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1780997026.895583:0:83326:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1780997026.895588:0:83326:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c03059a95 00000100:00100000:2.0:1780997026.895591:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126838016:0@lo:400:kworker.0 00010000:00080000:0.0:1780997026.895616:0:83326:0:(ldlm_lib.c:102:import_set_conn()) imp ffff968990cc2000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00000100:00100000:2.0:1780997026.895657:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.895716:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126838016 00000100:00100000:2.0:1780997026.895723:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126838016 00000100:00100000:2.0:1780997026.895758:0:83317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1780997026.895766:0:83317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3499:x1867507126838016:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1780997026.895790:0:83326:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1780997026.895812:0:83317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3499:x1867507126838016:12345-0@lo:400:kworker.0 Request processed in 46us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.895819:0:83317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1780997026.895862:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126838016:0@lo:400:kworker.0 00000100:00100000:3.0:1780997026.895948:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126837888:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780997026.895986:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.896521:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126837888 00000100:00100000:2.0:1780997026.896527:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126837888 00000100:00100000:2.0:1780997026.896548:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:2.0:1780997026.896552:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126837888:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1780997026.896572:0:80061:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3554 last 0 00000020:00000080:2.0:1780997026.896599:0:80061:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c03059a9c 00000004:00100000:2.0:1780997026.896611:0:80061:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1780997026.896698:0:80061:0:(import.c:65:import_set_state_nolock()) ffff96898d685800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997026.896742:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126837888:12345-0@lo:38:llog_process_th.0 Request processed in 189us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.896749:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00000100:00100000:2.0:1780997026.896780:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780997026.896787:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:2.0:1780997026.896794:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1780997026.896799:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1780997026.896807:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968990f72000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1780997026.896815:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126837888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780997026.896862:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126838144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997026.896886:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.896926:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126838144 00000100:00100000:2.0:1780997026.896930:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126838144 00000100:00100000:2.0:1780997026.896953:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:2.0:1780997026.896959:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126838144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780997026.896981:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1780997026.897014:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126838144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.897020:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00000100:00100000:2.0:1780997026.897050:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126838144:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1780997026.899530:0:83326:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1780997026.899557:0:83326:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1780997026.899809:0:83326:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:2.0:1780997026.901881:0:83326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780997026.901913:0:83326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:2.0:1780997026.902051:0:83326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000040:00080000:2.0:1780997026.902938:0:83332:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:2.0:1780997026.902944:0:83332:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1780997026.903081:0:83332:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1780997026.903098:0:83332:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1780997026.903209:0:83332:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:2.0:1780997026.903212:0:83332:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1780997026.904250:0:83326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997026.904568:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1780997026.904618:0:83326:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1780997026.904643:0:83326:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c03059aa3 00000100:00080000:1.0:1780997026.904654:0:83326:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780997026.904661:0:83326:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff968990cc2000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997026.904702:0:83326:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc954380 x1867507126838272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997026.904762:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126838272:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1780997026.904840:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997026.904920:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126838272 00000100:00100000:0.0:1780997026.904928:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126838272 00000100:00100000:0.0:1780997026.904961:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5915 00000100:00100000:0.0:1780997026.904968:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3495:x1867507126838272:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1780997026.904994:0:25171:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3554 last 0 00000020:00000080:0.0:1780997026.905020:0:25171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c03059aaa 00002000:00100000:0.0:1780997026.905033:0:25171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9689ba676800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1780997026.905038:0:25171:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1780997026.905041:0:25171:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1780997026.905105:0:25171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1780997026.905129:0:25171:0:(import.c:65:import_set_state_nolock()) ffff9689ba675000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1780997026.905182:0:83326:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1780997026.905251:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997026.905264:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997026.905267:0:83326:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1780997026.905287:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780997026.905290:0:83326:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1780997026.905302:0:83326:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997026.905305:0:83326:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997026.905307:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780997026.905310:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997026.905312:0:83326:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780997026.905315:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1780997026.905319:0:83326:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1780997026.905322:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997026.905324:0:83326:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1780997026.905327:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780997026.905331:0:83326:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:1.0:1780997026.905351:0:83326:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1780997026.905354:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780997026.905378:0:83326:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96888ac54d40) 00000020:00000080:1.0:1780997026.905395:0:83326:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:1.0:1780997026.905400:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1780997026.905478:0:83326:0:(osp_dev.c:1197:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1780997026.905484:0:83326:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1780997026.905490:0:83326:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c03059ab8 00010000:00080000:1.0:1780997026.905516:0:83326:0:(ldlm_lib.c:102:import_set_conn()) imp ffff968983330800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1780997026.905707:0:83326:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1780997026.905774:0:83326:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1780997026.905789:0:83326:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1780997026.906312:0:83326:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000040:00080000:1.0:1780997026.906835:0:83326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780997026.906858:0:83326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:1.0:1780997026.906994:0:83326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000100:00100000:0.0:1780997026.907745:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126838272:12345-0@lo:8:llog_process_th.0 Request processed in 2769us (2898us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997026.907758:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5915 00000100:00100000:2.0:1780997026.907974:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780997026.907985:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1780997026.907998:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1780997026.908002:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1780997026.908006:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968990cc2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1780997026.908060:0:3495:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:2.0:1780997026.908067:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126838272:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1780997026.908119:0:83332:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1780997026.908170:0:83332:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3554453899009ns, next at 0ns, rc = 0 00080000:00080000:0.0:1780997026.908176:0:83332:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1780997026.909809:0:83312:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1780997026.909977:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126838400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780997026.910043:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997026.910145:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126838400 00000100:00100000:1.0:1780997026.910161:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126838400 00000100:00100000:1.0:1780997026.910223:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:1.0:1780997026.910233:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126838400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780997026.910259:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1780997026.910370:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1780997026.910756:0:83334:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:0.0:1780997026.910762:0:83334:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1780997026.910955:0:83334:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:0.0:1780997026.910993:0:83334:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1780997026.911124:0:83334:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:0.0:1780997026.911127:0:83334:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1780997026.912047:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126838400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1812us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997026.912058:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:2.0:1780997026.912225:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126838400:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1780997026.913105:0:83326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997026.913118:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1780997026.913154:0:83326:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1780997026.913171:0:83326:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c03059abf 00000100:00080000:1.0:1780997026.913178:0:83326:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780997026.913183:0:83326:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff968983330800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997026.913214:0:83326:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc955880 x1867507126838528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997026.913293:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126838528:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780997026.913352:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780997026.913519:0:83326:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1780997026.913568:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997026.913571:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997026.913573:0:83326:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1780997026.913575:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997026.913579:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997026.913580:0:83326:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1780997026.913582:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1780997026.913584:0:83326:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1780997026.913585:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997026.913587:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997026.913588:0:83326:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1780997026.913590:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997026.913592:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997026.913593:0:83326:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1780997026.913616:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1780997026.913641:0:83326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83326:1867507126838656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997026.913684:0:83326:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997026.913699:0:83326:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a5f5d600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997026.913717:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126838656 00000100:00100000:1.0:1780997026.913721:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126838656 00000100:00100000:1.0:1780997026.913753:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1780997026.913761:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:83326:x1867507126838656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997026.913859:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:83326:x1867507126838656:12345-0@lo:502:llog_process_th.0 Request processed in 99us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997026.913866:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1780997026.913913:0:83326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83326:1867507126838656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780997026.913933:0:83326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997026.913937:0:83326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997026.913938:0:83326:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1780997026.913942:0:83326:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:0.0:1780997026.914115:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126838528 00000100:00100000:0.0:1780997026.914120:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126838528 00000100:00100000:0.0:1780997026.914146:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5916 00000100:00100000:0.0:1780997026.914151:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd01a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3495:x1867507126838528:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1780997026.914173:0:25181:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3554 last 0 00000020:00000080:0.0:1780997026.914198:0:25181:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c03059ac6 00002000:00100000:0.0:1780997026.914210:0:25181:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9689ba670800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1780997026.914214:0:25181:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1780997026.914217:0:25181:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1780997026.914300:0:25181:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1780997026.914321:0:25181:0:(import.c:65:import_set_state_nolock()) ffff9689ba677800 : changing import state from RECOVER to FULL 00000020:01000000:2.0:1780997026.914618:0:83311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1780997026.914645:0:83311:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1780997026.914699:0:83311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.914710:0:83311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997026.914718:0:83311:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9689a5872000 from 1 10000000:01000000:2.0:1780997026.914721:0:83311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1780997026.914747:0:83311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.914754:0:83311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.914762:0:83311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997026.914783:0:83311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126838784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780997026.914815:0:83311:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.914847:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997026.914890:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126838784 00000100:00100000:1.0:1780997026.914895:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126838784 00000100:00100000:1.0:1780997026.914927:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1780997026.914934:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:83311:x1867507126838784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997026.914943:0:83323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997026.914956:0:83323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c1200/0x30fd811c03059ad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059acd expref: -99 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.914976:0:83323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c1200/0x30fd811c03059ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059acd expref: 8 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.914985:0:83323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c1200/0x30fd811c03059ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059acd expref: 8 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.915002:0:83323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1200, rc 0) 00000100:00100000:1.0:1780997026.915032:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:83311:x1867507126838784:12345-0@lo:101:mount.lustre.0 Request processed in 99us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997026.915039:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1780997026.915095:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd01a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126838528:12345-0@lo:8:llog_process_th.0 Request processed in 942us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997026.915103:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5916 00000100:00100000:2.0:1780997026.915625:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780997026.915634:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1780997026.915643:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1780997026.915648:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1780997026.915651:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968983330800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1780997026.915707:0:3495:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:2.0:1780997026.915714:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126838528:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780997026.915757:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126838784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997026.915773:0:83311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059ad4 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.915782:0:83311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059ad4 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780997026.916914:0:83334:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1780997026.917000:0:83334:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3554462729115ns, next at 0ns, rc = 0 00080000:00080000:0.0:1780997026.917009:0:83334:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1780997026.917890:0:83311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126838912:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1780997026.917974:0:83311:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.918015:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997026.918669:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126838912 00000100:00100000:0.0:1780997026.918680:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126838912 00000100:00100000:0.0:1780997026.918726:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1780997026.918737:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:83311:x1867507126838912:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1780997026.918759:0:83318:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1780997026.918779:0:83318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1780997026.918783:0:83318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1780997026.918786:0:83318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1780997026.918793:0:83318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 107 00000100:00100000:0.0:1780997026.918890:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:83311:x1867507126838912:12345-0@lo:256:mount.lustre.0 Request processed in 154us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997026.918898:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1780997026.919000:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126838912:0@lo:256:mount.lustre.0 00000004:00080000:1.0:1780997026.920010:0:83312:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:2.0:1780997026.920538:0:83311:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1780997026.920604:0:83311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059ad4 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.920633:0:83311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059ad4 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997026.920643:0:83311:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9689a5872000 from 1 10000000:01000000:2.0:1780997026.920646:0:83311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1780997026.920682:0:83311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.920690:0:83311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.920700:0:83311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997026.920722:0:83311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126839040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780997026.920781:0:83311:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.920822:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997026.920983:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126839168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997026.921017:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997026.921102:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126839168 00000100:00100000:3.0:1780997026.921109:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126839168 00000100:00100000:3.0:1780997026.921167:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:3.0:1780997026.921176:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126839168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780997026.921204:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997026.921246:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126839168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997026.921252:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00080000:2.0:1780997026.921335:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997026.921378:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126839168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997026.921499:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126839040 00000100:00100000:1.0:1780997026.921504:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126839040 00000100:00100000:1.0:1780997026.921537:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1780997026.921545:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:83311:x1867507126839040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997026.921554:0:83319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997026.921567:0:83319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c1400/0x30fd811c03059ae2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059adb expref: -99 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.921588:0:83319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c1400/0x30fd811c03059ae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059adb expref: 9 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.921598:0:83319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c1400/0x30fd811c03059ae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059adb expref: 9 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.921607:0:83319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1400, rc 0) 00000100:00100000:1.0:1780997026.921646:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83311:x1867507126839040:12345-0@lo:101:mount.lustre.0 Request processed in 102us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997026.921652:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1780997026.921729:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126839040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997026.921743:0:83311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.921751:0:83311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997026.921817:0:83311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126839296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997026.921846:0:83311:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.921870:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997026.921913:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126839296 00000100:00100000:1.0:1780997026.921917:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126839296 00000100:00100000:1.0:1780997026.921950:0:83317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1780997026.921956:0:83317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83311:x1867507126839296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780997026.922098:0:83317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83311:x1867507126839296:12345-0@lo:501:mount.lustre.0 Request processed in 142us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997026.922105:0:83317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1780997026.922228:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126839296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997026.922256:0:83311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126839424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997026.922340:0:83311:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.922361:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997026.922668:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126839424 00000100:00100000:2.0:1780997026.922673:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126839424 00000100:00100000:2.0:1780997026.922709:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1780997026.922716:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83311:x1867507126839424:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997026.922812:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83311:x1867507126839424:12345-0@lo:503:mount.lustre.0 Request processed in 96us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.922820:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1780997026.922865:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126839424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997026.923053:0:83336:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83336:1867507126839552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997026.923089:0:83336:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.923109:0:83336:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997026.923167:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126839552 00000100:00100000:3.0:1780997026.923172:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126839552 00000100:00100000:3.0:1780997026.923205:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1780997026.923212:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83336:x1867507126839552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997026.923683:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83336:x1867507126839552:12345-0@lo:502:llog_process_th.0 Request processed in 469us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997026.923690:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1780997026.923779:0:83336:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83336:1867507126839552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780997026.923803:0:83336:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780997026.923813:0:83336:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997026.923816:0:83336:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1780997026.923823:0:83336:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9689a5872000 00000020:00000080:2.0:1780997026.923831:0:83336:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1780997026.923840:0:83336:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997026.923842:0:83336:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997026.923844:0:83336:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1780997026.923846:0:83336:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780997026.923848:0:83336:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997026.923849:0:83336:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1780997026.923853:0:83336:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9689a5872000 00000020:00000080:2.0:1780997026.923855:0:83336:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1780997026.923937:0:83336:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83336:1867507126839680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997026.923974:0:83336:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.924000:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126839680 00000100:00100000:2.0:1780997026.924005:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126839680 00000100:00100000:2.0:1780997026.924028:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1780997026.924036:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83336:x1867507126839680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997026.924107:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83336:x1867507126839680:12345-0@lo:502:llog_process_th.0 Request processed in 71us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.924113:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1780997026.924150:0:83336:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997026.924162:0:83336:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83336:1867507126839680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780997026.924179:0:83336:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997026.924183:0:83336:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997026.924184:0:83336:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1780997026.924188:0:83336:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1780997026.924253:0:83311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1780997026.924290:0:83311:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780997026.927987:0:83311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.928018:0:83311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997026.928092:0:83311:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1780997026.928095:0:83311:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9689a5872000 10000000:01000000:2.0:1780997026.928098:0:83311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9689a5872000 10000000:01000000:2.0:1780997026.928101:0:83311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1780997026.928107:0:83311:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689a5872000 from 1 10000000:01000000:2.0:1780997026.928109:0:83311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780997026.928146:0:83311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.928153:0:83311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.928164:0:83311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997026.928188:0:83311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126839808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780997026.928263:0:83311:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.928326:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1780997026.929519:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126839808 00000100:00100000:1.0:1780997026.929530:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126839808 00000100:00100000:1.0:1780997026.929574:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1780997026.929584:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:83311:x1867507126839808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997026.929599:0:83319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997026.929613:0:83319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c1a00/0x30fd811c03059af0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059ae9 expref: -99 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.929640:0:83319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c1a00/0x30fd811c03059af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059ae9 expref: 10 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.929651:0:83319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c1a00/0x30fd811c03059af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059ae9 expref: 10 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.929660:0:83319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1a00, rc 0) 00000100:00100000:1.0:1780997026.929714:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83311:x1867507126839808:12345-0@lo:101:mount.lustre.0 Request processed in 131us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997026.929721:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1780997026.929874:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126839808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997026.929891:0:83311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997026.929901:0:83311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997026.929984:0:83311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126839936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997026.930019:0:83311:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.930049:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126839936 00000100:00100000:2.0:1780997026.930054:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126839936 00000100:00100000:2.0:1780997026.930080:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1780997026.930087:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83311:x1867507126839936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997026.930215:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83311:x1867507126839936:12345-0@lo:501:mount.lustre.0 Request processed in 128us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.930223:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1780997026.930259:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997026.930308:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126839936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997026.930339:0:83311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126840064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997026.931460:0:83311:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.931499:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997026.931590:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126840064 00000100:00100000:0.0:1780997026.931598:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126840064 00000100:00100000:0.0:1780997026.931639:0:83317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1780997026.931648:0:83317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83311:x1867507126840064:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780997026.931759:0:83317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83311:x1867507126840064:12345-0@lo:503:mount.lustre.0 Request processed in 113us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997026.931766:0:83317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1780997026.931873:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126840064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780997026.944157:0:83339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83339:1867507126840192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997026.944242:0:83339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997026.944316:0:83339:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888965e480 going to sleep for 11 seconds 00000100:00100000:2.0:1780997026.944473:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126840192 00000100:00100000:2.0:1780997026.944607:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126840192 00000100:00100000:2.0:1780997026.944663:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1780997026.944673:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83339:x1867507126840192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997026.944805:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83339:x1867507126840192:12345-0@lo:502:llog_process_th.0 Request processed in 133us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.944812:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1780997026.944939:0:83339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83339:1867507126840192:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1780997026.944992:0:83339:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1780997026.945006:0:83339:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9689aeba0000) 00000020:00000080:3.0:1780997026.945030:0:83339:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1780997026.948803:0:83339:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689a5872000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1780997026.948812:0:83339:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689a5872000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1780997026.948815:0:83339:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689a5872000 4 00010000:00080000:3.0:1780997026.948852:0:83339:0:(ldlm_lib.c:102:import_set_conn()) imp ffff968986141000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:2.0:1780997026.952145:0:83339:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1780997026.952309:0:83339:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1780997026.952456:0:83339:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1780997026.952468:0:83339:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x30fd811c03059afe 00000100:00080000:2.0:1780997026.952546:0:83339:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780997026.952554:0:83339:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff968986141000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997026.952601:0:83339:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc86d180 x1867507126840320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997026.952622:0:83339:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1780997026.952855:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126840320:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780997026.952943:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.955197:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126840320 00000100:00100000:2.0:1780997026.955210:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126840320 00000100:00100000:2.0:1780997026.955256:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1780997026.955265:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126840320:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780997026.955619:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126840320:12345-0@lo:38:llog_process_th.0 Request processed in 353us (2674us total) trans 0 rc -11/-11 00000100:00100000:2.0:1780997026.955627:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1780997026.955681:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780997026.955689:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968986141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997026.955694:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1780997026.955697:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126840320:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780997026.955826:0:83339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83339:1867507126840448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997026.955892:0:83339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.955923:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126840448 00000100:00100000:2.0:1780997026.955927:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126840448 00000100:00100000:2.0:1780997026.955964:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1780997026.955973:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83339:x1867507126840448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997026.956099:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83339:x1867507126840448:12345-0@lo:502:llog_process_th.0 Request processed in 127us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.956112:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1780997026.956162:0:83339:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5540 going to sleep for 11 seconds 00000100:00100000:2.0:1780997026.956177:0:83339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83339:1867507126840448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997026.956212:0:83339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83339:1867507126840576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997026.956243:0:83339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997026.956264:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126840576 00000100:00100000:2.0:1780997026.956292:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126840576 00000100:00100000:2.0:1780997026.956316:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1780997026.956323:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83339:x1867507126840576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997026.957684:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83339:x1867507126840576:12345-0@lo:502:llog_process_th.0 Request processed in 1351us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.957696:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1780997026.957755:0:83339:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5540 going to sleep for 11 seconds 00000100:00100000:2.0:1780997026.957775:0:83339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83339:1867507126840576:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1780997026.957802:0:83339:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1780997026.958030:0:83311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1780997026.958056:0:83311:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780997026.958080:0:83311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.958091:0:83311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1780997026.958140:0:83311:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1780997026.958142:0:83311:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780997026.958143:0:83311:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997026.958145:0:83311:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997026.958146:0:83311:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997026.958147:0:83311:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997026.958148:0:83311:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997026.958150:0:83311:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780997026.958152:0:83311:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997026.958153:0:83311:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1780997026.958156:0:83311:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1780997026.958158:0:83311:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1780997026.958160:0:83311:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780997026.958165:0:83311:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997026.958166:0:83311:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997026.958167:0:83311:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997026.958168:0:83311:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997026.958169:0:83311:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997026.958170:0:83311:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780997026.958171:0:83311:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997026.958172:0:83311:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1780997026.958193:0:83311:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1780997026.958208:0:83311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126840704:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1780997026.958248:0:83311:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997026.958303:0:83311:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689869fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1780997026.958556:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126840704 00000100:00100000:2.0:1780997026.958563:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126840704 00000100:00100000:2.0:1780997026.960519:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1780997026.960538:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83311:x1867507126840704:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1780997026.960576:0:83318:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1780997026.960590:0:83318:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1780997026.966170:0:83318:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780997026.966220:0:83318:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1780997026.966568:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:83311:x1867507126840704:12345-0@lo:253:mount.lustre.0 Request processed in 6032us (8312us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.966597:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1780997026.967306:0:83311:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:83311:1867507126840704:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1780997026.967323:0:83311:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1780997026.967327:0:83311:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1780997026.967329:0:83311:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780997026.967330:0:83311:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997026.967331:0:83311:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997026.967333:0:83311:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997026.967334:0:83311:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997026.967335:0:83311:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997026.967337:0:83311:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780997026.967339:0:83311:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997026.967340:0:83311:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1780997026.967357:0:83311:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1780997026.969139:0:83322:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1780997026.969147:0:83322:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1780997026.969169:0:83322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997026.969188:0:83322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bc4c1200/0x30fd811c03059ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059acd expref: 9 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997026.969197:0:83322:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997026.969248:0:83322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bc4c1200/0x30fd811c03059ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c03059acd expref: 9 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997026.969264:0:83322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bc4c1200/0x30fd811c03059ad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c03059acd expref: 9 pid: 83323 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997026.969301:0:83322:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:83322:1867507126840832:0@lo:104: 00000100:00100000:3.0:1780997026.969473:0:83322:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997026.969618:0:83322:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984b36540 going to sleep for 11 seconds 00000100:00100000:0.0:1780997026.971193:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126840832 00000100:00100000:0.0:1780997026.971204:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126840832 00000100:00100000:0.0:1780997026.971249:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1780997026.971258:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:83322:x1867507126840832:12345-0@lo:104: 00010000:00010000:0.0:1780997026.971296:0:6334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c03059ad4 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.971392:0:6334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1780997026.971398:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:83322:x1867507126840832:12345-0@lo:104: Request processed in 142us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997026.971416:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:0.0:1780997026.971464:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997026.971471:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c03059ad4 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.971682:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455000 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:0.0:1780997026.971687:0:6339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c03059ad4 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.971697:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c03059ad4 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997026.971704:0:6339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c03059ad4 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997026.971710:0:6339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997026.971746:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c03059ad4 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.971753:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780997026.971773:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c03059ad4 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.971780:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba455000/0x30fd811c03059acd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c03059ad4 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.971796:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997026.971797:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997026.971799:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997026.971813:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126840960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997026.971862:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997026.972047:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126840960 00000100:00100000:0.0:1780997026.972052:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126840960 00010000:00010000:0.0:1780997026.972072:0:18812:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bc4c1200/0x30fd811c03059ad4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c03059acd expref: 10 pid: 83323 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997026.972097:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:0.0:1780997026.972104:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adeded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:3499:x1867507126840960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997026.972116:0:18812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997026.972121:0:18812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bc4c1200/0x30fd811c03059ad4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c03059acd expref: 10 pid: 83323 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.972132:0:18812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bc4c1200/0x30fd811c03059ad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c03059acd expref: 10 pid: 83323 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.972151:0:18812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.972159:0:18812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1780997026.972175:0:18812:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003028996s 00010000:00010000:0.0:1780997026.972180:0:18812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.972187:0:18812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.972195:0:18812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.972212:0:18812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.972217:0:18812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997026.972222:0:18812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.972229:0:18812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.972239:0:18812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997026.972249:0:18812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997026.972301:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adeded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:3499:x1867507126840960:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997026.972308:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:0.0:1780997026.972342:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126840960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997026.972606:0:83322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c1200/0x30fd811c03059ad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c03059acd expref: 9 pid: 83323 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997026.972617:0:83322:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:83322:1867507126840832:0@lo:104: 00010000:00010000:1.0:1780997026.972633:0:83322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.972652:0:83322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.972658:0:83322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997026.972675:0:83322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c9200/0x30fd811c03059b05 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1780997026.976727:0:83311:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444067 00000040:01000000:2.0:1780997026.977207:0:83311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1780997026.978392:0:83344:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444067 00000020:00080000:1.0:1780997026.978400:0:83344:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444067 00000040:01000000:1.0:1780997026.978698:0:83345:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1780997026.979205:0:83345:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1780997026.981030:0:83311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1780997026.982792:0:83346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83346:1867507126841088:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997026.982866:0:83346:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997026.982905:0:83346:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689869fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1780997026.983076:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126841088 00000100:00100000:2.0:1780997026.983083:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126841088 00000100:00100000:2.0:1780997026.983135:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:2.0:1780997026.983144:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83346:x1867507126841088:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780997026.983221:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83346:x1867507126841088:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 78us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.983229:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00000040:01000000:2.0:1780997026.983658:0:83311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1780997026.983909:0:83311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1780997026.984346:0:83311:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1780997026.984355:0:83311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1780997026.984401:0:83311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780997026.985470:0:83345:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1780997026.985619:0:83345:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1780997026.985810:0:83346:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83346:1867507126841088:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1780997026.985850:0:83346:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1780997026.985907:0:83346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83346:1867507126841216:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997026.985968:0:83346:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997026.986005:0:83346:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e33a80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997026.986330:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126841216 00000100:00100000:0.0:1780997026.986338:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126841216 00000100:00100000:0.0:1780997026.986457:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:0.0:1780997026.986467:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83346:x1867507126841216:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997026.986977:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83346:x1867507126841216:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 511us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997026.986987:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000100:00100000:0.0:1780997026.987090:0:83346:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83346:1867507126841216:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997026.987172:0:83346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83346:1867507126841344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997026.987201:0:83346:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997026.987218:0:83346:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e33a80 going to sleep for 11 seconds 00000040:00080000:2.0:1780997026.987973:0:83311:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1780997026.988044:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126841344 00000100:00100000:2.0:1780997026.988050:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126841344 00000100:00100000:2.0:1780997026.988087:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:2.0:1780997026.988094:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83346:x1867507126841344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780997026.988170:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83346:x1867507126841344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 76us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997026.988176:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00000100:00100000:0.0:1780997026.988550:0:83346:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83346:1867507126841344:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1780997026.988604:0:83346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780997026.990351:0:83311:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1780997026.990643:0:83311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1780997026.991057:0:83311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1780997026.993069:0:83311:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00000040:00080000:0.0:1780997026.995854:0:83346:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1780997026.996000:0:83346:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1780997026.996005:0:83346:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1780997026.996988:0:83311:0:(ldlm_lib.c:3037:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247812 00010000:00080000:2.0:1780997026.997923:0:83347:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 83347 00010000:02000000:2.0:1780997026.998097:0:83347:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1780997026.998102:0:83347:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1780997026.998105:0:83347:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1780997026.998731:0:83311:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1780997026.998750:0:83311:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1780997026.998766:0:83311:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:0.0:1780997026.998790:0:83311:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1780997026.999854:0:83311:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780997027.000239:0:83311:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1780997027.561140:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997028.111075:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997028.111152:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110342912 00000100:00100000:3.0:1780997028.111162:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110342912 00000100:00100000:3.0:1780997028.111221:0:83317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1780997028.111232:0:83317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+4:41993:x1867507110342912:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997028.111252:0:83317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997028.111305:0:83317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c9000/0x30fd811c03059b0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8af1 expref: -99 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.111337:0:83317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c9000/0x30fd811c03059b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8af1 expref: 5 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.111368:0:83317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c9000/0x30fd811c03059b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8af1 expref: 5 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.111377:0:83317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9000, rc 0) 00000100:00100000:3.0:1780997028.111441:0:83317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110342912:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 204us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.111448:0:83317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:2.0:1780997028.114605:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997028.116378:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110343040 00000100:00100000:3.0:1780997028.116395:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110343040 00000100:00100000:3.0:1780997028.116467:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1780997028.116480:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110343040:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780997028.116514:0:83323:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1780997028.116535:0:83323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780997028.116539:0:83323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1780997028.116542:0:83323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1780997028.116545:0:83323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1780997028.116548:0:83323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:3.0:1780997028.128937:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110343040:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 Request processed in 12449us (14330us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.128953:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1780997028.137583:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997028.137634:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997028.137748:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110343168 00000100:00100000:0.0:1780997028.137759:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110343168 00000100:00100000:0.0:1780997028.137811:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1144 00000100:00100000:0.0:1780997028.137819:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110343168:12345-192.168.206.51@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1780997028.137853:0:65272:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '285c134c-d3a6-4c01-bb4d-8148c50d5f95' at ffff9689bfab4000, cookie 0x30fd811c03059a56 00010000:00080000:0.0:1780997028.137873:0:65272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp recovering/t98784247813 exp ffff9689bfab4000 cur 3555 last 1780997026 00010000:02000400:0.0:1780997028.137882:0:65272:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1780997028.137888:0:65272:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1780997028.137913:0:65272:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1780997028.138061:0:65272:0:(import.c:65:import_set_state_nolock()) ffff9689891ae000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997028.138137:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110343168:12345-192.168.206.51@tcp:38:ll_cfg_requeue.0 Request processed in 317us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997028.138146:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1144 00000100:00100000:0.0:1780997028.138979:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110343296 00000100:00100000:0.0:1780997028.138988:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110343296 00000100:00100000:0.0:1780997028.139031:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1780997028.139039:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110343296:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997028.139051:0:83318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997028.139067:0:83318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff03c00/0x30fd811c03059b13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8af8 expref: -99 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.139093:0:83318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03c00/0x30fd811c03059b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8af8 expref: 6 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.139105:0:83318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff03c00/0x30fd811c03059b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8af8 expref: 6 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.139114:0:83318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03c00, rc 0) 00000100:00100000:0.0:1780997028.139166:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+6:41993:x1867507110343296:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 128us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997028.139173:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1780997028.139768:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997028.139955:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110336512 00000100:00100000:0.0:1780997028.139974:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110336512 00000100:00100000:0.0:1780997028.140018:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1145 00000100:00100000:0.0:1780997028.140026:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110336512:12345-192.168.206.51@tcp:36:mcreate.0 00010000:00080000:0.0:1780997028.140040:0:63417:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:0.0:1780997028.140052:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110336512:12345-192.168.206.51@tcp:36:mcreate.0 Request processed in 28us (287us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997028.140057:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1145 00010000:00080000:3.0:1780997028.140299:0:83347:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1780997028.142516:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997028.142944:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110343424 00000100:00100000:0.0:1780997028.142956:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110343424 00000100:00100000:0.0:1780997028.143011:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:0.0:1780997028.143022:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+6:41993:x1867507110343424:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997028.143256:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110343424:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 236us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997028.143267:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1780997028.163003:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997028.163089:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110343552 00000100:00100000:0.0:1780997028.163098:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110343552 00000100:00100000:0.0:1780997028.163158:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:0.0:1780997028.163167:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110343552:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997028.163346:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110343552:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 179us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997028.163355:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1780997028.180562:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997028.188141:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110343680 00000100:00100000:0.0:1780997028.188161:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110343680 00000100:00100000:3.0:1780997028.188340:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1780997028.188353:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110343680:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997028.188380:0:83318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997028.188398:0:83318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c8c00/0x30fd811c03059b1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8aff expref: -99 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.188445:0:83318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c8c00/0x30fd811c03059b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aff expref: 8 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.188456:0:83318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c8c00/0x30fd811c03059b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aff expref: 8 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.188465:0:83318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8c00, rc 0) 00000100:00100000:3.0:1780997028.188537:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110343680:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 187us (7984us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.188544:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:0.0:1780997028.197910:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997028.197960:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110343808 00000100:00100000:2.0:1780997028.197972:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110343808 00000100:00100000:2.0:1780997028.198029:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:2.0:1780997028.198041:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110343808:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997028.198239:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110343808:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 199us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997028.198248:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:3.0:1780997028.209602:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997028.209814:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110343936 00000100:00100000:0.0:1780997028.209828:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110343936 00000100:00100000:0.0:1780997028.209898:0:83317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:0.0:1780997028.209908:0:83317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110343936:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997028.210048:0:83317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110343936:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 142us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997028.210056:0:83317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:0.0:1780997028.218485:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997028.218612:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110344064 00000100:00100000:2.0:1780997028.218622:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110344064 00000100:00100000:2.0:1780997028.218668:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:2.0:1780997028.218678:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110344064:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997028.218695:0:83318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997028.218712:0:83318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba454200/0x30fd811c03059b21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b06 expref: -99 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.218743:0:83318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454200/0x30fd811c03059b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b06 expref: 9 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.218754:0:83318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba454200/0x30fd811c03059b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b06 expref: 9 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.218775:0:83318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454200, rc 0) 00000100:00100000:2.0:1780997028.218844:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:41993:x1867507110344064:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 168us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997028.218852:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:1.0:1780997028.224997:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997028.226748:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110344192 00000100:00100000:0.0:1780997028.226762:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110344192 00000100:00100000:0.0:1780997028.226827:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:0.0:1780997028.226838:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:41993:x1867507110344192:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997028.226966:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:41993:x1867507110344192:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 129us (1978us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780997028.226975:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:3.0:1780997028.267449:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780997028.267470:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126841472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780997028.267536:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.267584:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126841472 00000100:00100000:3.0:1780997028.267593:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126841472 00000100:00100000:3.0:1780997028.267641:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:3.0:1780997028.267650:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126841472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997028.267672:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997028.267714:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126841472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.267737:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00080000:3.0:1780997028.267758:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997028.267793:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126841472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997028.268124:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997028.268135:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126841600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997028.268165:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997028.268398:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126841600 00000100:00100000:0.0:1780997028.268403:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126841600 00000100:00100000:0.0:1780997028.268447:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:0.0:1780997028.268455:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126841600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997028.268467:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997028.268504:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126841600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997028.268510:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:0.0:1780997028.268541:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126841600:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1780997028.268616:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:3.0:1780997028.390170:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1780997028.390178:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9689a5872000 from 108 10000000:01000000:3.0:1780997028.390184:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1780997028.390251:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.390264:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.390307:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997028.390338:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126841728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.390426:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.390479:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a64bc840 going to sleep for 11 seconds 00000100:00100000:2.0:1780997028.390576:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126841728 00000100:00100000:2.0:1780997028.390583:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126841728 00000100:00100000:2.0:1780997028.390650:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1780997028.390659:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:6348:x1867507126841728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997028.390672:0:83325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997028.390685:0:83325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455000/0x30fd811c03059b2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059b28 expref: -99 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.390708:0:83325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455000/0x30fd811c03059b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059b28 expref: 10 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.390718:0:83325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455000/0x30fd811c03059b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059b28 expref: 10 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.390738:0:83325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455000, rc 0) 00000100:00100000:2.0:1780997028.390782:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126841728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997028.390789:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1780997028.391088:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126841728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997028.391102:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.391111:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997028.391170:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126841856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.391211:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.391236:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a64bc840 going to sleep for 11 seconds 00000100:00100000:2.0:1780997028.393519:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126841856 00000100:00100000:2.0:1780997028.393533:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126841856 00000100:00100000:2.0:1780997028.393606:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1780997028.393617:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126841856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1780997028.393657:0:83318:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1780997028.393675:0:83318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1780997028.393678:0:83318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 108 00000100:00100000:2.0:1780997028.394002:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126841856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 387us (2789us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997028.394010:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1780997028.394440:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126841856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1780997028.394499:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1780997028.394509:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.394520:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997028.394532:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1780997028.394534:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968886f5e000 from 52 10000000:01000000:3.0:1780997028.394537:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780997028.394567:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c8600/0x30fd811c03059b36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.394575:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689a56c8600/0x30fd811c03059b36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.394584:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689a56c8600/0x30fd811c03059b36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997028.394673:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126841984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.394717:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.394953:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a64bc840 going to sleep for 11 seconds 00000100:00100000:2.0:1780997028.401950:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126841984 00000100:00100000:2.0:1780997028.401967:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126841984 00000100:00100000:2.0:1780997028.402092:0:83317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1780997028.402103:0:83317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126841984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997028.402120:0:83317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997028.402139:0:83317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455a00/0x30fd811c03059b3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059b36 expref: -99 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.402167:0:83317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455a00/0x30fd811c03059b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059b36 expref: 11 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.402178:0:83317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455a00/0x30fd811c03059b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059b36 expref: 11 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.402188:0:83317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455a00, rc 0) 00000100:00100000:2.0:1780997028.402297:0:83317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126841984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (7579us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997028.402305:0:83317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1780997028.402391:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126841984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997028.402409:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689a56c8600/0x30fd811c03059b36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b3d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.402446:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689a56c8600/0x30fd811c03059b36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059b3d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997028.402529:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997028.402566:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997028.413983:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27300 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.414326:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126842112 00000100:00100000:3.0:1780997028.414336:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126842112 00000100:00100000:3.0:1780997028.415041:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1780997028.415054:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126842112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.415231:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126842112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (12663us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.415238:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1780997028.415726:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997028.415783:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997028.415835:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997028.415937:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27300 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.416002:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126842240 00000100:00100000:3.0:1780997028.416007:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126842240 00000100:00100000:3.0:1780997028.416078:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1780997028.416086:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126842240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.416169:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126842240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.416176:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1780997028.416299:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997028.417026:0:83407:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1780997028.417084:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1780997028.417104:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780997028.417113:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c8600/0x30fd811c03059b36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b3d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.417125:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689a56c8600/0x30fd811c03059b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b3d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997028.417134:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1780997028.417137:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff968886f5e000 from 105 10000000:01000000:0.0:1780997028.417140:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1780997028.417453:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059b44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.417473:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059b44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.417482:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059b44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997028.417498:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997028.417715:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997028.417738:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27d80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997028.418541:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126842368 00000100:00100000:0.0:1780997028.418549:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126842368 00000100:00100000:0.0:1780997028.418591:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1780997028.418601:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126842368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997028.418615:0:83325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997028.418629:0:83325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff03000/0x30fd811c03059b4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059b44 expref: -99 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.418781:0:83325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03000/0x30fd811c03059b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059b44 expref: 12 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.418793:0:83325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff03000/0x30fd811c03059b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059b44 expref: 12 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.418803:0:83325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03000, rc 0) 00000100:00100000:1.0:1780997028.418951:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126842368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 350us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997028.418959:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1780997028.419009:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997028.419024:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059b44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b4b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.419044:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059b44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059b4b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997028.419084:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1780997028.419113:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997028.419137:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.419152:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126842496 00000100:00100000:3.0:1780997028.419157:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126842496 00000100:00100000:3.0:1780997028.419222:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1780997028.419230:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126842496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780997028.419244:0:83318:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1780997028.419264:0:83318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780997028.419267:0:83318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1780997028.419304:0:83318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1780997028.419307:0:83318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1780997028.419309:0:83318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:3.0:1780997028.419386:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126842496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.419393:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1780997028.419463:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1780997028.419548:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780997028.419555:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059b44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b4b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.419698:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059b44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b4b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997028.419707:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1780997028.419710:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1780997028.419713:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1780997028.419789:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c03059b52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.419796:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c03059b52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.419802:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c03059b52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997028.419812:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.419834:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997028.419929:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984b36c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780997028.419957:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126842624 00000100:00100000:0.0:1780997028.419961:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126842624 00000100:00100000:0.0:1780997028.419983:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1780997028.419993:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126842624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997028.420001:0:83319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997028.420010:0:83319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff03a00/0x30fd811c03059b59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059b52 expref: -99 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.420027:0:83319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03a00/0x30fd811c03059b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059b52 expref: 13 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.420036:0:83319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff03a00/0x30fd811c03059b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059b52 expref: 13 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.420043:0:83319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03a00, rc 0) 00000100:00100000:0.0:1780997028.420079:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126842624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997028.420085:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1780997028.420153:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997028.420163:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c03059b52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b59 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.420171:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c03059b52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059b59 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997028.420222:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.420244:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.420447:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126842752 00000100:00100000:3.0:1780997028.420455:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126842752 00000100:00100000:1.0:1780997028.420527:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984b36c00 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.420654:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1780997028.420662:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126842752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.420808:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126842752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.420816:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1780997028.420874:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.420905:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.420948:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997028.420968:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984b36c00 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.421029:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126842880 00000100:00100000:3.0:1780997028.421033:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126842880 00000100:00100000:3.0:1780997028.421061:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1780997028.421068:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126842880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.424151:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126842880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3075us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.424166:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1780997028.424354:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126842880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997028.426861:0:83408:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1780997028.429629:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1780997028.429806:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1780997028.429819:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c03059b52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b59 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.429832:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c03059b52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b59 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997028.429843:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1780997028.429845:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff968886f5e000 from 1 10000000:01000000:1.0:1780997028.429848:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1780997028.430070:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0a00/0x30fd811c03059b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.430079:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0a00/0x30fd811c03059b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.430089:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0a00/0x30fd811c03059b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997028.430116:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.430192:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997028.430251:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984b36c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780997028.430511:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126843008 00000100:00100000:0.0:1780997028.430529:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126843008 00000100:00100000:0.0:1780997028.430585:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1780997028.430602:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126843008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997028.430618:0:83319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997028.430631:0:83319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff03600/0x30fd811c03059b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059b60 expref: -99 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.431228:0:83319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03600/0x30fd811c03059b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059b60 expref: 14 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.431712:0:83319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff03600/0x30fd811c03059b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059b60 expref: 14 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.431724:0:83319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03600, rc 0) 00000100:00100000:0.0:1780997028.432312:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507126843008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1665us (2072us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997028.432322:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1780997028.434066:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997028.434094:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0a00/0x30fd811c03059b60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b67 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.434127:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0a00/0x30fd811c03059b60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059b67 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997028.434148:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1780997028.434154:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0a00/0x30fd811c03059b60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b67 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.434162:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0a00/0x30fd811c03059b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b67 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997028.434473:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1780997028.434607:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff968886f5e000 from 7 10000000:01000000:1.0:1780997028.434611:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1780997028.441858:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1800/0x30fd811c03059b6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.441880:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1800/0x30fd811c03059b6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.441895:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1800/0x30fd811c03059b6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997028.441931:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.442006:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997028.442050:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984b360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.442126:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126843136 00000100:00100000:3.0:1780997028.442136:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126843136 00000100:00100000:3.0:1780997028.442200:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1780997028.442210:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968982c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507126843136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997028.442226:0:83325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997028.442243:0:83325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c8e00/0x30fd811c03059b75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059b6e expref: -99 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.442293:0:83325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c8e00/0x30fd811c03059b75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059b6e expref: 15 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.442305:0:83325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c8e00/0x30fd811c03059b75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059b6e expref: 15 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.442315:0:83325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8e00, rc 0) 00000100:00100000:3.0:1780997028.442358:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968982c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126843136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.442378:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1780997028.442930:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997028.442946:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1800/0x30fd811c03059b6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b75 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.442955:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1800/0x30fd811c03059b6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059b75 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997028.443028:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.443057:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997028.443088:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984b360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.443246:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126843264 00000100:00100000:3.0:1780997028.443251:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126843264 00000100:00100000:3.0:1780997028.443347:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1780997028.443355:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968982c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126843264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.443478:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968982c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126843264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.443485:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1780997028.443655:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.443681:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.443719:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997028.443749:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984b360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.443846:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126843392 00000100:00100000:3.0:1780997028.443850:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126843392 00000100:00100000:3.0:1780997028.443878:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1780997028.443884:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888ada9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126843392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.443948:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888ada9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126843392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.443954:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1780997028.445590:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997028.447085:0:83410:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1780997028.447415:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1780997028.447448:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1780997028.447458:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1800/0x30fd811c03059b6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b75 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.447471:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1800/0x30fd811c03059b6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b75 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997028.447482:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780997028.447485:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689bfa99000 from 52 10000000:01000000:1.0:1780997028.447488:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780997028.447541:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1000/0x30fd811c03059b7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.447550:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1000/0x30fd811c03059b7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.447560:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1000/0x30fd811c03059b7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997028.447582:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.449730:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997028.449794:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984b360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.450400:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126843520 00000100:00100000:3.0:1780997028.450410:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126843520 00000100:00100000:3.0:1780997028.450469:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1780997028.450478:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888adab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126843520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997028.450494:0:83323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997028.450512:0:83323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c9400/0x30fd811c03059b83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059b7c expref: -99 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.450551:0:83323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c9400/0x30fd811c03059b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059b7c expref: 16 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.450578:0:83323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c9400/0x30fd811c03059b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059b7c expref: 16 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.450587:0:83323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9400, rc 0) 00000100:00100000:3.0:1780997028.450820:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888adab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126843520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.450830:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1780997028.451090:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997028.451108:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1000/0x30fd811c03059b7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b83 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.451129:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1000/0x30fd811c03059b7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059b83 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997028.451203:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.451236:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997028.451291:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984b360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.451363:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126843648 00000100:00100000:3.0:1780997028.451368:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126843648 00000100:00100000:3.0:1780997028.451403:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1780997028.451411:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888adab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126843648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.451767:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888adab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126843648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 356us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.451774:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1780997028.451839:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.451882:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.451925:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997028.451951:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984b360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.452057:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126843776 00000100:00100000:3.0:1780997028.452062:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126843776 00000100:00100000:3.0:1780997028.452093:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1780997028.452100:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888adab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126843776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.452175:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888adab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126843776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.452181:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1780997028.452260:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780997028.454829:0:83411:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1780997028.459493:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1780997028.459542:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780997028.459554:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1000/0x30fd811c03059b7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b83 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.459577:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1000/0x30fd811c03059b7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b83 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997028.459587:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1780997028.459590:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1780997028.459593:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1780997028.459631:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c8000/0x30fd811c03059b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.459639:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689a56c8000/0x30fd811c03059b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.459659:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689a56c8000/0x30fd811c03059b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997028.459685:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.459745:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.459785:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689aeabc300 going to sleep for 11 seconds 00000100:00100000:1.0:1780997028.460506:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126843904 00000100:00100000:1.0:1780997028.460529:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126843904 00000100:00100000:1.0:1780997028.460573:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1780997028.460581:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888adaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126843904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997028.460595:0:83318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997028.460608:0:83318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c1e00/0x30fd811c03059b91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059b8a expref: -99 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.460631:0:83318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c1e00/0x30fd811c03059b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059b8a expref: 17 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.460641:0:83318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c1e00/0x30fd811c03059b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059b8a expref: 17 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.460671:0:83318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1e00, rc 0) 00000100:00100000:1.0:1780997028.460720:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888adaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126843904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997028.460726:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1780997028.464715:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126843904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997028.464742:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689a56c8000/0x30fd811c03059b8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b91 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.464755:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689a56c8000/0x30fd811c03059b8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059b91 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997028.464833:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.464888:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.464941:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689aeabc300 going to sleep for 11 seconds 00000100:00100000:1.0:1780997028.465656:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126844032 00000100:00100000:1.0:1780997028.465665:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126844032 00000100:00100000:1.0:1780997028.465727:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1780997028.465736:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888adabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126844032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.465890:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888adabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126844032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997028.465898:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1780997028.466157:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.466195:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.466241:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.466295:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689aeabc300 going to sleep for 11 seconds 00000100:00100000:1.0:1780997028.466346:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126844160 00000100:00100000:1.0:1780997028.466351:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126844160 00000100:00100000:1.0:1780997028.466391:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1780997028.466400:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888ada9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126844160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.468054:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888ada9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126844160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1651us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997028.468065:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1780997028.468150:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997028.473610:0:83412:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1780997028.473695:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1780997028.473726:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1780997028.473740:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c8000/0x30fd811c03059b8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b91 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.473753:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689a56c8000/0x30fd811c03059b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b91 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997028.473781:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1780997028.473784:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9689bfa99000 from 7 10000000:01000000:1.0:1780997028.473792:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1780997028.473829:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1c00/0x30fd811c03059b98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.473837:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1c00/0x30fd811c03059b98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.473847:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1c00/0x30fd811c03059b98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997028.473885:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.473952:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997028.473993:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a6406c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997028.474555:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126844288 00000100:00100000:2.0:1780997028.474564:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126844288 00000100:00100000:2.0:1780997028.474612:0:83317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1780997028.474621:0:83317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888ada8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126844288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997028.474635:0:83317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997028.474659:0:83317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455600/0x30fd811c03059b9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059b98 expref: -99 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.474683:0:83317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455600/0x30fd811c03059b9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059b98 expref: 18 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.474693:0:83317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455600/0x30fd811c03059b9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059b98 expref: 18 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.474701:0:83317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455600, rc 0) 00000100:00100000:2.0:1780997028.474748:0:83317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888ada8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126844288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997028.474755:0:83317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1780997028.475456:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997028.475473:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1c00/0x30fd811c03059b98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b9f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.475485:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1c00/0x30fd811c03059b98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059b9f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997028.475552:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.475588:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.475623:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689aeabc600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997028.475629:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126844416 00000100:00100000:1.0:1780997028.475636:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126844416 00000100:00100000:1.0:1780997028.475683:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1780997028.475692:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888ada8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126844416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.475814:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888ada8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126844416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997028.475821:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1780997028.475894:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997028.475926:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997028.475966:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997028.475991:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889f4a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997028.476143:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126844544 00000100:00100000:1.0:1780997028.476147:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126844544 00000100:00100000:1.0:1780997028.476178:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1780997028.476185:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888adaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126844544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997028.476340:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888adaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126844544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997028.476354:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1780997028.478961:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780997028.480058:0:83413:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1780997028.481209:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1780997028.481238:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1780997028.481250:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1c00/0x30fd811c03059b98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b9f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.481264:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1c00/0x30fd811c03059b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b9f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997028.481287:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780997028.481290:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968990f90000 from 52 10000000:01000000:0.0:1780997028.481293:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780997028.481329:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c03059ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.481350:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c03059ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.481361:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c03059ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997028.481385:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997028.481469:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997028.481512:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.482821:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126844672 00000100:00100000:3.0:1780997028.482831:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126844672 00000100:00100000:3.0:1780997028.483176:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1780997028.483187:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888adaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126844672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997028.483201:0:83319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997028.483216:0:83319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c8400/0x30fd811c03059bad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059ba6 expref: -99 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.483241:0:83319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c8400/0x30fd811c03059bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059ba6 expref: 19 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.483258:0:83319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c8400/0x30fd811c03059bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059ba6 expref: 19 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.483298:0:83319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8400, rc 0) 00000100:00100000:3.0:1780997028.483364:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888adaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126844672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.483371:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1780997028.484081:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997028.484102:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c03059ba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059bad expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.484113:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c03059ba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059bad expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997028.484209:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997028.484253:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997028.488959:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889f4a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.494617:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126844800 00000100:00100000:3.0:1780997028.494632:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126844800 00000100:00100000:3.0:1780997028.494693:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1780997028.494703:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888ada9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126844800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.494903:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888ada9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126844800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (10649us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.494911:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1780997028.494958:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.495009:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.495053:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.495077:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689aeabcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1780997028.495728:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126844928 00000100:00100000:0.0:1780997028.495736:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126844928 00000100:00100000:0.0:1780997028.495833:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1780997028.495843:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126844928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997028.495942:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126844928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997028.495950:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1780997028.496000:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126844928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997028.497382:0:83414:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1780997028.497511:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1780997028.497822:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780997028.497834:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c03059ba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059bad expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.497845:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c03059ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059bad expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997028.497860:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1780997028.497863:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1780997028.497866:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1780997028.498174:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c9c00/0x30fd811c03059bb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.498184:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689a56c9c00/0x30fd811c03059bb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.498195:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689a56c9c00/0x30fd811c03059bb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997028.498218:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.498322:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.498507:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126845056 00000100:00100000:3.0:1780997028.498514:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126845056 00000100:00100000:3.0:1780997028.498857:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1780997028.498868:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126845056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997028.498959:0:83319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997028.498973:0:83319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c9600/0x30fd811c03059bbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059bb4 expref: -99 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.498996:0:83319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c9600/0x30fd811c03059bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059bb4 expref: 20 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.499013:0:83319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c9600/0x30fd811c03059bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059bb4 expref: 20 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.499033:0:83319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9600, rc 0) 00000100:00100000:3.0:1780997028.499070:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126845056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.499078:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1780997028.499123:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689aeabcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.499145:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997028.499160:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689a56c9c00/0x30fd811c03059bb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059bbb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.499169:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689a56c9c00/0x30fd811c03059bb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059bbb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997028.499231:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.499258:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.499304:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126845184 00000100:00100000:3.0:1780997028.499308:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126845184 00000100:00100000:3.0:1780997028.499719:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1780997028.499731:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126845184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.499860:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126845184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.499867:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1780997028.500163:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689aeabcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.500179:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.500214:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.500298:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.500318:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886cc7540 going to sleep for 11 seconds 00000100:00100000:1.0:1780997028.500459:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126845312 00000100:00100000:1.0:1780997028.500465:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126845312 00000100:00100000:1.0:1780997028.500499:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1780997028.500507:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126845312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.501475:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126845312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 966us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.501483:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1780997028.501707:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997028.503597:0:83416:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1780997028.503702:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1780997028.503725:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1780997028.503735:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c9c00/0x30fd811c03059bb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059bbb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.503747:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689a56c9c00/0x30fd811c03059bb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059bbb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997028.503780:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1780997028.503782:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff968990f90000 from 7 10000000:01000000:0.0:1780997028.503785:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780997028.503818:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c03059bc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.503826:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c03059bc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.503836:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c03059bc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997028.503857:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997028.503911:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997028.503953:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889ea9300 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.504216:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126845440 00000100:00100000:3.0:1780997028.504222:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126845440 00000100:00100000:3.0:1780997028.504298:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1780997028.504308:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126845440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997028.504321:0:83323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997028.504334:0:83323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c9800/0x30fd811c03059bc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059bc2 expref: -99 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.504356:0:83323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c9800/0x30fd811c03059bc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059bc2 expref: 21 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.504367:0:83323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c9800/0x30fd811c03059bc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059bc2 expref: 21 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.504375:0:83323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9800, rc 0) 00000100:00100000:3.0:1780997028.504427:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126845440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.504445:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1780997028.504485:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997028.504499:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c03059bc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059bc9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.504519:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c03059bc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059bc9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997028.504579:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.504609:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.504631:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126845568 00000100:00100000:3.0:1780997028.504635:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126845568 00000100:00100000:3.0:1780997028.504659:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1780997028.504666:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126845568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.504943:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126845568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997028.504951:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1780997028.505046:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886cc7000 going to sleep for 11 seconds 00000100:00100000:3.0:1780997028.505064:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.505161:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997028.505196:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997028.505251:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886cc7000 going to sleep for 11 seconds 00000100:00100000:0.0:1780997028.508509:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126845696 00000100:00100000:0.0:1780997028.508522:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126845696 00000100:00100000:0.0:1780997028.508584:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1780997028.508594:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126845696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997028.509168:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997028.509506:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126845696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 912us (4306us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997028.509514:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000040:00080000:0.0:1780997028.512242:0:83418:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1780997028.512356:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1780997028.512387:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780997028.512401:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c03059bc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059bc9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.512412:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c03059bc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059bc9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997028.512422:0:6348:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1780997028.512439:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9689b6283380 from 1 10000000:01000000:2.0:1780997028.512443:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1780997028.512487:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454a00/0x30fd811c03059bd0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.512496:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba454a00/0x30fd811c03059bd0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.512507:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba454a00/0x30fd811c03059bd0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997028.512787:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997028.512853:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997028.512939:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126845824 00000100:00100000:0.0:1780997028.512947:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126845824 00000100:00100000:2.0:1780997028.512970:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889f4a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997028.513221:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1780997028.513233:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126845824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997028.513256:0:83319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997028.513291:0:83319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff02800/0x30fd811c03059bd7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059bd0 expref: -99 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.513316:0:83319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02800/0x30fd811c03059bd7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059bd0 expref: 22 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.513327:0:83319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff02800/0x30fd811c03059bd7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059bd0 expref: 22 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997028.513336:0:83319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02800, rc 0) 00000100:00100000:0.0:1780997028.513384:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126845824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997028.513391:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1780997028.513449:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997028.513465:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba454a00/0x30fd811c03059bd0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059bd7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.513475:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba454a00/0x30fd811c03059bd0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059bd7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997028.513491:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1780997028.513496:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454a00/0x30fd811c03059bd0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059bd7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.513502:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba454a00/0x30fd811c03059bd0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059bd7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997028.513509:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1780997028.513512:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9689b6283380 from 1 10000000:01000000:2.0:1780997028.513590:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1780997028.513609:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c03059bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.513616:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c03059bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.513623:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c03059bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997028.513636:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997028.513743:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997028.513768:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889f4a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997028.513810:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126845952 00000100:00100000:1.0:1780997028.513816:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126845952 00000100:00100000:1.0:1780997028.515868:0:83317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1780997028.515989:0:83317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126845952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997028.516006:0:83317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997028.516022:0:83317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c1600/0x30fd811c03059be5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059bde expref: -99 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.516048:0:83317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c1600/0x30fd811c03059be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059bde expref: 23 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.516060:0:83317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c1600/0x30fd811c03059be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059bde expref: 23 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.516070:0:83317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1600, rc 0) 00000100:00100000:1.0:1780997028.516129:0:83317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126845952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997028.516194:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126845952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997028.516212:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c03059bde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059be5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997028.516221:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c03059bde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059be5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997028.516324:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126846080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997028.516356:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997028.516385:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889f4a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997028.516399:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126846080 00000100:00100000:2.0:1780997028.516404:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126846080 00000100:00100000:1.0:1780997028.516777:0:83317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1780997028.516956:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1780997028.516965:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126846080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997028.517112:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126846080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (754us total) trans 0 rc -2/-2 00000100:00100000:2.0:1780997028.517127:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1780997028.517190:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126846080:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1780997028.517220:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1780997028.517227:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c03059bde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059be5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997028.517236:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c03059bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059be5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997028.581504:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997029.608534:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997030.634788:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1780997031.157234:0:83580:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1780997031.654351:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997031.698295:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997031.698359:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997031.698461:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110344448 00000100:00100000:2.0:1780997031.698474:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110344448 00000100:00100000:2.0:1780997031.698556:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1136 00000100:00100000:2.0:1780997031.698568:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110344448:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997031.698651:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110344448:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997031.698659:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1136 00000100:00100000:3.0:1780997031.699111:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110344320 00000100:00100000:3.0:1780997031.699117:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110344320 00000100:00100000:3.0:1780997031.699158:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:3.0:1780997031.699167:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110344320:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997031.699297:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110344320:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 131us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997031.699305:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00080000:0.0:1780997031.699633:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:3.0:1780997032.222930:0:83632:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1780997032.223131:0:83632:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1780997032.361933:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997032.361940:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997032.361956:0:38:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997032.361963:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3554 00000100:00080000:1.0:1780997032.361968:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997032.361974:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997032.361996:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc954700 x1867507126846336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997032.362026:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997032.362029:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997032.362031:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997032.362034:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3554 00000100:00080000:1.0:1780997032.362037:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997032.362040:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997032.362050:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc954380 x1867507126846592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997032.362072:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997032.362075:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997032.362077:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997032.362080:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3554 00000100:00080000:1.0:1780997032.362083:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997032.362086:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997032.362097:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc956d80 x1867507126846848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997032.362117:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997032.362120:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997032.362127:0:38:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997032.362131:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3554 00000100:00080000:1.0:1780997032.362133:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997032.362137:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997032.362149:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc955880 x1867507126847232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997032.362174:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1780997032.362177:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997032.362179:0:38:0:(import.c:65:import_set_state_nolock()) ffff968986141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997032.362183:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff968986141000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997032.362192:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b0bdaa00 x1867507126847744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997032.362218:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126846336:0@lo:38:kworker.0 00000100:00100000:1.0:1780997032.362319:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997032.362350:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126846592:0@lo:38:kworker.0 00000100:00100000:1.0:1780997032.362373:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997032.362387:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126846848:0@lo:38:kworker.0 00000100:00100000:1.0:1780997032.362420:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997032.362435:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126847232:0@lo:38:kworker.0 00000100:00100000:1.0:1780997032.362455:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997032.362469:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b0bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126847744:0@lo:38:kworker.0 00000100:00100000:1.0:1780997032.362494:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997032.362609:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126846976:0@lo:400:kworker.0 00000100:00100000:3.0:1780997032.362746:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126846464:0@lo:400:kworker.0 00000100:00100000:3.0:1780997032.362775:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997032.362796:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b0bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126847360:0@lo:400:kworker.0 00000100:00100000:3.0:1780997032.362820:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997032.362840:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1780997032.362847:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126846208:0@lo:400:kworker.0 00000100:00100000:3.0:1780997032.362875:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997032.362902:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126847104:0@lo:400:kworker.0 00000100:00100000:3.0:1780997032.363025:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126846336 00000100:00100000:3.0:1780997032.363033:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126846336 00000100:00100000:3.0:1780997032.363063:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126846592 00000100:00100000:3.0:1780997032.363066:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126846592 00000100:00100000:3.0:1780997032.363075:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126847232 00000100:00100000:3.0:1780997032.363077:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126847232 00000100:00100000:3.0:1780997032.363085:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126847744 00000100:00100000:3.0:1780997032.363094:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126847744 00000100:00100000:3.0:1780997032.363106:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126846464 00000100:00100000:3.0:1780997032.363108:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126846464 00000100:00100000:3.0:1780997032.363138:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1780997032.363148:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126846464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997032.363200:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126846464:12345-0@lo:400:kworker.0 Request processed in 55us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997032.363207:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1780997032.363223:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1780997032.363227:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126846336:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780997032.363248:0:63419:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3559 last 0 00000020:00000080:3.0:1780997032.363302:0:63419:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x30fd811c03059bec 00000004:00100000:3.0:1780997032.363320:0:63419:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780997032.363462:0:63419:0:(import.c:65:import_set_state_nolock()) ffff968986147000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780997032.363501:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3495:x1867507126846336:12345-0@lo:38:kworker.0 Request processed in 272us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997032.363508:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:1.0:1780997032.363611:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997032.363709:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b0bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126847616:0@lo:400:kworker.0 00000100:00100000:1.0:1780997032.363738:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997032.363758:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1780997032.363762:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126846720:0@lo:400:kworker.0 00000100:00100000:1.0:1780997032.363779:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997032.363789:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b0bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126847488:0@lo:400:kworker.0 00000100:00100000:1.0:1780997032.363809:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997032.363841:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126846720 00000100:00100000:1.0:1780997032.363845:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126846720 00000100:00100000:1.0:1780997032.364083:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:1.0:1780997032.364091:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126846720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997032.364131:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126846720:12345-0@lo:400:kworker.0 Request processed in 42us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997032.364137:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:1.0:1780997032.364150:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:1.0:1780997032.364155:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126846592:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780997032.364168:0:63584:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3559 last 0 00000020:00000080:1.0:1780997032.364194:0:63584:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x30fd811c03059bf3 00000004:00100000:1.0:1780997032.364204:0:63584:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780997032.364242:0:63584:0:(import.c:65:import_set_state_nolock()) ffff96888b415800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997032.364299:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3495:x1867507126846592:12345-0@lo:38:kworker.0 Request processed in 142us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997032.364305:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:1.0:1780997032.364318:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:1.0:1780997032.364322:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126847232:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780997032.364333:0:63584:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3559 last 0 00000020:00000080:1.0:1780997032.364358:0:63584:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x30fd811c03059bfa 00000004:00100000:1.0:1780997032.364364:0:63584:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780997032.364378:0:63584:0:(import.c:65:import_set_state_nolock()) ffff96888b413800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997032.364403:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3495:x1867507126847232:12345-0@lo:38:kworker.0 Request processed in 80us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997032.364424:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:1.0:1780997032.364436:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1780997032.364440:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126847744:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780997032.364450:0:63584:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3559 last 0 00000020:00000080:1.0:1780997032.364473:0:63584:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x30fd811c03059c01 00000004:00100000:1.0:1780997032.364478:0:63584:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780997032.364489:0:63584:0:(import.c:65:import_set_state_nolock()) ffff96888b410000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780997032.364622:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126846848 00000100:00100000:3.0:1780997032.364628:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126846848 00000100:00100000:3.0:1780997032.364732:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126847360 00000100:00100000:3.0:1780997032.364736:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126847360 00000100:00100000:3.0:1780997032.364761:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:3.0:1780997032.364765:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126846848:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780997032.364778:0:8242:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9689bfab0800, cookie 0x30fd811c03059a5d 00010000:00080000:3.0:1780997032.364782:0:8242:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411355 exp ffff9689bfab0800 cur 3559 last 1780997026 00000004:00100000:3.0:1780997032.367390:0:8242:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780997032.367453:0:8242:0:(import.c:65:import_set_state_nolock()) ffff968986142000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780997032.367595:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126846848:12345-0@lo:38:kworker.0 Request processed in 2825us (5171us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997032.367607:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000100:00100000:3.0:1780997032.367653:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:3.0:1780997032.367664:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126847360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997032.367709:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126847360:12345-0@lo:400:kworker.0 Request processed in 49us (4888us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997032.367715:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00100000:3.0:1780997032.367758:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126846976 00000100:00100000:3.0:1780997032.367766:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126846976 00000100:00100000:3.0:1780997032.367808:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126847616 00000100:00100000:3.0:1780997032.367812:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126847616 00000100:00100000:3.0:1780997032.367830:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126847488 00000100:00100000:3.0:1780997032.367833:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126847488 00000100:00100000:3.0:1780997032.367854:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478 00000100:00100000:3.0:1780997032.367860:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126846976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997032.367897:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126846976:12345-0@lo:400:kworker.0 Request processed in 37us (4286us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997032.367903:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478 00000100:00100000:3.0:1780997032.367914:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479 00000100:00100000:3.0:1780997032.367920:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126847616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997032.367948:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126847616:12345-0@lo:400:kworker.0 Request processed in 29us (4209us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997032.367954:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479 00000100:00100000:3.0:1780997032.367964:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480 00000100:00100000:3.0:1780997032.367970:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126847488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997032.367997:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126847488:12345-0@lo:400:kworker.0 Request processed in 27us (4187us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997032.368009:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480 00000100:00080000:0.0:1780997032.368032:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997032.368036:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1780997032.368038:0:83347:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00080000:0.0:1780997032.368038:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1780997032.368042:0:83347:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 98784247813 00000020:00080000:3.0:1780997032.368047:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997032.368050:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:3.0:1780997032.368054:0:83347:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:3.0:1780997032.368056:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997032.368066:0:83347:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110336512 t98784247813 from 192.168.206.51@tcp req@ffff9689bfaaca80 x1867507110336512/t0(98784247813) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:359/0 lens 528/0 e 0 to 0 dl 1780997039 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997032.368144:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997032.368205:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126846464:0@lo:400:kworker.0 00000100:00100000:3.0:1780997032.368219:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b0bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126847360:0@lo:400:kworker.0 00000100:00100000:3.0:1780997032.368262:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780997032.368289:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126847872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997032.368324:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997032.368436:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126847872 00000100:00100000:3.0:1780997032.368440:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126847872 00000100:00100000:3.0:1780997032.368464:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:3.0:1780997032.368470:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126847872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780997032.368491:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1780997032.368537:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126847872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997032.368544:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00000100:00100000:3.0:1780997032.368574:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126847872:0@lo:41:osp-pre-1-0.0 00000004:00080000:0.0:1780997032.369004:0:83347:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 891us 00000100:00100000:0.0:1780997032.369956:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126847104 00000100:00100000:0.0:1780997032.369963:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126847104 00000100:00100000:0.0:1780997032.370012:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481 00000100:00100000:0.0:1780997032.370020:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126847104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997032.370088:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126847104:12345-0@lo:400:kworker.0 Request processed in 69us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997032.370095:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481 00000100:00100000:0.0:1780997032.370128:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126846208 00000100:00100000:0.0:1780997032.370132:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126846208 00000100:00100000:0.0:1780997032.370156:0:83317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1780997032.370163:0:83317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126846208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997032.370197:0:83317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126846208:12345-0@lo:400:kworker.0 Request processed in 34us (7321us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997032.370202:0:83317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1780997032.370230:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997032.370254:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126846208:0@lo:400:kworker.0 00000100:00100000:0.0:1780997032.370286:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126847104:0@lo:400:kworker.0 00010000:00080000:0.0:1780997032.370329:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689bc954700 x1867507126846336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997032.370344:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00080000:0.0:1780997032.374249:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9689bc954700 x1867507126846336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997057 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997032.374266:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00100000:1.0:1780997032.374352:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1867507126847744:12345-0@lo:38:kworker.0 Request processed in 9907us (11853us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997032.374364:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1780997032.374471:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126846720:0@lo:400:kworker.0 00000100:00100000:1.0:1780997032.374488:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b0bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126847488:0@lo:400:kworker.0 00000100:00100000:1.0:1780997032.374501:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126846976:0@lo:400:kworker.0 00000100:00080000:0.0:1780997032.375023:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780997032.375029:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1780997032.375034:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126846336:0@lo:38:kworker.0 00010000:00080000:0.0:1780997032.375055:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689bc954380 x1867507126846592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997032.375070:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000100:00100000:1.0:1780997032.375217:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b0bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126847616:0@lo:400:kworker.0 00000100:00080000:0.0:1780997032.376188:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9689bc954380 x1867507126846592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997057 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997032.376200:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1780997032.376213:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780997032.376217:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1780997032.376221:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126846592:0@lo:38:kworker.0 00000100:00080000:0.0:1780997032.376246:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:0.0:1780997032.376255:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1780997032.376259:0:3495:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1780997032.376261:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:0.0:1780997032.376264:0:3495:0:(recover.c:53:ptlrpc_replay_next()) import ffff9689ae566000 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:0.0:1780997032.376322:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000001:00100000:2.0:1780997032.376946:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1780997032.377657:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126846848:0@lo:38:kworker.0 00010000:00080000:0.0:1780997032.377686:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689bc955880 x1867507126847232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997032.377700:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00000100:00080000:0.0:1780997032.378898:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9689bc955880 x1867507126847232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997057 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997032.378909:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1780997032.378915:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780997032.378918:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1780997032.378923:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126847232:0@lo:38:kworker.0 00010000:00080000:0.0:1780997032.378953:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689b0bdaa00 x1867507126847744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997032.378963:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:0.0:1780997032.378970:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1780997032.378973:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1780997032.378982:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968986141000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1780997032.378987:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b0bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126847744:0@lo:38:kworker.0 00010000:00080000:2.0:1780997032.382649:0:83642:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1780997032.382656:0:83642:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1780997032.382664:0:83642:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1780997032.383185:0:83642:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000001:00100000:1.0:1780997032.385774:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1780997032.387934:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126848000:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1780997032.388068:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997032.388191:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126848000 00000100:00100000:1.0:1780997032.388204:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126848000 00000100:00100000:1.0:1780997032.388249:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918 00000100:00100000:1.0:1780997032.388258:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126848000:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1780997032.388299:0:80061:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff9689b0bdad80 x1867507126848000/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:363/0 lens 224/0 e 0 to 0 dl 1780997043 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997032.388311:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126848000:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 55us (245us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997032.388318:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918 00000001:00100000:2.0:1780997032.388556:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1780997032.400697:0:83347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c03059c08 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.400722:0:83347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c03059c08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.400737:0:83347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c03059c08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.400750:0:83347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059c0f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.400757:0:83347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059c0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.400764:0:83347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059c0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.401179:0:83347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c03059c08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.401188:0:83347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c03059c08 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.401195:0:83347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c03059c08 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.401202:0:83347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997032.401207:0:83347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c03059c08 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.401230:0:83347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c03059c08 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.401243:0:83347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983653800) 00010000:00010000:0.0:1780997032.401246:0:83347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997032.401251:0:83347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c03059c08 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.401256:0:83347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02400/0x30fd811c03059c08 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997032.401292:0:83347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009792c853 reply state 00000000cecf01de transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059c0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.401302:0:83347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059c0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.401307:0:83347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff968983653a00) 00010000:00010000:0.0:1780997032.401309:0:83347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997032.401312:0:83347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1780997032.403575:0:83347:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1780997032.403611:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780997032.403614:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:0.0:1780997032.403618:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780997032.403620:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000100:00100000:3.0:1780997032.422321:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997032.422378:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110337024 00000100:00100000:3.0:1780997032.422388:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110337024 00000100:00100000:3.0:1780997032.422459:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1150 00000100:00100000:3.0:1780997032.422473:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2393:x1867507110337024:12345-192.168.206.51@tcp:36:rm.0 00010000:00080000:3.0:1780997032.422501:0:63419:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:3.0:1780997032.422517:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2393:x1867507110337024:12345-192.168.206.51@tcp:36:rm.0 Request processed in 49us (210us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997032.422531:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1150 00000020:00080000:3.0:1780997032.422555:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997032.422559:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:3.0:1780997032.422563:0:83347:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:3.0:1780997032.422566:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997032.422577:0:83347:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110337024 t98784247814 from 192.168.206.51@tcp req@ffff968986934700 x1867507110337024/t0(98784247814) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:363/0 lens 512/0 e 0 to 0 dl 1780997043 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1780997032.422691:0:83347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c03059c16 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.422708:0:83347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c03059c16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.422722:0:83347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c03059c16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.422733:0:83347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059c1d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.422741:0:83347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059c1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.422764:0:83347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059c1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.422855:0:83347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059c24 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.422863:0:83347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059c24 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.422870:0:83347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059c24 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423232:0:83347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059c24 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423241:0:83347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059c24 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423247:0:83347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059c24 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423254:0:83347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997032.423258:0:83347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059c24 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423266:0:83347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059c24 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423298:0:83347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9689964dc600) 00010000:00010000:3.0:1780997032.423301:0:83347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1780997032.423306:0:83347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059c24 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423317:0:83347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9a00/0x30fd811c03059c24 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423338:0:83347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c03059c16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423345:0:83347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c03059c16 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423350:0:83347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c03059c16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423355:0:83347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997032.423357:0:83347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c03059c16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423363:0:83347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c03059c16 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423371:0:83347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689964dc700) 00010000:00010000:3.0:1780997032.423373:0:83347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997032.423376:0:83347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c03059c16 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423381:0:83347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9200/0x30fd811c03059c16 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997032.423391:0:83347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d6b4966 reply state 00000000436d67ef transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059c1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423401:0:83347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059c1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.423422:0:83347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff968983653a00) 00010000:00010000:3.0:1780997032.423425:0:83347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997032.423427:0:83347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1780997032.423502:0:83347:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1780997032.423518:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997032.423521:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:3.0:1780997032.423524:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997032.423526:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:1.0:1780997032.430927:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997032.430972:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110338304 00000100:00100000:1.0:1780997032.430982:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110338304 00000100:00100000:1.0:1780997032.431036:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1151 00000100:00100000:1.0:1780997032.431046:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2393:x1867507110338304:12345-192.168.206.51@tcp:101:touch.0 00010000:00080000:1.0:1780997032.431082:0:65272:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:1.0:1780997032.431097:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2393:x1867507110338304:12345-192.168.206.51@tcp:101:touch.0 Request processed in 54us (182us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997032.431104:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1151 00000020:00080000:3.0:1780997032.433661:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997032.433671:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:3.0:1780997032.433677:0:83347:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:3.0:1780997032.433680:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997032.433695:0:83347:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110338304 t98784247815 from 192.168.206.51@tcp req@ffff9689b0bda680 x1867507110338304/t0(98784247815) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:363/0 lens 752/0 e 0 to 0 dl 1780997043 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1780997032.433726:0:83347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997032.433750:0:83347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8200/0x30fd811c03059c2b lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8aea expref: -99 pid: 83347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.434123:0:83347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059c32 lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.434139:0:83347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059c32 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.434150:0:83347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059c32 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.434162:0:83347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c03059c39 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.434175:0:83347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c03059c39 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.434181:0:83347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c03059c39 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780997032.435847:0:83347:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x5:0x0], cookie = 0x30fd811c030599b5 00000004:00080000:3.0:1780997032.435857:0:83347:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x30fd811c030599b5 in new mfd 00010000:00010000:3.0:1780997032.435871:0:83347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059c32 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.435882:0:83347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059c32 lrc: 2/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.435890:0:83347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059c32 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.436010:0:83347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997032.436016:0:83347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059c32 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.436024:0:83347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059c32 lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.436040:0:83347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9689964dcf00) 00010000:00010000:3.0:1780997032.436043:0:83347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997032.436048:0:83347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059c32 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.436055:0:83347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059c32 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997032.436085:0:83347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007542bcd0 reply state 0000000097db72fe transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c03059c39 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.436100:0:83347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c03059c39 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.436107:0:83347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9689964dc000) 00010000:00010000:3.0:1780997032.436110:0:83347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997032.436113:0:83347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1780997032.436152:0:83347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8200/0x30fd811c03059c2b lrc: 1/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aea expref: 12 pid: 83347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.436164:0:83347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9689964dcf00) 00010000:00010000:3.0:1780997032.436166:0:83347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997032.436170:0:83347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8200/0x30fd811c03059c2b lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aea expref: 12 pid: 83347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.436189:0:83347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8200, rc 0) 00010000:00080000:3.0:1780997032.436307:0:83347:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1780997032.436331:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997032.436335:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:3.0:1780997032.436339:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997032.436341:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:1.0:1780997032.473038:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997032.473221:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110338560 00000100:00100000:1.0:1780997032.473230:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110338560 00000100:00100000:1.0:1780997032.473308:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1152 00000100:00100000:1.0:1780997032.473319:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2393:x1867507110338560:12345-192.168.206.51@tcp:36:touch.0 00010000:00080000:1.0:1780997032.473351:0:63418:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 98784247816, current: 98784247816, replaying 00000100:00100000:1.0:1780997032.473366:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2393:x1867507110338560:12345-192.168.206.51@tcp:36:touch.0 Request processed in 49us (336us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997032.473496:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1152 00000020:00080000:1.0:1780997032.473996:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780997032.474002:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247816, next_transno: 98784247816 00010000:00080000:1.0:1780997032.474006:0:83347:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247816) 00000020:00080000:1.0:1780997032.474010:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780997032.474019:0:83347:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110338560 t98784247816 from 192.168.206.51@tcp req@ffff9689b0bd9c00 x1867507110338560/t0(98784247816) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:363/0 lens 488/0 e 0 to 0 dl 1780997043 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1780997032.474144:0:83347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c03059c47 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.474161:0:83347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c03059c47 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.474176:0:83347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c03059c47 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997032.474334:0:83347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007261b0cd reply state 000000008c08ac00 transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c03059c47 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.474359:0:83347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c03059c47 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.474368:0:83347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff96888760fd00) 00010000:00010000:1.0:1780997032.474499:0:83347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997032.474503:0:83347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1780997032.474788:0:83347:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1780997032.474879:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780997032.474883:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000020:00080000:1.0:1780997032.474886:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780997032.474889:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000100:00100000:3.0:1780997032.477300:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997032.477343:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110338944 00000100:00100000:3.0:1780997032.477351:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110338944 00000100:00100000:3.0:1780997032.477393:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 218 00000100:00100000:3.0:1780997032.477401:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:2393:x1867507110338944:12345-192.168.206.51@tcp:35:touch.0 00010000:00080000:3.0:1780997032.477440:0:63420:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 98784247817, current: 98784247817, replaying 00000100:00100000:3.0:1780997032.477452:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:2393:x1867507110338944:12345-192.168.206.51@tcp:35:touch.0 Request processed in 52us (185us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997032.477460:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 218 00000020:00080000:1.0:1780997032.478056:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780997032.478067:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247817, next_transno: 98784247817 00010000:00080000:1.0:1780997032.478071:0:83347:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247817) 00000020:00080000:1.0:1780997032.478075:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780997032.478085:0:83347:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110338944 t98784247817 from 192.168.206.51@tcp req@ffff968986937480 x1867507110338944/t0(98784247817) o35->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:363/0 lens 392/0 e 0 to 0 dl 1780997043 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997032.478367:0:83347:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1780997032.478382:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780997032.478385:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000020:00080000:1.0:1780997032.478388:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780997032.478389:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000100:00100000:1.0:1780997032.484227:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997032.484286:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110344576 00000100:00100000:1.0:1780997032.484297:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110344576 00000100:00100000:1.0:1780997032.484355:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1139 00000100:00100000:1.0:1780997032.484377:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+15:2393:x1867507110344576:12345-192.168.206.51@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1780997032.484403:0:63419:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff9689b0bdb480 x1867507110344576/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:363/0 lens 224/0 e 0 to 0 dl 1780997043 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997032.484433:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+15:2393:x1867507110344576:12345-192.168.206.51@tcp:400:ldlm_lock_repla.0 Request processed in 70us (217us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997032.484441:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1139 00000020:00080000:1.0:1780997032.484462:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780997032.484465:0:83347:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247818 00010000:00080000:1.0:1780997032.484469:0:83347:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1780997032.484471:0:83347:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780997032.484479:0:83347:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1780997032.484482:0:83347:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1780997032.484619:0:83347:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:1.0:1780997032.486170:0:83312:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000001:00100000:1.0:1780997032.486179:0:83312:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1780997032.486197:0:83312:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00010000:00010000:1.0:1780997032.486237:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059c0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486249:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059c0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486258:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059c0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486265:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997032.486297:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059c0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486305:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059c0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486327:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059c0f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486344:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c03059c0f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486360:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059c1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486367:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059c1d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486386:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059c1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486391:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997032.486395:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059c1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486401:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059c1d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486418:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059c1d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486424:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c03059c1d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486444:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c03059c39 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486451:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c03059c39 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486457:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c03059c39 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486461:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997032.486464:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c03059c39 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486470:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c03059c39 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486483:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c03059c39 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486489:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c03059c39 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486502:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c03059c47 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486740:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c03059c47 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486750:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c03059c47 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486756:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997032.486759:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c03059c47 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486765:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c03059c47 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486775:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c03059c47 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.486781:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c03059c47 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83347 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780997032.486831:0:83347:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1780997032.486865:0:83347:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1780997032.486877:0:83347:0:(ldlm_lib.c:2924:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9689b0bdad80 x1867507126848000/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:363/0 lens 224/0 e 0 to 0 dl 1780997043 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1780997032.486997:0:83347:0:(ldlm_lib.c:2924:target_recovery_thread()) @@@ processing final ping from 192.168.206.51@tcp: req@ffff9689b0bdb480 x1867507110344576/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:363/0 lens 224/0 e 0 to 0 dl 1780997043 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1780997032.487051:0:83347:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1780997032.499362:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1780997032.499379:0:3495:0:(client.c:3253:ptlrpc_resend_req()) @@@ going to resend req@ffff9689bc86f100 x1867507126848000/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997048 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780997032.499389:0:3495:0:(client.c:3262:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9689bc86f100 x1867507126848000/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997048 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780997032.499396:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1780997032.499420:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1780997032.499424:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126848000:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1780997032.499511:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126848128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997032.499571:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997032.499618:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126848128 00000100:00100000:2.0:1780997032.499631:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126848128 00000100:00100000:2.0:1780997032.504782:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:2.0:1780997032.504808:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126848128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780997032.504853:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445265408 avail 1299025920 00000100:00100000:2.0:1780997032.504955:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126848128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (5384us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997032.504962:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00100000:0.0:1780997032.505232:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126848128:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1780997032.538002:0:83347:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8c8c72f3e10 00100000:10000000:0.0:1780997032.538018:0:83347:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1780997032.543023:0:83333:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x282:0x0] 00000004:00080000:3.0:1780997032.543026:0:83335:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x90:0x0] 00000100:00100000:3.0:1780997032.543081:0:83335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986935f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83335:1867507126848256:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1780997032.543081:0:83333:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b0bd8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83333:1867507126848384:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1780997032.543584:0:83335:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997032.543616:0:83335:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689869fab40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997032.543725:0:83333:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997032.543780:0:83333:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689836009c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997032.544084:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126848256 00000100:00100000:3.0:1780997032.544095:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126848256 00000100:00100000:0.0:1780997032.544424:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126848384 00000100:00100000:0.0:1780997032.544437:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126848384 00000100:00100000:0.0:1780997032.544513:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5917 00000100:00100000:0.0:1780997032.544534:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:83335:x1867507126848256:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1780997032.544564:0:25168:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -593 00002000:02000040:0.0:1780997032.544569:0:25168:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:145 to 0x2c0000401:737) 00000100:00100000:1.0:1780997032.544801:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5918 00000100:00100000:1.0:1780997032.544811:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:83333:x1867507126848384:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1780997032.544825:0:23044:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -95 00002000:02000040:1.0:1780997032.544828:0:23044:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:643 to 0x280000400:737) 00002000:00010000:0.0:1780997032.559911:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.559926:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c03059c4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.559944:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.559946:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.559952:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c03059c4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.559980:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c03059c4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.559992:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c03059c4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.560001:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c03059c4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.560024:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997032.560037:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997032.560043:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c03059c4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.560069:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997032.560073:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c03059c4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.560081:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c03059c4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.560098:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c03059c4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.560107:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c03059c4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.560123:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.560124:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.560126:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997032.560239:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.560245:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c03059c55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.560253:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.560255:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.560258:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c03059c55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.560268:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c03059c55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.560841:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c03059c55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.560848:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c03059c55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571095:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997032.571119:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997032.571128:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c03059c55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571142:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997032.571148:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c03059c55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571159:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c03059c55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571180:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c03059c55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571187:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c03059c55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571207:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.571622:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.571625:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997032.571786:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.571793:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c03059c5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571806:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.571808:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.571814:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c03059c5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571826:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c03059c5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571835:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c03059c5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571844:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c03059c5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571893:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997032.571933:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.571938:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c03059c63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571946:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.571947:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.571950:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c03059c63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571983:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c03059c63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571990:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c03059c63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.571998:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c03059c63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.572060:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997032.572067:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c03059c5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.572076:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.572080:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c03059c5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.572089:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c03059c5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.572101:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c03059c5c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.572107:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c03059c5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.572134:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.572138:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c03059c63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.572145:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.572149:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c03059c63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.572157:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c03059c63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.572168:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c03059c63 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.572175:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.572177:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.572178:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.572210:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780997032.572262:0:25168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c03059c63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997032.572336:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.572341:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051b2093c/0x30fd811c03059c6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.572350:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.572351:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.572355:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051b2093c/0x30fd811c03059c6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.572364:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051b2093c/0x30fd811c03059c6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.572372:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051b2093c/0x30fd811c03059c6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.572385:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051b2093c/0x30fd811c03059c6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.572400:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997032.574478:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.574491:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051b2093c/0x30fd811c03059c6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.574503:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997032.574609:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.574764:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051b2093c/0x30fd811c03059c6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.574794:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051b2093c/0x30fd811c03059c6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.574816:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051b2093c/0x30fd811c03059c6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.574823:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051b2093c/0x30fd811c03059c6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.574849:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.574851:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.574852:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997032.574904:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.574910:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c03059c71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.574920:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.574922:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.574927:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c03059c71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.574936:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c03059c71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.574944:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c03059c71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.574952:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c03059c71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575075:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997032.575118:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.575122:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c03059c78 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575136:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.575137:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.575140:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c03059c78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575149:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c03059c78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575156:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c03059c78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575164:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c03059c78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575179:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1780997032.575187:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780997032.575191:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c03059c71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575199:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997032.575202:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c03059c71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.575583:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.575589:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c03059c78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.575597:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.575600:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c03059c78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.575608:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c03059c78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.575619:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c03059c78 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.575636:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c03059c78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.575652:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.575654:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.575655:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.575757:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c03059c71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575780:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c03059c71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575787:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c03059c71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575800:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.575801:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.575803:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997032.575847:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.575851:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c03059c7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575858:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.575860:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.575863:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c03059c7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575871:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c03059c7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575879:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c03059c7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575886:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c03059c7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.575940:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997032.576040:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.576045:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c03059c7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576052:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.576055:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c03059c7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576062:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c03059c7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576071:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c03059c7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576077:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c03059c7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576089:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.576090:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.576100:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997032.576139:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.576144:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c03059c86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.576152:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.576153:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.576156:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c03059c86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.576164:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c03059c86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.576173:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c03059c86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.576181:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c03059c86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.576224:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997032.576259:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.576264:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c03059c8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.576296:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.576298:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.576305:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c03059c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.576318:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c03059c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.576326:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c03059c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.576333:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c03059c8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576478:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997032.576483:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c03059c86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576490:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.576494:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c03059c86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576501:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c03059c86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576519:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c03059c86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576527:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c03059c86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576540:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.576543:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c03059c8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576549:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.576552:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c03059c8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576559:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c03059c8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576580:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c03059c8d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.576587:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.576589:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.576591:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.578780:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780997032.578795:0:25168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c03059c8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997032.578966:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.578975:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c03059c94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.578989:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.578991:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.578997:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c03059c94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.579010:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c03059c94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.579040:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c03059c94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.579048:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c03059c94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.580432:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.580443:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c03059c94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.580455:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.580459:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c03059c94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.580469:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c03059c94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.580488:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c03059c94 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.580498:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.580500:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.580502:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.580645:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780997032.580653:0:25168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c03059c94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997032.580789:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.580795:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c03059c9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.580804:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.580805:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.580809:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c03059c9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.580819:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c03059c9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.580827:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c03059c9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.580834:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c03059c9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.580926:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.580931:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c03059c9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.580948:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.580952:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c03059c9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.580958:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c03059c9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.580976:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c03059c9b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.580983:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.580985:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.580986:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.581117:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780997032.581123:0:25168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c03059c9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997032.581176:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.581181:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c03059ca2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.581189:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.581190:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.581193:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c03059ca2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.581202:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c03059ca2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.581209:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c03059ca2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.581216:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c03059ca2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.581782:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.581789:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c03059ca2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.581798:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.581801:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c03059ca2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.581809:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c03059ca2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.581820:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c03059ca2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.581833:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.581835:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.581837:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.581906:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780997032.581911:0:25168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c03059ca2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997032.581986:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.581991:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c03059ca9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.581999:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.582000:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.582003:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c03059ca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.582012:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c03059ca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.582019:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c03059ca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.582026:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c03059ca9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.582050:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.582055:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c03059ca9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.582061:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.582065:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c03059ca9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.582075:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c03059ca9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.582085:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c03059ca9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.582092:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.582093:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.582095:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.582227:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780997032.582232:0:25168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c03059ca9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997032.582308:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.582313:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c03059cb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.582332:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.582333:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.582336:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c03059cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.582345:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c03059cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.582352:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c03059cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.582359:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c03059cb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.582484:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.582490:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c03059cb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.582496:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.582499:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c03059cb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.582524:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c03059cb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.582536:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c03059cb0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.582544:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.582545:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.582547:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.582732:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780997032.582737:0:25168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c03059cb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997032.582825:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.582831:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c03059cb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.582838:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.582840:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.582843:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c03059cb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.582863:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c03059cb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.582870:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c03059cb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.582877:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c03059cb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.582901:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997032.582942:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.582946:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c03059cbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.582953:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.582955:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.582958:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c03059cbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.582993:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.583000:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c03059cb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.583009:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.583013:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c03059cb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.583020:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c03059cb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.583029:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c03059cbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.583036:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c03059cb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.583039:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c03059cbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.583051:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c03059cbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.583073:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997032.583075:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c03059cb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.583083:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997032.583088:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c03059cbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.583092:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.583096:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.583098:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.583099:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.583103:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c03059cbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.583113:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c03059cbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.583124:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c03059cbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.583131:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c03059cbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.583145:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.583147:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.583149:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997032.583188:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.583194:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c03059cc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.583201:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.583207:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.583210:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c03059cc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.583642:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c03059cc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.583651:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c03059cc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.583657:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c03059cc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.589571:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.590183:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997032.590486:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.590494:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c03059cc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.590516:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.590522:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c03059cc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.590533:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c03059cc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.590553:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c03059cc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.590561:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c03059cc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.590590:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.590592:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.590593:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997032.590665:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.590675:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059ccc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.590688:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.590690:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.590696:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059ccc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997032.590763:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.590784:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059cd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.590793:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.590796:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.590800:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059cd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.590812:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059cd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.590822:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059cd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.590830:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059cd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.590846:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997032.590862:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.590868:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059cd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.590873:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059ccc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.590877:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.590883:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059cd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.590886:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059ccc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.590902:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059cd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.590904:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059ccc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.590927:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059cd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.590945:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005fa4b8d/0x30fd811c03059cd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.590960:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997032.590962:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.590967:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059ccc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.590973:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.590977:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059ccc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.590984:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059ccc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591008:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059ccc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591015:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059ccc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997032.591025:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.591029:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.591032:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059cda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591033:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.591036:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.591044:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.591046:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.591049:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059cda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591057:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059cda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591065:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059cda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591071:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059cda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591087:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997032.591103:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.591110:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f16438d/0x30fd811c03059ce1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591117:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.591119:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.591122:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f16438d/0x30fd811c03059ce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591130:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f16438d/0x30fd811c03059ce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591138:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f16438d/0x30fd811c03059ce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591144:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f16438d/0x30fd811c03059ce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591166:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780997032.591209:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.591214:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb6af9a1/0x30fd811c03059ce8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591222:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.591223:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.591226:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb6af9a1/0x30fd811c03059ce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591228:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997032.591236:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059cda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591238:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb6af9a1/0x30fd811c03059ce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591256:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.591260:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb6af9a1/0x30fd811c03059ce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591262:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059cda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591327:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb6af9a1/0x30fd811c03059ce8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591356:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780997032.591362:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997032.591366:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f16438d/0x30fd811c03059ce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591372:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.591375:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f16438d/0x30fd811c03059ce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591391:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f16438d/0x30fd811c03059ce1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591402:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f16438d/0x30fd811c03059ce1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591420:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f16438d/0x30fd811c03059ce1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591433:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.591437:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb6af9a1/0x30fd811c03059ce8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591443:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.591446:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb6af9a1/0x30fd811c03059ce8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591453:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb6af9a1/0x30fd811c03059ce8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591462:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb6af9a1/0x30fd811c03059ce8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591469:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb6af9a1/0x30fd811c03059ce8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591493:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.591494:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.591496:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780997032.591538:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.591544:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0b1e/0x30fd811c03059cef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591552:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.591554:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.591557:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0b1e/0x30fd811c03059cef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.591566:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0b1e/0x30fd811c03059cef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591863:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059cda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591875:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059cda lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591883:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059cda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591895:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.591897:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.591898:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997032.591947:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.591953:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059cf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591961:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.591977:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.591981:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591991:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.591998:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.592015:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059cf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.592031:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997032.592039:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997032.592043:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059cf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.592050:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.592053:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059cf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.592062:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.592072:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059cf6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.592080:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059cf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.592092:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.593151:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0b1e/0x30fd811c03059cef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593172:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0b1e/0x30fd811c03059cef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593196:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997032.593266:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.593285:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f457437/0x30fd811c03059cfd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593306:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.593308:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.593312:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f457437/0x30fd811c03059cfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593322:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f457437/0x30fd811c03059cfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593331:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f457437/0x30fd811c03059cfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593339:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f457437/0x30fd811c03059cfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593349:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780997032.593387:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.593392:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005749adda/0x30fd811c03059d04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593400:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.593401:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.593404:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005749adda/0x30fd811c03059d04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593421:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005749adda/0x30fd811c03059d04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593439:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005749adda/0x30fd811c03059d04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593446:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005749adda/0x30fd811c03059d04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593455:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1780997032.593492:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00002000:00010000:1.0:1780997032.593497:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997032.593500:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0b1e/0x30fd811c03059cef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593503:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c03059d0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593513:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.593515:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.593517:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c03059d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593525:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.593530:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0b1e/0x30fd811c03059cef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593554:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0b1e/0x30fd811c03059cef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.593556:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c03059d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593580:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0b1e/0x30fd811c03059cef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593589:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee9a0b1e/0x30fd811c03059cef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593606:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997032.593609:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f457437/0x30fd811c03059cfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593615:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.593624:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f457437/0x30fd811c03059cfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593632:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f457437/0x30fd811c03059cfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593641:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f457437/0x30fd811c03059cfd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593648:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f457437/0x30fd811c03059cfd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593659:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.593662:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005749adda/0x30fd811c03059d04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593668:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.593670:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005749adda/0x30fd811c03059d04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593678:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005749adda/0x30fd811c03059d04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593687:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005749adda/0x30fd811c03059d04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593694:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005749adda/0x30fd811c03059d04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.593715:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.593717:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.593718:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.593725:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.594831:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.594835:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.594837:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997032.594861:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997032.594869:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021736cf5/0x30fd811c03059d12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.594882:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997032.594884:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997032.594887:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021736cf5/0x30fd811c03059d12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.594897:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021736cf5/0x30fd811c03059d12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.594905:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021736cf5/0x30fd811c03059d12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.594912:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021736cf5/0x30fd811c03059d12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.595260:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997032.595436:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.595443:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021736cf5/0x30fd811c03059d12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.595463:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.595467:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021736cf5/0x30fd811c03059d12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.595476:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021736cf5/0x30fd811c03059d12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.595490:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021736cf5/0x30fd811c03059d12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.595497:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021736cf5/0x30fd811c03059d12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.595580:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.595582:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.595584:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997032.596046:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.596054:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c03059d19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596064:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.596065:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.596069:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c03059d19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596079:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c03059d19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596087:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c03059d19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596426:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c03059d19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596445:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780997032.596492:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.596497:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c03059d20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596505:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.596506:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.596509:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c03059d20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596529:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c03059d20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596536:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c03059d20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596543:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c03059d20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596559:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780997032.596569:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997032.596573:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c03059d19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596580:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.596584:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c03059d19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596593:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c03059d19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596603:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c03059d19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596609:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c03059d19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.596631:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.597420:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.598282:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c03059d20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.598298:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.598303:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c03059d20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.598312:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c03059d20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.598326:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c03059d20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.598334:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c03059d20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.598418:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.598420:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.598422:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.598477:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c03059d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.598491:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c03059d0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.598516:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780997032.598520:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.598527:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c03059d27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.598538:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.598548:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.598553:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c03059d27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.598565:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c03059d27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.598574:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c03059d27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.598581:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c03059d27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997032.598588:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.598594:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059d2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.598597:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780997032.598606:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.598609:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997032.598609:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.598613:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059d2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.598616:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c03059d0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.598632:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.598634:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059d2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.598644:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059d2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.598652:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059d2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.598659:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.598669:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997032.599664:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c03059d0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.599677:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c03059d0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.599689:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c03059d0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.600164:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deb4836d/0x30fd811c03059d0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.600189:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997032.600193:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059d2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.600201:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6da400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.600205:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059d2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.600213:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059d2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.600224:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059d2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.600231:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aebfecd7/0x30fd811c03059d2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.600244:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.600246:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.606486:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997032.606958:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.606969:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001656ce6c/0x30fd811c03059d35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.606995:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.606997:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.607003:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001656ce6c/0x30fd811c03059d35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.607017:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001656ce6c/0x30fd811c03059d35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.607028:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001656ce6c/0x30fd811c03059d35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.607037:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001656ce6c/0x30fd811c03059d35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.607881:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780997032.607978:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.607986:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c03059d3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.607997:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.607999:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.608003:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c03059d3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608013:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c03059d3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608036:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c03059d3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608045:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c03059d3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608055:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780997032.608347:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.608355:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c03059d43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608363:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.608364:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.608367:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c03059d43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608376:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c03059d43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608383:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c03059d43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608389:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c03059d43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608417:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1780997032.608438:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780997032.608444:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001656ce6c/0x30fd811c03059d35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608452:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.608456:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001656ce6c/0x30fd811c03059d35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608465:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001656ce6c/0x30fd811c03059d35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608481:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001656ce6c/0x30fd811c03059d35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608489:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001656ce6c/0x30fd811c03059d35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608726:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997032.608731:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c03059d3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608738:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.608741:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c03059d3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608749:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c03059d3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608770:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c03059d3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608776:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c03059d3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608791:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997032.608794:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c03059d43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608799:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.608802:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c03059d43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608808:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c03059d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608815:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c03059d43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608821:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c03059d43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608831:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.608833:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.608840:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997032.608895:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.608900:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c03059d4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608907:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.608908:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.608911:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c03059d4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608919:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c03059d4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608925:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c03059d4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608932:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c03059d4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608945:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997032.608951:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997032.608955:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c03059d4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608961:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.608964:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c03059d4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608985:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c03059d4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.608996:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c03059d4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609003:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c03059d4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609015:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.609017:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.609019:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997032.609061:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.609066:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c03059d51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609073:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.609075:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.609078:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c03059d51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609086:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c03059d51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609304:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c03059d51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609324:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c03059d51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609337:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997032.609345:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997032.609349:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c03059d51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609356:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.609358:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c03059d51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609365:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c03059d51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609375:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c03059d51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609381:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c03059d51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609393:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.609395:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.609396:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997032.609448:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.609459:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c03059d58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609466:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.609468:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.609471:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c03059d58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609480:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c03059d58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609488:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c03059d58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609495:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c03059d58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609693:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997032.609702:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997032.609706:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c03059d58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609712:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.609716:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c03059d58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609722:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c03059d58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609745:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c03059d58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609752:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c03059d58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609766:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.609767:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.609769:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997032.609812:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.609817:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c03059d5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609824:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.609825:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.609828:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c03059d5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609837:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c03059d5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609845:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c03059d5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.609854:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c03059d5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.609863:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.610048:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.610055:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c03059d5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610064:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.610068:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c03059d5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610077:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c03059d5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610096:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c03059d5f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610106:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.610108:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.610131:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1780997032.610233:0:23044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c03059d5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997032.610309:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.610315:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c03059d66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.610323:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.610325:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.610328:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c03059d66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.610336:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c03059d66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.610343:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c03059d66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.610350:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c03059d66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.610427:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c03059d27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.610437:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.610441:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c03059d27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.610466:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c03059d27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.610477:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c03059d27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.610485:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c03059d27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.610501:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997032.610505:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c03059d66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.610512:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997032.610515:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c03059d66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.610522:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c03059d66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.610532:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c03059d66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997032.610539:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.610541:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.610588:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.610636:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.610690:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1780997032.610696:0:23044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c03059d66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997032.610723:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.610730:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059d6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610739:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.610741:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.610744:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059d6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610755:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059d6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610763:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059d6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610769:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059d6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997032.610771:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.610781:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c03059d74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.610790:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.610792:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.610793:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997032.610795:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c03059d74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610802:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997032.610807:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c03059d74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610815:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059d6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.610819:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c03059d74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610831:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dae00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.610835:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c03059d74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610837:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059d6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610857:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059d6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.610864:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997032.610869:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059d6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610877:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae0d85c4/0x30fd811c03059d6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610897:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.610901:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c03059d74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997032.610906:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.610911:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.610914:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c03059d7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610916:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c03059d74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.610935:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.610937:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c03059d74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.610939:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.610944:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c03059d7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.610969:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c03059d7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.610982:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c03059d7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610984:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c03059d74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.610994:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c03059d7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.610997:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c03059d74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611012:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997032.611019:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.611024:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c03059d7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611031:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.611034:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c03059d7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611041:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c03059d7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611052:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c03059d7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997032.611055:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.611067:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c03059d82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611067:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c03059d7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611089:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.611090:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.611093:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c03059d82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611094:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.611098:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.611105:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c03059d82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611107:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.611115:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c03059d82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611115:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.611124:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c03059d82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611155:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997032.611159:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.611165:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c03059d82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611172:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.611175:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c03059d82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611182:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c03059d82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611194:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c03059d82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611201:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c03059d82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997032.611203:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.611213:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c03059d89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611222:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.611223:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.611226:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c03059d89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611234:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c03059d89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611241:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c03059d89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611247:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c03059d89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611258:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780997032.611336:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.611340:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c03059d90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611347:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.611348:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.611357:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c03059d90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611365:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c03059d90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611373:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c03059d90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611380:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c03059d90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611388:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1780997032.611422:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780997032.611429:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c03059d89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611437:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997032.611440:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c03059d89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997032.611441:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.611452:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c03059d97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611455:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c03059d89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611468:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.611471:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.611475:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c03059d97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611476:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c03059d89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611496:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c03059d97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611520:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c03059d97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611521:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c03059d89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611549:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997032.611556:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c03059d97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611556:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c03059d90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611576:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.611581:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997032.611582:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c03059d90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611593:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c03059d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611605:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c03059d90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611613:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c03059d90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997032.611624:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997032.611627:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997032.611631:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c03059d9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611632:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c03059d97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611651:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997032.611652:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.611655:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.611658:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c03059d9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611664:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c03059d97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611672:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c03059d9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611677:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c03059d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611688:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c03059d9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611694:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c03059d97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611697:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c03059d9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611713:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c03059d97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611717:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997032.611733:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997032.611737:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c03059d9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611744:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997032.611747:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c03059d9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611756:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c03059d9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997032.611758:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.611769:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c03059da5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611773:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c03059d9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611788:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c03059d9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611792:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.611795:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.611799:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c03059da5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611813:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c03059da5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.611815:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.611818:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.611822:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.611825:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c03059da5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611833:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c03059da5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611855:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997032.611897:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.611902:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c03059da5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997032.611903:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.611914:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c03059dac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611916:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.611922:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c03059da5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611927:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.611930:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.611934:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c03059dac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611953:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c03059dac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611956:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c03059da5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611973:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c03059da5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611979:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c03059dac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.611984:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c03059da5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.611994:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c03059dac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612003:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.612006:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997032.612007:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.612014:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c03059dac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612021:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.612024:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c03059dac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612033:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c03059dac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612043:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c03059dac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997032.612050:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.612051:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c03059dac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.612056:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059db3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.612078:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.612080:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.612084:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059db3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612086:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.612089:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.612092:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.612100:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780997032.612125:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.612130:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059dba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612139:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.612140:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.612143:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059dba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612152:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059dba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612160:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059dba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612167:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059dba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612182:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997032.612189:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.612192:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059dba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612210:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.612213:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059dba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.612427:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.612470:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059dba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612483:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059dba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612490:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c64905b9/0x30fd811c03059dba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612504:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.612506:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.612508:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780997032.612556:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.612561:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026ec4514/0x30fd811c03059dc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612568:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.612570:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.612573:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026ec4514/0x30fd811c03059dc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612581:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026ec4514/0x30fd811c03059dc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612596:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026ec4514/0x30fd811c03059dc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612603:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026ec4514/0x30fd811c03059dc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612625:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997032.612667:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.612672:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef332c85/0x30fd811c03059dc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612680:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.612682:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.612685:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef332c85/0x30fd811c03059dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612693:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef332c85/0x30fd811c03059dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612701:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef332c85/0x30fd811c03059dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612708:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef332c85/0x30fd811c03059dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612720:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780997032.612763:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.612769:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a17f6ec/0x30fd811c03059dcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612776:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.612778:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.612780:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a17f6ec/0x30fd811c03059dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612789:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a17f6ec/0x30fd811c03059dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612796:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a17f6ec/0x30fd811c03059dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612802:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a17f6ec/0x30fd811c03059dcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612815:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1780997032.612822:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780997032.612826:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026ec4514/0x30fd811c03059dc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612833:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.612836:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026ec4514/0x30fd811c03059dc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612844:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026ec4514/0x30fd811c03059dc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612864:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026ec4514/0x30fd811c03059dc1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612871:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026ec4514/0x30fd811c03059dc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612885:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997032.612888:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef332c85/0x30fd811c03059dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612894:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dbe00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.612897:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef332c85/0x30fd811c03059dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612904:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef332c85/0x30fd811c03059dc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612914:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef332c85/0x30fd811c03059dc8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612920:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef332c85/0x30fd811c03059dc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612933:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.612936:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a17f6ec/0x30fd811c03059dcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612948:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.612951:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a17f6ec/0x30fd811c03059dcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612959:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a17f6ec/0x30fd811c03059dcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612969:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a17f6ec/0x30fd811c03059dcf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612976:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a17f6ec/0x30fd811c03059dcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.612989:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.612991:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.612993:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780997032.613033:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997032.613039:0:25168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000315c80e8/0x30fd811c03059dd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.613047:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.613049:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997032.613052:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000315c80e8/0x30fd811c03059dd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.613061:0:25168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000315c80e8/0x30fd811c03059dd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.613075:0:25168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000315c80e8/0x30fd811c03059dd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.613082:0:25168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000315c80e8/0x30fd811c03059dd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.613095:0:25168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997032.613102:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997032.613106:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000315c80e8/0x30fd811c03059dd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.613113:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dbc00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997032.613116:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000315c80e8/0x30fd811c03059dd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.613123:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000315c80e8/0x30fd811c03059dd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.613135:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000315c80e8/0x30fd811c03059dd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.613143:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000315c80e8/0x30fd811c03059dd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997032.613157:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.613164:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997032.613166:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.613382:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.613388:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.614777:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059db3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.614799:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059db3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.614809:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059db3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.614844:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997032.615394:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997032.615402:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059db3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.615420:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997032.615426:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059db3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.615434:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059db3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.615452:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059db3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.615459:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c03059db3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.615482:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.615484:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.615486:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997032.615598:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997032.615667:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.615675:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059ddd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.615686:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.615688:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.615693:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059ddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.615703:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059ddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.615711:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059ddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.615717:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059ddd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.615735:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997032.615745:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997032.615752:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059ddd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.615761:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997032.615764:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059ddd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.615773:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059ddd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.615785:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059ddd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997032.615786:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.615797:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059de4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.615799:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000040f23cc/0x30fd811c03059ddd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.615819:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.615822:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.615826:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059de4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.615828:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.615832:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.615835:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.615841:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059de4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.615858:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059de4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.615865:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059de4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.615888:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997032.615983:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997032.615989:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059de4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.615996:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997032.616000:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059de4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.616020:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059de4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.616031:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059de4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.616039:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c03059de4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.616051:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.616053:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.616055:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997032.616426:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.616433:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000924b876/0x30fd811c03059deb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616442:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.616444:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.616447:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000924b876/0x30fd811c03059deb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616456:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000924b876/0x30fd811c03059deb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616465:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000924b876/0x30fd811c03059deb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616472:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000924b876/0x30fd811c03059deb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616489:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997032.616504:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997032.616508:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000924b876/0x30fd811c03059deb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616516:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc843200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997032.616520:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000924b876/0x30fd811c03059deb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616528:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000924b876/0x30fd811c03059deb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616539:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000924b876/0x30fd811c03059deb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616546:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000924b876/0x30fd811c03059deb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616559:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.616561:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.616563:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997032.616619:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.616625:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c03059df2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616741:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.616744:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.616748:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c03059df2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616771:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c03059df2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616780:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c03059df2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616788:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c03059df2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616810:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780997032.616863:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.616869:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020246fb0/0x30fd811c03059df9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616878:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.616880:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.616883:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020246fb0/0x30fd811c03059df9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616893:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020246fb0/0x30fd811c03059df9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616901:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020246fb0/0x30fd811c03059df9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616909:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020246fb0/0x30fd811c03059df9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.616931:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1780997032.616992:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780997032.616998:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c03059df2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617006:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997032.617009:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c03059df2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617018:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c03059df2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617029:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c03059df2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617047:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c03059df2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997032.617053:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.617060:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c03059e00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617063:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997032.617071:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020246fb0/0x30fd811c03059df9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.617072:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.617076:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.617081:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c03059e00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617083:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997032.617089:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020246fb0/0x30fd811c03059df9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.617097:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c03059e00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617101:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020246fb0/0x30fd811c03059df9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617121:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020246fb0/0x30fd811c03059df9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.617122:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c03059e00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617143:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020246fb0/0x30fd811c03059df9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.617145:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c03059e00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617171:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997032.617176:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c03059e00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.617177:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780997032.617186:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc843a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997032.617194:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c03059e00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617203:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c03059e00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617213:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c03059e00 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617221:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.617222:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.617224:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.617231:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997032.617248:0:23044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c03059e00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.617301:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997032.617346:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997032.617351:0:23044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c03059e07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.617366:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.617368:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997032.617372:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c03059e07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.617381:0:23044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c03059e07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.617390:0:23044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c03059e07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.617398:0:23044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c03059e07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997032.617470:0:23044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997032.617533:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997032.617539:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c03059e07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617547:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc843000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997032.617551:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c03059e07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617560:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c03059e07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617572:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c03059e07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617591:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c03059e07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997032.617607:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.617610:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997032.617612:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1780997032.618123:0:23044:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:642 00000100:00100000:2.0:1780997032.618325:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:83333:x1867507126848384:12345-0@lo:5:osp-pre-0-0.0 Request processed in 73511us (74593us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997032.618335:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5918 00000100:00100000:0.0:1780997032.619205:0:83333:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b0bd8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83333:1867507126848384:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1780997032.619231:0:83333:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x2e1:0x0] from OST, last_created [0x280000400:0x2e1:0x0]last_used is [0x280000400:0x282:0x0] 00000100:00100000:0.0:1780997032.620536:0:83333:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83333:1867507126848640:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1780997032.620596:0:83333:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997032.620631:0:83333:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689ba1df480 going to sleep for 11 seconds 00000100:00100000:3.0:1780997032.620636:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126848640 00000100:00100000:3.0:1780997032.620644:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126848640 00000100:00100000:0.0:1780997032.620663:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126848512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780997032.620689:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5919 00000100:00100000:0.0:1780997032.620690:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997032.620698:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:83333:x1867507126848640:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1780997032.620813:0:8233:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 738 00000100:00100000:3.0:1780997032.623675:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:83333:x1867507126848640:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2970us (3071us total) trans 4294969450 rc 0/0 00000100:00100000:3.0:1780997032.623687:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5919 00000100:00100000:3.0:1780997032.623749:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126848512 00000100:00100000:3.0:1780997032.623756:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126848512 00000100:00100000:3.0:1780997032.623792:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:3.0:1780997032.623800:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126848512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780997032.623822:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997032.623859:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126848512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (3168us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997032.623866:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:3.0:1780997032.623915:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126848512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780997032.623974:0:83333:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83333:1867507126848640:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1780997032.623988:0:83333:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x2e1:0x0]-[0x280000400:0x301:0x0] 00002000:00080000:1.0:1780997032.626583:0:25168:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:144 00000100:00100000:1.0:1780997032.626678:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:83335:x1867507126848256:12345-0@lo:5:osp-pre-1-0.0 Request processed in 82153us (83092us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997032.626688:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5917 00000100:00100000:3.0:1780997032.626729:0:83335:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986935f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83335:1867507126848256:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1780997032.626744:0:83335:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2e1:0x0] from OST, last_created [0x2c0000401:0x2e1:0x0]last_used is [0x2c0000401:0x90:0x0] 00000100:00100000:3.0:1780997032.626819:0:83335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986936300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83335:1867507126848896:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1780997032.626854:0:83335:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997032.626886:0:83335:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689869fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1780997032.626906:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126848896 00000100:00100000:3.0:1780997032.626911:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126848896 00000100:00100000:3.0:1780997032.626946:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5920 00000100:00100000:3.0:1780997032.626953:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:83335:x1867507126848896:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1780997032.627002:0:25179:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 738 00000100:00100000:0.0:1780997032.629502:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997032.629534:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126848768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780997032.629580:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997032.629590:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:83335:x1867507126848896:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2637us (2736us total) trans 4294969450 rc 0/0 00000100:00100000:3.0:1780997032.629599:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5920 00000100:00100000:3.0:1780997032.629652:0:83335:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986936300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83335:1867507126848896:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1780997032.629664:0:83335:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2e1:0x0]-[0x2c0000401:0x301:0x0] 00000100:00100000:1.0:1780997032.630882:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126848768 00000100:00100000:1.0:1780997032.630893:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126848768 00000100:00100000:1.0:1780997032.630939:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:1.0:1780997032.630948:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126848768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780997032.630979:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997032.631035:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126848768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997032.631042:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:0.0:1780997032.631193:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126848768:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1780997032.677480:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1780997033.109053:0:83686:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1780997033.109765:0:83686:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1780997033.384642:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780997033.384664:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888d7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126849024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997033.384737:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997033.384821:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126849024 00000100:00100000:2.0:1780997033.384829:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126849024 00000100:00100000:2.0:1780997033.384876:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:2.0:1780997033.384885:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126849024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780997033.384907:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997033.384972:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997033.384979:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126849024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997033.384979:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126849152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997033.384986:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:0.0:1780997033.385003:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997033.385028:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126849152 00000100:00100000:2.0:1780997033.385031:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126849152 00000100:00100000:2.0:1780997033.385062:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:2.0:1780997033.385069:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126849152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997033.385079:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997033.385089:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888d7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126849024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997033.385108:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126849152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997033.385114:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:0.0:1780997033.385188:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126849152:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1780997033.703234:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997033.735774:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997033.735831:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997033.735901:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110344704 00000100:00100000:2.0:1780997033.735913:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110344704 00000100:00100000:0.0:1780997033.735950:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110344960 00000100:00100000:0.0:1780997033.735957:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110344960 00000100:00100000:2.0:1780997033.735995:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:2.0:1780997033.736007:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:5bc603cc-b633-43af-a003-872c004686c8+9:2396:x1867507110344704:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997033.736028:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1140 00000100:00100000:0.0:1780997033.736039:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110344960:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997033.736087:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:5bc603cc-b633-43af-a003-872c004686c8+9:2396:x1867507110344704:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 82us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997033.736096:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110344960:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 59us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997033.736097:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:0.0:1780997033.736110:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1140 00000100:00080000:1.0:1780997033.738905:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997033.742529:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997033.742860:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110344832 00000100:00100000:1.0:1780997033.742872:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110344832 00000100:00100000:1.0:1780997033.742941:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1141 00000100:00100000:1.0:1780997033.742953:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110344832:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997033.743049:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110344832:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 99us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997033.743057:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1141 00010000:00010000:2.0:1780997034.727096:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997034.979425:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997034.979507:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110345088 00000100:00100000:1.0:1780997034.979519:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110345088 00000100:00100000:1.0:1780997034.979603:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1153 00000100:00100000:1.0:1780997034.979615:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:66088:x1867507110345088:12345-192.168.206.51@tcp:101:lfs.0 00000100:00080000:0.0:1780997034.979630:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1780997034.979650:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997034.979673:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db600/0x30fd811c03059e0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b0d expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997034.979738:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db800/0x30fd811c03059e15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997034.979752:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db800/0x30fd811c03059e15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997034.979765:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db800/0x30fd811c03059e15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997034.979835:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780997034.979839:0:63419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780997034.979880:0:63419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db800/0x30fd811c03059e15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997034.979905:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db600/0x30fd811c03059e0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b0d expref: 8 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997034.979923:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db800/0x30fd811c03059e15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b0d expref: 7 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997034.979933:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96888760f400) 00010000:00010000:1.0:1780997034.979936:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780997034.979939:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96898d6db800, rc 0) 00000100:00100000:1.0:1780997034.980009:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:66088:x1867507110345088:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 397us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997034.980017:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1153 00000100:00100000:3.0:1780997034.987425:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997034.987508:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110345216 00000100:00100000:0.0:1780997034.987518:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110345216 00000100:00100000:0.0:1780997034.987584:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1154 00000100:00100000:0.0:1780997034.987671:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:66088:x1867507110345216:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:0.0:1780997034.987715:0:65272:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445265408 avail 1299025920 00000100:00100000:0.0:1780997034.987810:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:66088:x1867507110345216:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 215us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997034.987818:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1154 00000100:00100000:2.0:1780997034.989747:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997034.989901:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110345344 00000100:00100000:1.0:1780997034.989910:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110345344 00000100:00100000:1.0:1780997034.989965:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1155 00000100:00100000:1.0:1780997034.989974:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:66088:x1867507110345344:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:1.0:1780997034.990010:0:63418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1780997034.990073:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:66088:x1867507110345344:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 99us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997034.990081:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1155 00000100:00100000:2.0:1780997035.007445:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997035.008446:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110345472 00000100:00100000:0.0:1780997035.008460:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110345472 00000100:00100000:0.0:1780997035.008517:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5921 00000100:00100000:0.0:1780997035.008527:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2393:x1867507110345472:12345-192.168.206.51@tcp:8:lfs.0 00010000:00080000:0.0:1780997035.008563:0:25171:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp t0 exp 0000000000000000 cur 3562 last 0 00000020:00000080:0.0:1780997035.008602:0:25171:0:(genops.c:1406:class_connect()) connect: client 285c134c-d3a6-4c01-bb4d-8148c50d5f95, cookie 0x30fd811c03059e1c 00002000:00100000:0.0:1780997035.008616:0:25171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 285c134c-d3a6-4c01-bb4d-8148c50d5f95/ffff9689886b0000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1780997035.008649:0:25171:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1780997035.008722:0:25171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1780997035.008755:0:25171:0:(import.c:65:import_set_state_nolock()) ffff9689886b4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997035.009041:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110345472:12345-192.168.206.51@tcp:8:lfs.0 Request processed in 513us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997035.009048:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5921 00000100:00100000:3.0:1780997035.014493:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997035.014648:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110345600 00000100:00100000:2.0:1780997035.014660:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110345600 00000100:00100000:2.0:1780997035.014756:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1984 00000100:00100000:2.0:1780997035.014768:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:66088:x1867507110345600:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1780997035.014827:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997035.014917:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:66088:x1867507110345600:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 151us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997035.014924:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1984 00000100:00080000:0.0:1780997035.015500:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997035.019404:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997035.019552:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110345728 00000100:00100000:0.0:1780997035.019565:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110345728 00000100:00100000:0.0:1780997035.019619:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5922 00000100:00100000:0.0:1780997035.019627:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2393:x1867507110345728:12345-192.168.206.51@tcp:8:lfs.0 00010000:00080000:0.0:1780997035.019663:0:25181:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp t0 exp 0000000000000000 cur 3562 last 0 00000020:00000080:0.0:1780997035.019704:0:25181:0:(genops.c:1406:class_connect()) connect: client 285c134c-d3a6-4c01-bb4d-8148c50d5f95, cookie 0x30fd811c03059e23 00002000:00100000:0.0:1780997035.019719:0:25181:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 285c134c-d3a6-4c01-bb4d-8148c50d5f95/ffff9689ba41c800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1780997035.019739:0:25181:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1780997035.019810:0:25181:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1780997035.019845:0:25181:0:(import.c:65:import_set_state_nolock()) ffff9689ba419000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997035.019923:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110345728:12345-192.168.206.51@tcp:8:lfs.0 Request processed in 294us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997035.019931:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5922 00000100:00100000:1.0:1780997035.026784:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997035.026886:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110345856 00000100:00100000:2.0:1780997035.026898:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110345856 00000100:00100000:2.0:1780997035.026977:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1985 00000100:00100000:2.0:1780997035.026990:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:66088:x1867507110345856:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1780997035.027021:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997035.027098:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:66088:x1867507110345856:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 111us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997035.027106:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1985 00000100:00080000:0.0:1780997035.027780:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1780997035.751470:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997036.773603:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997037.477971:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126849408:0@lo:400:kworker.0 00000100:00100000:1.0:1780997037.478060:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997037.478119:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780997037.478126:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126849280:0@lo:400:kworker.0 00000100:00100000:1.0:1780997037.478160:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997037.478349:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126849408 00000100:00100000:2.0:1780997037.478357:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126849408 00000100:00100000:2.0:1780997037.478428:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:2.0:1780997037.478439:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126849408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.478493:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126849408:12345-0@lo:400:kworker.0 Request processed in 56us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997037.478500:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1780997037.478672:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126849536:0@lo:400:kworker.0 00000100:00100000:0.0:1780997037.478702:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997037.478747:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997037.478753:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126849664:0@lo:400:kworker.0 00000100:00100000:0.0:1780997037.478792:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997037.478819:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126849536 00000100:00100000:0.0:1780997037.478823:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126849536 00000100:00100000:0.0:1780997037.479951:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126849664 00000100:00100000:0.0:1780997037.479960:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126849664 00000100:00100000:3.0:1780997037.480067:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126849280 00000100:00100000:3.0:1780997037.480073:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126849280 00000100:00100000:3.0:1780997037.480116:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1780997037.480125:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126849280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997037.480183:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126849280:12345-0@lo:400:kworker.0 Request processed in 60us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997037.480191:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1780997037.480282:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997037.480287:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780997037.481240:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1780997037.481255:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126849536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.481332:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126849536:12345-0@lo:400:kworker.0 Request processed in 83us (2629us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997037.481339:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1780997037.481373:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:2.0:1780997037.481391:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507126849664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.481424:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507126849664:12345-0@lo:400:kworker.0 Request processed in 46us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997037.481430:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:2.0:1780997037.481524:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126849792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997037.481561:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997037.481637:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997037.481644:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126849920:0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.481670:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997037.481694:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126849920 00000100:00100000:2.0:1780997037.481699:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126849920 00000100:00100000:2.0:1780997037.481736:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1780997037.481742:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126849920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.481776:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126849920:12345-0@lo:400:kworker.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997037.481782:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00080000:2.0:1780997037.481797:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997037.481928:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126849920:0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.481971:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997037.481980:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126850048:0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.482076:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997037.482207:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126849664:0@lo:400:kworker.0 00000100:00100000:0.0:1780997037.482220:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126849536:0@lo:400:kworker.0 00000100:00100000:0.0:1780997037.482266:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126849280:0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.482345:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126849792 00000100:00100000:2.0:1780997037.482350:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126849792 00000100:00100000:2.0:1780997037.482374:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126850048 00000100:00100000:2.0:1780997037.482386:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126850048 00000100:00100000:2.0:1780997037.482405:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:2.0:1780997037.482420:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126849792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780997037.482448:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1780997037.482484:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126849792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997037.482490:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00000100:00100000:2.0:1780997037.482502:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:2.0:1780997037.482508:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126850048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.482538:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126850048:12345-0@lo:400:kworker.0 Request processed in 30us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997037.482544:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000100:00100000:2.0:1780997037.482571:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126850048:0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.482596:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126849792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997037.482647:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126850176:0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.482673:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997037.482717:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126850304:0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.482738:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997037.482778:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997037.482785:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126850432:0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.482808:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997037.483083:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126849408:0@lo:400:kworker.0 00000100:00100000:0.0:1780997037.483122:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126850176 00000100:00100000:0.0:1780997037.483126:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126850176 00000100:00100000:0.0:1780997037.483159:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126850304 00000100:00100000:0.0:1780997037.483163:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126850304 00000100:00100000:0.0:1780997037.483183:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:0.0:1780997037.483190:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126850176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997037.483229:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126850176:12345-0@lo:400:kworker.0 Request processed in 39us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997037.483236:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00100000:0.0:1780997037.483249:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:0.0:1780997037.483255:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126850304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.483332:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126850432 00000100:00100000:2.0:1780997037.483336:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126850432 00000100:00100000:2.0:1780997037.483361:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1780997037.483367:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126850432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997037.483607:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126850304:12345-0@lo:400:kworker.0 Request processed in 351us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997037.483615:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00080000:0.0:1780997037.483638:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997037.483642:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780997037.483652:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126850688:0@lo:400:kworker.0 00000100:00100000:0.0:1780997037.483688:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997037.483717:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126850176:0@lo:400:kworker.0 00000100:00100000:0.0:1780997037.483728:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780997037.483733:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126850560:0@lo:400:kworker.0 00000100:00100000:0.0:1780997037.483755:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997037.483781:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126850688 00000100:00100000:0.0:1780997037.483784:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126850688 00000100:00100000:0.0:1780997037.483814:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126850560 00000100:00100000:0.0:1780997037.483818:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126850560 00000100:00100000:2.0:1780997037.483914:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126850432:12345-0@lo:400:kworker.0 Request processed in 547us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997037.483927:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1780997037.483952:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126850816:0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.483978:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997037.484016:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126850432:0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.484040:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126850304:0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.484079:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126850816 00000100:00100000:2.0:1780997037.484082:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126850816 00000100:00100000:2.0:1780997037.484309:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1780997037.484317:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126850816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.484358:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126850816:12345-0@lo:400:kworker.0 Request processed in 42us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997037.484364:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1780997037.484403:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126850816:0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.484444:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484 00000100:00100000:2.0:1780997037.484451:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126850688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997037.484490:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126850688:12345-0@lo:400:kworker.0 Request processed in 39us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997037.484496:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484 00000100:00080000:2.0:1780997037.484525:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997037.484529:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997037.484548:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126850688:0@lo:400:kworker.0 00000100:00100000:0.0:1780997037.484795:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485 00000100:00100000:0.0:1780997037.484803:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126850560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997037.484914:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126850560:12345-0@lo:400:kworker.0 Request processed in 112us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997037.484922:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485 00000100:00100000:2.0:1780997037.485191:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126850560:0@lo:400:kworker.0 00010000:00010000:0.0:1780997037.799599:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997037.989745:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126850944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997037.989820:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997037.989926:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126850944 00000100:00100000:0.0:1780997037.989937:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126850944 00000100:00100000:0.0:1780997037.989993:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986 00000100:00100000:0.0:1780997037.990003:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126850944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780997037.990035:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997037.990083:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126850944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997037.990090:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986 00000100:00100000:1.0:1780997037.990236:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126850944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997037.990407:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126851200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997037.990454:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997037.990485:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997037.990493:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126851072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780997037.990516:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997037.990701:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126851072 00000100:00100000:0.0:1780997037.990706:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126851072 00000100:00100000:0.0:1780997037.990743:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:0.0:1780997037.990750:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126851072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780997037.990774:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997037.990814:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126851072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997037.990821:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00100000:0.0:1780997037.990853:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126851072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997037.990919:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126851200 00000100:00100000:1.0:1780997037.990924:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126851200 00000100:00100000:1.0:1780997037.990967:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:1.0:1780997037.990975:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126851200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780997037.990998:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445265408 avail 1299025920 00000100:00100000:1.0:1780997037.991035:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126851200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997037.991052:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00000100:00100000:0.0:1780997037.991252:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126851200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997038.502055:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780997038.502080:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126851328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997038.502147:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997038.502190:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126851328 00000100:00100000:1.0:1780997038.502196:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126851328 00000100:00100000:1.0:1780997038.502241:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:1.0:1780997038.502250:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126851328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997038.502303:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997038.502349:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126851328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997038.502356:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:1.0:1780997038.502412:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126851328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997038.508475:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997038.508498:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126851456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997038.508588:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997038.508638:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126851456 00000100:00100000:2.0:1780997038.508645:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126851456 00000100:00100000:2.0:1780997038.508685:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1780997038.508693:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126851456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997038.508714:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997038.508757:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126851456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997038.508764:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1780997038.508812:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126851456:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1780997038.520401:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000001:00080000:0.0:1780997038.520420:0:9294:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969450 is committed 00000001:00100000:2.0:1780997038.535391:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000001:00080000:2.0:1780997038.535406:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969450 is committed 00010000:00010000:3.0:1780997038.828422:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997038.863707:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997038.863755:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997038.863781:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997038.863809:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997038.863836:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997038.863869:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110345984 00000100:00100000:1.0:1780997038.863880:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110345984 00000100:00100000:1.0:1780997038.863940:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:1.0:1780997038.863951:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110345984:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997038.864018:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110345984:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997038.864026:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:0.0:1780997038.864463:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110346112 00000100:00100000:0.0:1780997038.864469:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110346112 00000100:00100000:0.0:1780997038.864531:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110346240 00000100:00100000:0.0:1780997038.864534:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110346240 00000100:00100000:0.0:1780997038.864560:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1148 00000100:00100000:0.0:1780997038.864568:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110346112:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997038.864603:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110346112:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997038.864610:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1148 00000100:00100000:0.0:1780997038.864624:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1149 00000100:00100000:0.0:1780997038.864630:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110346240:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997038.864654:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110346240:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997038.864661:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1149 00000100:00080000:0.0:1780997038.864678:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780997038.864681:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780997038.864995:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110346368 00000100:00100000:2.0:1780997038.865000:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110346368 00000100:00100000:2.0:1780997038.865036:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110346496 00000100:00100000:2.0:1780997038.865039:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110346496 00000100:00100000:2.0:1780997038.865063:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2486 00000100:00100000:2.0:1780997038.865069:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110346368:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997038.865096:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110346368:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997038.865113:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2486 00000100:00100000:2.0:1780997038.865126:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2487 00000100:00100000:2.0:1780997038.865131:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110346496:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997038.865154:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110346496:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 23us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997038.865160:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2487 00000100:00080000:0.0:1780997038.869034:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997038.869068:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1780997038.887881:0:83782:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:3.0:1780997039.845783:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1780997040.596135:0:83831:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1780997040.872759:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997041.893833:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997042.317062:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997042.317153:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110346624 00000100:00100000:2.0:1780997042.317168:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110346624 00000100:00100000:2.0:1780997042.317309:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1156 00000100:00100000:2.0:1780997042.317322:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:66535:x1867507110346624:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:2.0:1780997042.317380:0:63418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445265408 avail 1299025920 00000100:00100000:2.0:1780997042.317455:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:66535:x1867507110346624:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 137us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997042.317464:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1156 00000100:00080000:3.0:1780997042.318104:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997042.324968:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997042.325261:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110346752 00000100:00100000:0.0:1780997042.325311:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110346752 00000100:00100000:0.0:1780997042.325398:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1157 00000100:00100000:0.0:1780997042.325411:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:66535:x1867507110346752:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:0.0:1780997042.325454:0:80049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780997042.325857:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:66535:x1867507110346752:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 447us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997042.325866:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1157 00000100:00080000:3.0:1780997042.325937:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997042.341037:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997042.341478:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110346880 00000100:00100000:0.0:1780997042.341492:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110346880 00000100:00080000:3.0:1780997042.341722:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780997042.341751:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1990 00000100:00100000:0.0:1780997042.341769:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:66535:x1867507110346880:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1780997042.341812:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997042.341894:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:66535:x1867507110346880:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 130us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997042.342775:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1990 00000100:00100000:1.0:1780997042.344450:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997042.344551:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110347008 00000100:00100000:2.0:1780997042.344562:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110347008 00000100:00100000:2.0:1780997042.344746:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1991 00000100:00100000:2.0:1780997042.344756:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:66535:x1867507110347008:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1780997042.344791:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1780997042.344794:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997042.344865:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:66535:x1867507110347008:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 110us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997042.344873:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1991 00000100:00100000:1.0:1780997042.382174:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997042.382344:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110347136 00000100:00100000:0.0:1780997042.382367:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110347136 00000100:00100000:0.0:1780997042.382439:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1158 00000100:00100000:0.0:1780997042.382452:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:66552:x1867507110347136:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1780997042.382480:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997042.382503:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059e2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b14 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382599:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382636:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382649:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382666:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382673:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382679:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382780:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955c00/0x30fd811c03059e3f lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382788:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955c00/0x30fd811c03059e3f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382795:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955c00/0x30fd811c03059e3f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997042.382834:0:65272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1780997042.382837:0:65272:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997042.382857:0:65272:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968888955c00/0x30fd811c03059e3f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382871:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e31 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382887:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e31 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382893:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382900:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382907:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997042.382913:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382921:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e31 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382948:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96888760f400) 00010000:00010000:0.0:1780997042.382951:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997042.382955:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e31 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382961:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382978:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382983:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382988:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.382998:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997042.383002:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.383007:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.383015:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9689896fe200) 00010000:00010000:0.0:1780997042.383017:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997042.383019:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.383024:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.383066:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059e2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b14 expref: 9 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.383081:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955c00/0x30fd811c03059e3f lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b14 expref: 8 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.383090:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9689896fe900) 00010000:00010000:0.0:1780997042.383092:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780997042.383095:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955c00, rc 0) 00000100:00100000:0.0:1780997042.383164:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:66552:x1867507110347136:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 715us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997042.383172:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1158 00000100:00100000:1.0:1780997042.388633:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997042.388797:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110347392 00000100:00100000:2.0:1780997042.388826:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110347392 00000100:00100000:2.0:1780997042.388888:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1159 00000100:00100000:2.0:1780997042.388897:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:66552:x1867507110347392:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780997042.388918:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997042.388939:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843600/0x30fd811c03059e46 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b1b expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389016:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e4d lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389030:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e4d lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389042:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e4d lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389055:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843200/0x30fd811c03059e54 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389062:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843200/0x30fd811c03059e54 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389068:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843200/0x30fd811c03059e54 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389148:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e4d lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389155:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e4d lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389161:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e4d lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389173:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e4d lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389180:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997042.389184:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e4d lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389191:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e4d lrc: 5/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389204:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9689896fe900) 00010000:00010000:2.0:1780997042.389207:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997042.389212:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e4d lrc: 3/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389218:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e4d lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389231:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843200/0x30fd811c03059e54 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389237:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843200/0x30fd811c03059e54 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389243:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843200/0x30fd811c03059e54 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389248:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc843200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997042.389251:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843200/0x30fd811c03059e54 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389897:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843200/0x30fd811c03059e54 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389915:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff968889ed0300) 00010000:00010000:2.0:1780997042.389918:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997042.389922:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843200/0x30fd811c03059e54 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389928:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843200/0x30fd811c03059e54 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389968:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843600/0x30fd811c03059e46 lrc: 1/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b1b expref: 9 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389979:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9689896fe900) 00010000:00010000:2.0:1780997042.389981:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780997042.389985:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843600/0x30fd811c03059e46 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b1b expref: 9 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.389996:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc843600, rc 0) 00000100:00100000:2.0:1780997042.390068:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:66552:x1867507110347392:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1171us (1446us total) trans 0 rc 301/301 00000100:00100000:2.0:1780997042.390076:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1159 00000100:00100000:1.0:1780997042.394759:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997042.394883:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110347648 00000100:00100000:2.0:1780997042.394893:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110347648 00000100:00100000:2.0:1780997042.394955:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1160 00000100:00100000:2.0:1780997042.394965:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:66552:x1867507110347648:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780997042.395003:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997042.395022:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b22 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997042.395131:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1780997042.395248:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b22 expref: 10 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.395264:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96888760f400) 00010000:00010000:2.0:1780997042.395302:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780997042.395310:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b22 expref: 10 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997042.395334:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc842000, rc 0) 00000100:00100000:2.0:1780997042.395407:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:66552:x1867507110347648:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 443us (659us total) trans 103079215105 rc 301/301 00000100:00100000:2.0:1780997042.395415:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1160 00000100:00100000:1.0:1780997042.406379:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997042.407322:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110347776 00000100:00100000:0.0:1780997042.407361:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110347776 00000100:00100000:0.0:1780997042.407432:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1161 00000100:00100000:0.0:1780997042.407444:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:66552:x1867507110347776:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1780997042.407532:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059e69 lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.407551:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059e69 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.407563:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059e69 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.407580:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e70 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.407588:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e70 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.407595:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e70 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.407697:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e77 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.407706:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e77 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.407713:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e77 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997042.407773:0:65272:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997042.407789:0:65272:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e77 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409358:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059e69 lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409366:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059e69 lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409372:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059e69 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409379:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059e69 lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409384:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997042.409388:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059e69 lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409395:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059e69 lrc: 5/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409409:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9689896fe900) 00010000:00010000:0.0:1780997042.409412:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997042.409416:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059e69 lrc: 3/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409422:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059e69 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409441:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e70 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409446:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e70 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409462:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e70 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409466:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997042.409469:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e70 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409475:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e70 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409483:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9689896fe200) 00010000:00010000:0.0:1780997042.409485:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997042.409488:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e70 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409495:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059e70 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409512:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e77 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409518:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e77 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409524:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e77 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409529:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997042.409531:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e77 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409548:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e77 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409556:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9689896fe400) 00010000:00010000:0.0:1780997042.409558:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997042.409561:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e77 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997042.409567:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c03059e77 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997042.409657:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:66552:x1867507110347776:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 2213us (3286us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997042.409667:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1161 00000100:00100000:1.0:1780997042.414401:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997042.414514:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110348032 00000100:00100000:3.0:1780997042.414526:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110348032 00000100:00100000:3.0:1780997042.414610:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:3.0:1780997042.414621:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:66552:x1867507110348032:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1780997042.414851:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:66552:x1867507110348032:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 232us (460us total) trans 103079215106 rc 0/0 00000100:00100000:3.0:1780997042.414859:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:0.0:1780997042.597648:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126851968:0@lo:400:kworker.0 00000100:00100000:0.0:1780997042.597718:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997042.597762:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126852480:0@lo:400:kworker.0 00000100:00100000:0.0:1780997042.597786:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997042.597798:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126852992:0@lo:400:kworker.0 00000100:00100000:0.0:1780997042.597817:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997042.597837:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1780997042.597843:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126851840:0@lo:400:kworker.0 00000100:00100000:0.0:1780997042.597863:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997042.597878:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126852352:0@lo:400:kworker.0 00000100:00100000:0.0:1780997042.597898:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997042.597912:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126852864:0@lo:400:kworker.0 00000100:00100000:0.0:1780997042.597948:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997042.597982:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126852480 00000100:00100000:0.0:1780997042.597989:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126852480 00000100:00100000:0.0:1780997042.598041:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126852992 00000100:00100000:0.0:1780997042.598045:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126852992 00000100:00100000:0.0:1780997042.598063:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126852352 00000100:00100000:0.0:1780997042.598066:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126852352 00000100:00100000:0.0:1780997042.598085:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126852864 00000100:00100000:0.0:1780997042.598087:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126852864 00000100:00100000:0.0:1780997042.598108:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488 00000100:00100000:0.0:1780997042.598116:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126852480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997042.598168:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126852480:12345-0@lo:400:kworker.0 Request processed in 53us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997042.598174:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488 00000100:00100000:0.0:1780997042.598190:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489 00000100:00100000:0.0:1780997042.598196:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126852992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997042.598219:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126852992:12345-0@lo:400:kworker.0 Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997042.598224:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489 00000100:00100000:0.0:1780997042.598233:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:0.0:1780997042.598238:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126852352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997042.598259:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126852352:12345-0@lo:400:kworker.0 Request processed in 20us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997042.598264:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00100000:0.0:1780997042.598304:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:0.0:1780997042.598311:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126852864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997042.598339:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126852864:12345-0@lo:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997042.598363:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00080000:0.0:1780997042.598391:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780997042.598394:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997042.598430:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126852352:0@lo:400:kworker.0 00000100:00100000:0.0:1780997042.598441:0:3497:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 2 00000100:00100000:0.0:1780997042.598460:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126852864:0@lo:400:kworker.0 00000100:00100000:0.0:1780997042.598470:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126852480:0@lo:400:kworker.0 00000100:00100000:0.0:1780997042.598478:0:3497:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 2 00000100:00100000:0.0:1780997042.598486:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126852992:0@lo:400:kworker.0 00000100:00100000:1.0:1780997042.598709:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126851712:0@lo:400:kworker.0 00000100:00100000:1.0:1780997042.598744:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997042.598762:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126852224:0@lo:400:kworker.0 00000100:00100000:1.0:1780997042.598785:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997042.598799:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126852736:0@lo:400:kworker.0 00000100:00100000:1.0:1780997042.598823:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997042.598840:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1780997042.598847:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126851584:0@lo:400:kworker.0 00000100:00100000:1.0:1780997042.598874:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997042.598896:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126852224 00000100:00100000:3.0:1780997042.598903:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126852224 00000100:00100000:1.0:1780997042.598907:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126852096:0@lo:400:kworker.0 00000100:00100000:3.0:1780997042.598936:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126852736 00000100:00100000:3.0:1780997042.598940:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126852736 00000100:00100000:3.0:1780997042.598961:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:3.0:1780997042.598967:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126852224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997042.599014:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126852224:12345-0@lo:400:kworker.0 Request processed in 46us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997042.599021:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997042.599027:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00000100:00100000:3.0:1780997042.599045:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:1.0:1780997042.599049:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126852608:0@lo:400:kworker.0 00000100:00100000:3.0:1780997042.599056:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126852736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997042.599258:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997042.599281:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126853248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997042.599318:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126851968 00000100:00100000:0.0:1780997042.599322:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126851968 00000100:00100000:0.0:1780997042.599366:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126851840 00000100:00100000:0.0:1780997042.599369:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126851840 00000100:00100000:0.0:1780997042.599389:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126851712 00000100:00100000:0.0:1780997042.599393:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126851712 00000100:00100000:0.0:1780997042.599404:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126852096 00000100:00100000:0.0:1780997042.599407:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126852096 00000100:00100000:0.0:1780997042.599418:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1780997042.599424:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126851968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997042.602805:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126852736:12345-0@lo:400:kworker.0 Request processed in 3741us (3968us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997042.602820:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:3.0:1780997042.602920:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1780997042.602934:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126851840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997042.602999:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126851840:12345-0@lo:400:kworker.0 Request processed in 70us (5133us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997042.603006:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1780997042.603022:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1780997042.603028:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126851712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997042.603054:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126851712:12345-0@lo:400:kworker.0 Request processed in 28us (4311us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997042.603059:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1780997042.603068:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1780997042.603074:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126852096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997042.603099:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126852096:12345-0@lo:400:kworker.0 Request processed in 25us (4083us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997042.603104:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1780997042.603149:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126851840:0@lo:400:kworker.0 00000100:00100000:3.0:1780997042.603214:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126851584 00000100:00100000:3.0:1780997042.603221:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126851584 00000100:00100000:3.0:1780997042.603253:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1780997042.603258:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126851584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997042.603312:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126851584:12345-0@lo:400:kworker.0 Request processed in 53us (4437us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997042.603331:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1780997042.603387:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997042.603393:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997042.605926:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997042.605975:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126853120:0@lo:400:kworker.0 00000100:00100000:3.0:1780997042.606022:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126852608 00000100:00100000:3.0:1780997042.606031:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126852608 00000100:00100000:1.0:1780997042.606046:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997042.606051:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997042.606090:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126853120 00000100:00100000:1.0:1780997042.606095:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126853120 00000100:00100000:3.0:1780997042.606101:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1780997042.606111:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126853248 00000100:00100000:3.0:1780997042.606114:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126852608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997042.606117:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126853248 00000100:00100000:1.0:1780997042.606132:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:2.0:1780997042.606157:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:1.0:1780997042.606162:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126853120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997042.606170:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126853248:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997042.606175:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126852608:12345-0@lo:400:kworker.0 Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997042.606184:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000004:00000024:2.0:1780997042.606202:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1780997042.606209:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126853120:12345-0@lo:400:kworker.0 Request processed in 53us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997042.606216:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1780997042.606261:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126853120:0@lo:400:kworker.0 00000100:00100000:1.0:1780997042.606296:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126851712:0@lo:400:kworker.0 00000100:00100000:1.0:1780997042.606308:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126852224:0@lo:400:kworker.0 00000100:00100000:1.0:1780997042.606317:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126852736:0@lo:400:kworker.0 00000100:00100000:1.0:1780997042.606342:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126851584:0@lo:400:kworker.0 00000100:00100000:1.0:1780997042.606365:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126852096:0@lo:400:kworker.0 00000100:00100000:1.0:1780997042.606374:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126852608:0@lo:400:kworker.0 00000100:00100000:2.0:1780997042.606594:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126853248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 428us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997042.606610:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000100:00100000:3.0:1780997042.606711:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126853248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997042.607438:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126851968:12345-0@lo:400:kworker.0 Request processed in 8009us (9715us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997042.607447:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1780997042.607582:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126851968:0@lo:400:kworker.0 00010000:00010000:3.0:1780997042.918512:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997043.110320:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126853376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780997043.110409:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997043.110474:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126853376 00000100:00100000:3.0:1780997043.110481:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126853376 00000100:00100000:3.0:1780997043.110525:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:3.0:1780997043.110534:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126853376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780997043.110556:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997043.110600:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126853376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997043.110607:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:3.0:1780997043.110657:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126853376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780997043.113164:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126853504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780997043.113232:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997043.113431:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126853504 00000100:00100000:3.0:1780997043.113440:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126853504 00000100:00100000:3.0:1780997043.113481:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:3.0:1780997043.113491:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126853504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780997043.113511:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997043.113566:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126853504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997043.113574:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00100000:2.0:1780997043.113583:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997043.113594:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126853632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780997043.113755:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126853504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997043.117763:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997043.117917:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126853632 00000100:00100000:3.0:1780997043.117927:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126853632 00000100:00100000:3.0:1780997043.117984:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:3.0:1780997043.117994:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126853632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780997043.118028:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445265408 avail 1299025920 00000100:00100000:3.0:1780997043.118140:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126853632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997043.118148:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00000100:00100000:0.0:1780997043.118472:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126853632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997043.621467:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997043.621489:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126853760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997043.621573:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997043.621646:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126853760 00000100:00100000:2.0:1780997043.621654:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126853760 00000100:00100000:2.0:1780997043.621709:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:2.0:1780997043.621719:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126853760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997043.621751:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997043.621801:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126853760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997043.621809:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00000100:00100000:2.0:1780997043.621859:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126853760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997043.624957:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126853888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997043.625035:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997043.627456:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126853888 00000100:00100000:0.0:1780997043.627471:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126853888 00000100:00100000:0.0:1780997043.627532:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:0.0:1780997043.627542:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126853888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997043.627574:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997043.627650:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126853888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997043.627658:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00100000:0.0:1780997043.627710:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126853888:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1780997043.941841:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997043.974981:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997043.975031:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997043.975105:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997043.975134:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997043.975189:0:83317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110348160 00000100:00100000:2.0:1780997043.975200:0:83317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110348160 00000100:00100000:2.0:1780997043.975256:0:83317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:2.0:1780997043.975266:0:83317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110348160:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997043.975376:0:83317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110348160:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 111us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997043.975385:0:83317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:0.0:1780997043.976415:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110348672 00000100:00100000:0.0:1780997043.976427:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110348672 00000100:00100000:2.0:1780997043.976631:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2492 00000100:00100000:2.0:1780997043.976639:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110348672:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997043.976691:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110348672:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 53us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997043.976698:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2492 00000100:00100000:3.0:1780997043.982688:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110348416 00000100:00100000:3.0:1780997043.982704:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110348416 00000100:00100000:3.0:1780997043.987837:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110348288 00000100:00100000:3.0:1780997043.987856:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110348288 00000100:00100000:3.0:1780997043.987942:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1156 00000100:00100000:3.0:1780997043.987953:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110348416:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997043.988215:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1157 00000100:00100000:0.0:1780997043.988227:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2395:x1867507110348288:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997043.989301:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997043.989350:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110348544 00000100:00100000:1.0:1780997043.989357:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110348544 00000100:00100000:1.0:1780997043.989398:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2493 00000100:00100000:1.0:1780997043.989407:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110348544:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997043.989482:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110348544:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 76us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997043.989490:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2493 00000100:00100000:3.0:1780997043.990140:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110348416:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 2185us (15103us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997043.990149:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1156 00000100:00100000:0.0:1780997043.996778:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2395:x1867507110348288:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 8542us (21630us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997043.996794:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1157 00010000:00010000:3.0:1780997044.977800:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997045.990457:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997047.013754:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997047.717638:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126854144:0@lo:400:kworker.0 00000100:00100000:2.0:1780997047.717739:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997047.717783:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126854656:0@lo:400:kworker.0 00000100:00100000:2.0:1780997047.717811:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997047.717832:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126855168:0@lo:400:kworker.0 00000100:00100000:2.0:1780997047.717855:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997047.718155:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507126854400:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.718190:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997047.718212:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126854912:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.718236:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997047.718253:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126855424:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.718291:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997047.718310:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1780997047.718316:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126854016:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.718376:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997047.718404:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126854528:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.718424:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997047.718442:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126855040:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.718463:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997047.718480:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126855552:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.718503:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997047.718531:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126854272:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.718557:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997047.718587:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126854784:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.718610:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997047.718640:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126855296:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.718666:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997047.718704:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126854144 00000100:00100000:0.0:1780997047.718715:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126854144 00000100:00100000:0.0:1780997047.718781:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126854400 00000100:00100000:0.0:1780997047.718785:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126854400 00000100:00100000:0.0:1780997047.718798:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126854528 00000100:00100000:0.0:1780997047.718800:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126854528 00000100:00100000:0.0:1780997047.718812:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126855040 00000100:00100000:0.0:1780997047.718814:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126855040 00000100:00100000:0.0:1780997047.718826:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126855552 00000100:00100000:0.0:1780997047.718828:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126855552 00000100:00100000:0.0:1780997047.718839:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126854272 00000100:00100000:0.0:1780997047.718842:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126854272 00000100:00100000:0.0:1780997047.718859:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1780997047.718869:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507126854144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.719488:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507126854144:12345-0@lo:400:kworker.0 Request processed in 618us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997047.719498:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1780997047.719527:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1780997047.719536:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507126854400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.719579:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507126854400:12345-0@lo:400:kworker.0 Request processed in 45us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997047.719585:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1780997047.719597:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1780997047.719603:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126854528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.719647:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126854528:12345-0@lo:400:kworker.0 Request processed in 43us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997047.719653:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1780997047.719666:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1780997047.719672:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126855040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.719702:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126855040:12345-0@lo:400:kworker.0 Request processed in 29us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997047.719709:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1780997047.719721:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:0.0:1780997047.719727:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126855552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.719754:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126855552:12345-0@lo:400:kworker.0 Request processed in 27us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997047.719760:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:0.0:1780997047.719772:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1780997047.719779:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126854272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.719825:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126854272:12345-0@lo:400:kworker.0 Request processed in 47us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997047.719831:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1780997047.719862:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126854912 00000100:00100000:0.0:1780997047.719869:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126854912 00000100:00100000:2.0:1780997047.720047:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126854144:0@lo:400:kworker.0 00000100:00100000:2.0:1780997047.720094:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126854656 00000100:00100000:2.0:1780997047.720098:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126854656 00000100:00100000:2.0:1780997047.720133:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126855168 00000100:00100000:2.0:1780997047.720136:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126855168 00000100:00100000:2.0:1780997047.720156:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927 00000100:00100000:2.0:1780997047.720162:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126854656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997047.720203:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126854656:12345-0@lo:400:kworker.0 Request processed in 41us (2391us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997047.720209:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00000100:00100000:2.0:1780997047.720220:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928 00000100:00100000:2.0:1780997047.720226:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126855168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997047.720249:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126855168:12345-0@lo:400:kworker.0 Request processed in 23us (2393us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997047.720265:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928 00000100:00100000:2.0:1780997047.720332:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126854656:0@lo:400:kworker.0 00000100:00100000:2.0:1780997047.720346:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126855168:0@lo:400:kworker.0 00000100:00100000:3.0:1780997047.720749:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126855680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997047.720802:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997047.720917:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126855424 00000100:00100000:0.0:1780997047.720922:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126855424 00000100:00100000:0.0:1780997047.720946:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126854784 00000100:00100000:0.0:1780997047.720949:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126854784 00000100:00100000:0.0:1780997047.720966:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126855296 00000100:00100000:0.0:1780997047.720969:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126855296 00000100:00100000:0.0:1780997047.720986:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494 00000100:00100000:0.0:1780997047.720993:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126854912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721031:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126854912:12345-0@lo:400:kworker.0 Request processed in 39us (2794us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997047.721038:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494 00000100:00100000:0.0:1780997047.721050:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495 00000100:00100000:0.0:1780997047.721055:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126855424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721078:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126855424:12345-0@lo:400:kworker.0 Request processed in 23us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997047.721084:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495 00000100:00100000:0.0:1780997047.721092:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496 00000100:00100000:0.0:1780997047.721097:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126854784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721121:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126854784:12345-0@lo:400:kworker.0 Request processed in 24us (2510us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997047.721127:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496 00000100:00100000:0.0:1780997047.721135:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497 00000100:00100000:0.0:1780997047.721149:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126855296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721174:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126855296:12345-0@lo:400:kworker.0 Request processed in 26us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997047.721179:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497 00000100:00100000:0.0:1780997047.721209:0:83325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126854016 00000100:00100000:0.0:1780997047.721213:0:83325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126854016 00000100:00100000:0.0:1780997047.721239:0:83325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1780997047.721245:0:83325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126854016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721289:0:83325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126854016:12345-0@lo:400:kworker.0 Request processed in 44us (2913us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997047.721295:0:83325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1780997047.721356:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780997047.721361:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997047.721364:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780997047.721366:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780997047.721419:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126854272:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721434:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126854784:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721446:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126855296:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721482:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126854016:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721496:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126854528:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721509:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126855040:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721521:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126855552:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721535:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507126854400:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721559:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126854912:0@lo:400:kworker.0 00000100:00100000:0.0:1780997047.721571:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126855424:0@lo:400:kworker.0 00000100:00100000:2.0:1780997047.724207:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126855680 00000100:00100000:2.0:1780997047.724296:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126855680 00000100:00100000:2.0:1780997047.724376:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:2.0:1780997047.724387:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126855680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780997047.724442:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1780997047.725694:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126855680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1298us (4881us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997047.725954:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126855680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997047.726059:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00010000:00010000:3.0:1780997048.041182:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997048.229818:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780997048.229849:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126855808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780997048.230088:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997048.230256:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126855808 00000100:00100000:2.0:1780997048.230267:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126855808 00000100:00100000:2.0:1780997048.230369:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:2.0:1780997048.230382:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126855808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780997048.230430:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997048.230569:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126855808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 190us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997048.230577:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00100000:2.0:1780997048.230605:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997048.230617:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126855936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780997048.230649:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997048.230681:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126855936 00000100:00100000:2.0:1780997048.230686:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126855936 00000100:00100000:2.0:1780997048.230710:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:2.0:1780997048.230716:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126855936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780997048.230757:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997048.230794:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126855936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997048.230801:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000100:00100000:2.0:1780997048.230856:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126855936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780997048.231571:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126855808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780997048.244594:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126856064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780997048.244700:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997048.244778:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126856064 00000100:00100000:3.0:1780997048.244789:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126856064 00000100:00100000:3.0:1780997048.244849:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:3.0:1780997048.244859:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126856064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780997048.244920:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445265408 avail 1299025920 00000100:00100000:3.0:1780997048.244972:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126856064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997048.244981:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00000100:00100000:3.0:1780997048.245040:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126856064:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1780997048.246182:0:83312:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215106 is committed 00000001:02000400:0.0:1780997048.393086:0:84026:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 05:24:07 (1780997047) 00000100:00100000:2.0:1780997048.511682:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997048.513660:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110348800 00000100:00100000:0.0:1780997048.513675:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110348800 00000100:00080000:3.0:1780997048.513741:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780997048.513767:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1162 00000100:00100000:0.0:1780997048.513780:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67133:x1867507110348800:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1780997048.513806:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997048.513829:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954e00/0x30fd811c03059e7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b29 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.513899:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c03059e85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.513915:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c03059e85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.513930:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c03059e85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.513946:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c03059e8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.513953:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c03059e8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.513959:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c03059e8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514019:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c03059e85 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514027:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c03059e85 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514034:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c03059e85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514040:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c03059e85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514046:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997048.514050:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c03059e85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514057:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c03059e85 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514070:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96888760f400) 00010000:00010000:0.0:1780997048.514072:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997048.514077:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c03059e85 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514083:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c03059e85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514098:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c03059e8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514104:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c03059e8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514115:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c03059e8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514120:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997048.514123:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c03059e8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514128:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c03059e8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514135:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff968983653700) 00010000:00010000:0.0:1780997048.514137:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997048.514141:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c03059e8c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514146:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c03059e8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514178:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954e00/0x30fd811c03059e7e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b29 expref: 9 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514189:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96888760f400) 00010000:00010000:0.0:1780997048.514191:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997048.514195:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954e00/0x30fd811c03059e7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b29 expref: 9 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.514204:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954e00, rc 0) 00000100:00100000:0.0:1780997048.514294:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67133:x1867507110348800:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 516us (2632us total) trans 0 rc 301/301 00000100:00100000:0.0:1780997048.514310:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1162 00000100:00100000:1.0:1780997048.518714:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997048.518802:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110349056 00000100:00100000:2.0:1780997048.518821:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110349056 00000100:00100000:2.0:1780997048.518941:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1163 00000100:00100000:2.0:1780997048.518956:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67133:x1867507110349056:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780997048.518988:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997048.518992:0:63419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1780997048.519033:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db800/0x30fd811c03059e15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b0d expref: 8 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997048.519058:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96888760f400) 00010000:00010000:2.0:1780997048.519074:0:63419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997048.519096:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e93 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b30 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.519513:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbc00/0x30fd811c03059e9a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.519531:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbc00/0x30fd811c03059e9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.519543:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbc00/0x30fd811c03059e9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.519559:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db200/0x30fd811c03059ea1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.519566:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db200/0x30fd811c03059ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.519573:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db200/0x30fd811c03059ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520186:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbe00/0x30fd811c03059ea8 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520201:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbe00/0x30fd811c03059ea8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520211:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbe00/0x30fd811c03059ea8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997048.520228:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00010000:00010000:1.0:1780997048.520263:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbc00/0x30fd811c03059e9a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520304:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbc00/0x30fd811c03059e9a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520343:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbc00/0x30fd811c03059e9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520352:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbc00/0x30fd811c03059e9a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520360:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dbc00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997048.520367:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbc00/0x30fd811c03059e9a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520376:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbc00/0x30fd811c03059e9a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520391:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3500) 00010000:00010000:1.0:1780997048.520395:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997048.520401:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbc00/0x30fd811c03059e9a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520409:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbc00/0x30fd811c03059e9a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997048.520430:0:63419:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7b1b3e3 reply state 00000000e5182eb7 transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db200/0x30fd811c03059ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520443:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db200/0x30fd811c03059ea1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520451:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9689ad88ef00) 00010000:00010000:1.0:1780997048.520454:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997048.520459:0:63419:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780997048.520500:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842000/0x30fd811c03059e93 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b30 expref: 10 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520543:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbe00/0x30fd811c03059ea8 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b30 expref: 9 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.520552:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9689ad88eb00) 00010000:00010000:1.0:1780997048.520555:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997048.520558:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96898d6dbe00, rc 0) 00000100:00100000:1.0:1780997048.520670:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:67133:x1867507110349056:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1716us (1964us total) trans 103079215107 rc 0/0 00000100:00100000:1.0:1780997048.520684:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1163 00000100:00100000:2.0:1780997048.527498:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997048.527845:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110349312 00000100:00100000:0.0:1780997048.527857:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110349312 00000100:00100000:0.0:1780997048.527928:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1164 00000100:00100000:0.0:1780997048.527939:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:67133:x1867507110349312:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1780997048.527962:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997048.527985:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954000/0x30fd811c03059eb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b37 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.528093:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.528108:0:63418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbe00/0x30fd811c03059ea8 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b30 expref: 11 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.528115:0:63418:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.528148:0:63418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbe00/0x30fd811c03059ea8 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b30 expref: 11 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997048.528160:0:63418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbe00/0x30fd811c03059ea8 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b30 expref: 11 pid: 63419 timeout: 3676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997048.528172:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:63418:1867507126856192:192.168.206.51@tcp:104: 00000100:00100000:0.0:1780997048.528248:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886bae3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997048.533203:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:63418:1867507126856192:192.168.206.51@tcp:104: 00010000:00010000:3.0:1780997048.533236:0:63418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997048.534140:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997048.536672:0:6337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110349440 00000100:00100000:1.0:1780997048.536691:0:6337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110349440 00010000:00010000:1.0:1780997048.536750:0:6337:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbe00/0x30fd811c03059ea8 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b30 expref: 12 pid: 63419 timeout: 3676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997048.536807:0:6337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2554 00000100:00100000:1.0:1780997048.536820:0:6337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2394:x1867507110349440:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780997048.536838:0:6337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997048.536846:0:6337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbe00/0x30fd811c03059ea8 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b30 expref: 12 pid: 63419 timeout: 3676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.536861:0:6337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbe00/0x30fd811c03059ea8 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b30 expref: 12 pid: 63419 timeout: 3676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.536888:0:6337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dbe00/0x30fd811c03059ea8 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b30 expref: 12 pid: 63419 timeout: 3676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.536920:0:6337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9689ad88eb00) 00010000:00010000:1.0:1780997048.536926:0:6337:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.536937:0:6337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.536947:0:6337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.536977:0:6337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997048.537057:0:6337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:2394:x1867507110349440:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 240us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997048.537066:0:6337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2554 00010000:00010000:1.0:1780997048.537263:0:63418:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.537292:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997048.537329:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00010000:00010000:1.0:1780997048.537629:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.537639:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.537647:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.537665:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997048.537670:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.537680:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.537691:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9689ad88eb00) 00010000:00010000:1.0:1780997048.537695:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1780997048.537699:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.537705:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955000/0x30fd811c03059ebd lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.537770:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954000/0x30fd811c03059eb6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b37 expref: 11 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.537781:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983653600) 00010000:00010000:1.0:1780997048.537783:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780997048.537787:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954000/0x30fd811c03059eb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b37 expref: 11 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997048.537802:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954000, rc 0) 00000100:00100000:1.0:1780997048.537846:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:67133:x1867507110349312:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 9909us (10367us total) trans 103079215108 rc 301/301 00000100:00100000:1.0:1780997048.537854:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1164 00000100:00100000:2.0:1780997048.542813:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997048.542905:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110349696 00000100:00100000:3.0:1780997048.542923:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110349696 00000100:00100000:3.0:1780997048.543010:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 220 00000100:00100000:3.0:1780997048.543024:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:67133:x1867507110349696:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1780997048.543414:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:67133:x1867507110349696:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 391us (609us total) trans 103079215109 rc 0/0 00000100:00100000:3.0:1780997048.543438:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 220 00000100:00100000:1.0:1780997048.545623:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997048.545741:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110349952 00000100:00100000:2.0:1780997048.545756:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110349952 00000100:00100000:2.0:1780997048.545808:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:2.0:1780997048.545818:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:67133:x1867507110349952:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1780997048.546060:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:67133:x1867507110349952:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 244us (445us total) trans 103079215110 rc 0/0 00000100:00100000:2.0:1780997048.546069:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:2.0:1780997048.741564:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997048.741589:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126856320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997048.741664:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997048.741719:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126856320 00000100:00100000:2.0:1780997048.741727:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126856320 00000100:00100000:2.0:1780997048.741776:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:2.0:1780997048.741786:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126856320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997048.741813:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997048.741863:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126856320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997048.741870:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00000100:00100000:2.0:1780997048.741917:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126856320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997048.742420:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997048.742433:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126856448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997048.742483:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997048.742525:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126856448 00000100:00100000:1.0:1780997048.742531:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126856448 00000100:00100000:1.0:1780997048.742561:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:1.0:1780997048.742568:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126856448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997048.742580:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997048.742619:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126856448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997048.742626:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:1.0:1780997048.742656:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126856448:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1780997049.067162:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997049.095791:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997049.095826:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997049.095853:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997049.095869:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997049.095886:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997049.095944:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110350336 00000100:00100000:0.0:1780997049.095954:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110350336 00000100:00100000:0.0:1780997049.096010:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110350208 00000100:00100000:0.0:1780997049.096014:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110350208 00000100:00100000:0.0:1780997049.096050:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1164 00000100:00100000:0.0:1780997049.096060:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110350336:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997049.096133:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110350336:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 75us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997049.096141:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1164 00000100:00100000:0.0:1780997049.096158:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1165 00000100:00100000:0.0:1780997049.096164:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2397:x1867507110350208:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997049.096193:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2397:x1867507110350208:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997049.096199:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1165 00000100:00100000:0.0:1780997049.096215:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110350592 00000100:00100000:0.0:1780997049.096218:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110350592 00000100:00100000:0.0:1780997049.096253:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110350464 00000100:00100000:0.0:1780997049.096256:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110350464 00000100:00100000:0.0:1780997049.096297:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2498 00000100:00100000:0.0:1780997049.096304:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110350592:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997049.096337:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110350592:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997049.096343:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2498 00000100:00100000:0.0:1780997049.096354:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2499 00000100:00100000:0.0:1780997049.096359:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110350464:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997049.096380:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110350464:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 21us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997049.096392:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2499 00000100:00080000:2.0:1780997049.096589:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997049.096593:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997049.096596:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997049.096752:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110350080 00000100:00100000:3.0:1780997049.096757:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110350080 00000100:00100000:3.0:1780997049.096792:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:3.0:1780997049.096798:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2397:x1867507110350080:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997049.096829:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2397:x1867507110350080:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997049.096835:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000001:00080000:2.0:1780997049.334933:0:83312:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:3.0:1780997049.335166:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db200/0x30fd811c03059ea1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.335180:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db200/0x30fd811c03059ea1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.335188:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db200/0x30fd811c03059ea1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.335195:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997049.335200:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db200/0x30fd811c03059ea1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.335208:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db200/0x30fd811c03059ea1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.335225:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9689ad88ef00) 00010000:00010000:3.0:1780997049.335228:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997049.335232:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db200/0x30fd811c03059ea1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.335249:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db200/0x30fd811c03059ea1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997049.429677:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997049.429850:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110350720 00000100:00100000:0.0:1780997049.429862:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110350720 00000100:00100000:0.0:1780997049.429927:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1165 00000100:00100000:0.0:1780997049.429938:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:67149:x1867507110350720:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1780997049.429958:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997049.429982:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059ecb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b3e expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.430044:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059ed2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.430059:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.430071:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997049.430116:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780997049.430119:0:63584:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997049.430138:0:63584:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.430160:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955400/0x30fd811c03059ecb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b3e expref: 9 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.430179:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b3e expref: 8 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.430199:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983653f00) 00010000:00010000:0.0:1780997049.430203:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780997049.430206:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955e00, rc 0) 00000100:00100000:0.0:1780997049.430300:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67149:x1867507110350720:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 363us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997049.430318:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1165 00000100:00100000:3.0:1780997049.436936:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997049.437014:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110350848 00000100:00100000:0.0:1780997049.437024:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110350848 00000100:00100000:0.0:1780997049.437085:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1166 00000100:00100000:0.0:1780997049.437095:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67149:x1867507110350848:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:0.0:1780997049.437136:0:80049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445265408 avail 1299025920 00000100:00100000:0.0:1780997049.437211:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67149:x1867507110350848:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 117us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997049.437219:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1166 00000100:00100000:0.0:1780997049.445465:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997049.445540:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110350976 00000100:00100000:3.0:1780997049.445550:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110350976 00000100:00100000:3.0:1780997049.445611:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1167 00000100:00100000:3.0:1780997049.445622:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:67149:x1867507110350976:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:3.0:1780997049.445663:0:65272:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1780997049.445729:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:67149:x1867507110350976:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 109us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997049.445739:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1167 00000100:00100000:3.0:1780997049.449953:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997049.450033:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110351104 00000100:00100000:2.0:1780997049.450044:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110351104 00000100:00100000:2.0:1780997049.450104:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2000 00000100:00100000:2.0:1780997049.450114:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:67149:x1867507110351104:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1780997049.450142:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997049.450217:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:67149:x1867507110351104:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 104us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997049.450225:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2000 00000100:00100000:3.0:1780997049.454727:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997049.457806:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110351232 00000100:00100000:0.0:1780997049.457821:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110351232 00000100:00100000:0.0:1780997049.459742:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2001 00000100:00100000:0.0:1780997049.459760:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:67149:x1867507110351232:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1780997049.459794:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997049.459866:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:67149:x1867507110351232:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 113us (5149us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997049.459874:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2001 00000100:00100000:1.0:1780997049.542595:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997049.542696:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110351488 00000100:00100000:3.0:1780997049.542708:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110351488 00000100:00100000:3.0:1780997049.542780:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1168 00000100:00100000:3.0:1780997049.542792:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67156:x1867507110351488:12345-192.168.206.51@tcp:36:mcreate.0 00010000:00010000:3.0:1780997049.542859:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997049.542906:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c03059ed2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b3e expref: 8 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.542927:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983653f00) 00010000:00010000:3.0:1780997049.542941:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997049.543003:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059ed9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543025:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543035:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543046:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059ee0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543053:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059ee0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543059:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059ee0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543763:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059ed9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543773:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059ed9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543779:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543785:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059ed9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543791:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997049.543795:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059ed9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543802:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059ed9 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543819:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689a5f8f900) 00010000:00010000:3.0:1780997049.543822:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997049.543826:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059ed9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543832:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059ed9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997049.543847:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c89bb7d reply state 00000000bdda3da2 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059ee0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543857:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059ee0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.543863:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689a5f8fd00) 00010000:00010000:3.0:1780997049.543865:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997049.543868:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780997049.544056:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:67156:x1867507110351488:12345-192.168.206.51@tcp:36:mcreate.0 Request processed in 1266us (1468us total) trans 103079215111 rc 0/0 00000100:00100000:3.0:1780997049.544064:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1168 00000100:00100000:3.0:1780997049.566029:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997049.566133:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110351616 00000100:00100000:1.0:1780997049.566144:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110351616 00000100:00100000:1.0:1780997049.566205:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1169 00000100:00100000:1.0:1780997049.566217:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:67159:x1867507110351616:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:1.0:1780997049.566240:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997049.566261:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6daa00/0x30fd811c03059ee7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b45 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.566545:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da600/0x30fd811c03059eee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.566559:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da600/0x30fd811c03059eee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.566569:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da600/0x30fd811c03059eee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997049.566679:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780997049.566684:0:80049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780997049.566706:0:80049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da600/0x30fd811c03059eee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.566729:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6daa00/0x30fd811c03059ee7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b45 expref: 11 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.566745:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da600/0x30fd811c03059eee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b45 expref: 10 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.566753:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88eb00) 00010000:00010000:1.0:1780997049.566756:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780997049.566760:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96898d6da600, rc 0) 00000100:00100000:1.0:1780997049.566866:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:67159:x1867507110351616:12345-192.168.206.51@tcp:101:rm.0 Request processed in 651us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997049.566873:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1169 00000100:00100000:3.0:1780997049.569321:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997049.569578:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110351744 00000100:00100000:1.0:1780997049.569588:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110351744 00000100:00100000:1.0:1780997049.569654:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1170 00000100:00100000:1.0:1780997049.569664:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:67159:x1867507110351744:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:1.0:1780997049.569685:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997049.569704:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da200/0x30fd811c03059ef5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b4c expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.569771:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da000/0x30fd811c03059efc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.569806:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da000/0x30fd811c03059efc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.569818:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da000/0x30fd811c03059efc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.569831:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dba00/0x30fd811c03059f03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.569839:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dba00/0x30fd811c03059f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.569847:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dba00/0x30fd811c03059f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.569943:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db400/0x30fd811c03059f0a lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.569952:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db400/0x30fd811c03059f0a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.569960:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db400/0x30fd811c03059f0a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997049.570016:0:65272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x7:0x0]: returning size 0 00000004:00200000:1.0:1780997049.570020:0:65272:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780997049.570038:0:65272:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db400/0x30fd811c03059f0a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570049:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db400/0x30fd811c03059f0a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570071:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da000/0x30fd811c03059efc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570078:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da000/0x30fd811c03059efc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570085:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da000/0x30fd811c03059efc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570093:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da000/0x30fd811c03059efc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570100:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6da000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997049.570105:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da000/0x30fd811c03059efc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570114:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da000/0x30fd811c03059efc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570128:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88eb00) 00010000:00010000:1.0:1780997049.570131:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997049.570136:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da000/0x30fd811c03059efc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570141:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da000/0x30fd811c03059efc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570152:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dba00/0x30fd811c03059f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570158:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dba00/0x30fd811c03059f03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570169:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dba00/0x30fd811c03059f03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570174:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dba00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997049.570176:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dba00/0x30fd811c03059f03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570182:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dba00/0x30fd811c03059f03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570190:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689a5f8fd00) 00010000:00010000:1.0:1780997049.570192:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997049.570194:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dba00/0x30fd811c03059f03 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570199:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6dba00/0x30fd811c03059f03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570223:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da200/0x30fd811c03059ef5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b4c expref: 12 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570449:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db400/0x30fd811c03059f0a lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b4c expref: 11 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997049.570458:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9689ad88e900) 00010000:00010000:1.0:1780997049.570460:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997049.570463:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96898d6db400, rc 0) 00000100:00100000:1.0:1780997049.570530:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:67159:x1867507110351744:12345-192.168.206.51@tcp:101:rm.0 Request processed in 867us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997049.570547:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1170 00000100:00100000:3.0:1780997049.576423:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997049.576734:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110352000 00000100:00100000:0.0:1780997049.576754:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110352000 00000100:00100000:0.0:1780997049.576913:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1171 00000100:00100000:0.0:1780997049.576926:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:67159:x1867507110352000:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:0.0:1780997049.576984:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1780997049.577012:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6db400/0x30fd811c03059f0a lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b4c expref: 11 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577033:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9689ad88e900) 00010000:00010000:0.0:1780997049.577053:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96898d6da600/0x30fd811c03059eee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b45 expref: 10 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577060:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88eb00) 00010000:00010000:0.0:1780997049.577063:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997049.577088:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c03059f11 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577099:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c03059f11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577109:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c03059f11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577119:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954c00/0x30fd811c03059f18 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577126:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888954c00/0x30fd811c03059f18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577133:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954c00/0x30fd811c03059f18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577237:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955200/0x30fd811c03059f1f lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577258:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955200/0x30fd811c03059f1f lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577265:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955200/0x30fd811c03059f1f lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577521:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c03059f26 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577530:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c03059f26 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577538:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c03059f26 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577545:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c03059f26 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577551:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c03059f26 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577557:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c03059f26 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577573:0:63584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997049.577592:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955200/0x30fd811c03059f1f lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577599:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955200/0x30fd811c03059f1f lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577612:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955200/0x30fd811c03059f1f lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577618:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997049.577623:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955200/0x30fd811c03059f1f lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577632:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955200/0x30fd811c03059f1f lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577641:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff968983653000) 00010000:00010000:0.0:1780997049.577644:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1780997049.577648:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955200/0x30fd811c03059f1f lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577654:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955200/0x30fd811c03059f1f lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577672:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c03059f11 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577678:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c03059f11 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577684:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c03059f11 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577689:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c03059f11 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577695:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997049.577704:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c03059f11 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577710:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c03059f11 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577724:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983653300) 00010000:00010000:0.0:1780997049.577726:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997049.577729:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c03059f11 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577735:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c03059f11 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997049.577748:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000319a6d06 reply state 0000000021ca4b32 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff968888954c00/0x30fd811c03059f18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577759:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888954c00/0x30fd811c03059f18 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997049.577764:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689a5f8fd00) 00010000:00010000:0.0:1780997049.577766:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997049.577769:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997049.577902:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:67159:x1867507110352000:12345-192.168.206.51@tcp:36:rm.0 Request processed in 979us (1487us total) trans 103079215112 rc 0/0 00000100:00100000:0.0:1780997049.577909:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1171 00010000:00010000:3.0:1780997049.578113:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997049.578120:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c03059f26 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.578126:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997049.578129:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c03059f26 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.578141:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c03059f26 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.578150:0:14480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff968983653000) 00010000:00010000:3.0:1780997049.578152:0:14480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1780997049.578156:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c03059f26 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.578161:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c03059f26 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997049.578173:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997049.578175:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997049.578176:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997050.097421:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997051.109880:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997052.134288:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997052.838505:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126856576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997052.838574:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997052.838675:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126856576 00000100:00100000:3.0:1780997052.838684:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126856576 00000100:00100000:3.0:1780997052.838742:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:3.0:1780997052.838751:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126856576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780997052.838789:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1780997052.838835:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126856576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997052.838843:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00000100:00100000:3.0:1780997052.838892:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126856576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780997052.841617:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126856704:0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.841696:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997052.841828:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780997052.841836:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126857088:0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.841947:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997052.842433:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126857216:0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.842462:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997052.842540:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997052.842544:0:83318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126856704 00000100:00100000:1.0:1780997052.842548:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126857600:0@lo:400:kworker.0 00000100:00100000:2.0:1780997052.842553:0:83318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126856704 00000100:00100000:1.0:1780997052.842582:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997052.842602:0:83318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1780997052.842613:0:83318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126856704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.842616:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126857088 00000100:00100000:1.0:1780997052.842621:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126857088 00000100:00100000:1.0:1780997052.842658:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126857216 00000100:00100000:1.0:1780997052.842661:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126857216 00000100:00100000:2.0:1780997052.842677:0:83318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126856704:12345-0@lo:400:kworker.0 Request processed in 66us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997052.842684:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:2.0:1780997052.842686:0:83318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1780997052.842694:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126857088:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780997052.842713:0:80049:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968988615500 x1867507126857088/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:383/0 lens 224/224 e 0 to 0 dl 1780997063 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997052.842744:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126857088:12345-0@lo:400:kworker.0 Request processed in 53us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997052.842746:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126856960:0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.842757:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1780997052.842772:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1780997052.842783:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126857216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997052.842784:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997052.842810:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126857472:0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.842821:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126857216:12345-0@lo:400:kworker.0 Request processed in 42us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997052.842840:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997052.842844:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1780997052.842865:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1780997052.842873:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126856832:0@lo:400:kworker.0 00000100:00100000:2.0:1780997052.842893:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997052.842911:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126857344:0@lo:400:kworker.0 00000100:00100000:2.0:1780997052.842942:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997052.842969:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126857984:0@lo:400:kworker.0 00000100:00100000:3.0:1780997052.842974:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126856960 00000100:00100000:3.0:1780997052.842979:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126856960 00000100:00100000:3.0:1780997052.843009:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126856832 00000100:00100000:2.0:1780997052.843011:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997052.843021:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126856832 00000100:00100000:2.0:1780997052.843043:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780997052.843045:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1780997052.843051:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126857856:0@lo:400:kworker.0 00000100:00100000:3.0:1780997052.843055:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126856960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997052.843079:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997052.843130:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126857600 00000100:00100000:0.0:1780997052.843135:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126857600 00000100:00100000:0.0:1780997052.843170:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126857472 00000100:00100000:0.0:1780997052.843174:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126857472 00000100:00100000:1.0:1780997052.843187:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1780997052.843194:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126857984 00000100:00100000:1.0:1780997052.843199:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126856832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997052.843199:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126857984 00010000:00000080:1.0:1780997052.843219:0:80049:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968990f19c00 x1867507126856832/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:383/0 lens 224/224 e 0 to 0 dl 1780997063 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997052.843225:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126857856 00000100:00100000:0.0:1780997052.843228:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126857856 00000100:00100000:0.0:1780997052.843250:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500 00000100:00100000:0.0:1780997052.843257:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126857600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997052.843367:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126856960:0@lo:400:kworker.0 00000100:00100000:2.0:1780997052.843411:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501 00000100:00100000:2.0:1780997052.843420:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126857472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.843428:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126856832:12345-0@lo:400:kworker.0 Request processed in 231us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997052.843436:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00080000:1.0:1780997052.843458:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997052.843460:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126857472:12345-0@lo:400:kworker.0 Request processed in 40us (621us total) trans 0 rc 0/0 00000100:00080000:1.0:1780997052.843463:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997052.843467:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997052.843471:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501 00000100:00080000:1.0:1780997052.843472:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780997052.843491:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502 00000100:00100000:2.0:1780997052.843503:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126857984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.843503:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503 00000100:00100000:1.0:1780997052.843517:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126857856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997052.843539:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126857984:12345-0@lo:400:kworker.0 Request processed in 40us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997052.843546:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502 00000100:00100000:1.0:1780997052.843562:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126857856:12345-0@lo:400:kworker.0 Request processed in 47us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997052.843570:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503 00000100:00100000:2.0:1780997052.843580:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126858112:0@lo:400:kworker.0 00000100:00100000:2.0:1780997052.843612:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997052.843627:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126857856:0@lo:400:kworker.0 00000100:00100000:2.0:1780997052.843636:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997052.843644:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126857984:0@lo:400:kworker.0 00000100:00100000:2.0:1780997052.843645:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126857728:0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.843661:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126856832:0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.843671:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126857472:0@lo:400:kworker.0 00000100:00100000:2.0:1780997052.843692:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997052.843705:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126858112 00000100:00100000:1.0:1780997052.843709:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126858112 00000100:00100000:1.0:1780997052.843735:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126857728 00000100:00100000:1.0:1780997052.843745:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126857728 00000100:00100000:2.0:1780997052.843748:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126857344 00000100:00100000:2.0:1780997052.843753:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126857344 00000100:00100000:1.0:1780997052.843770:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1780997052.843778:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126858112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997052.843787:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932 00010000:00000080:1.0:1780997052.843792:0:80049:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adedf100 x1867507126858112/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:383/0 lens 224/224 e 0 to 0 dl 1780997063 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997052.843799:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126857344:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780997052.843820:0:23042:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968990f1bb80 x1867507126857344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:383/0 lens 224/224 e 0 to 0 dl 1780997063 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997052.843835:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126858112:12345-0@lo:400:kworker.0 Request processed in 57us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997052.843842:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1780997052.843868:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126857344:12345-0@lo:400:kworker.0 Request processed in 72us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997052.843875:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932 00000100:00100000:3.0:1780997052.843922:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126856960:12345-0@lo:400:kworker.0 Request processed in 868us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997052.843978:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1780997052.843987:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126857728:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780997052.843997:0:80049:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b11a9500 x1867507126857728/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:383/0 lens 224/224 e 0 to 0 dl 1780997063 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997052.844023:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126857728:12345-0@lo:400:kworker.0 Request processed in 38us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997052.844057:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:1.0:1780997052.844091:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1780997052.844181:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126857728:0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.844191:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126858112:0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.844214:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adeddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126857216:0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.844226:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126857088:0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.844235:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126856704:0@lo:400:kworker.0 00000100:00100000:1.0:1780997052.844396:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126857344:0@lo:400:kworker.0 00000100:00100000:0.0:1780997052.847620:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126857600:12345-0@lo:400:kworker.0 Request processed in 4352us (5026us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997052.847635:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500 00000100:00100000:2.0:1780997052.848009:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126857600:0@lo:400:kworker.0 00010000:00010000:1.0:1780997053.157419:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997053.351468:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997053.351491:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126858240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997053.351554:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997053.351744:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126858240 00000100:00100000:1.0:1780997053.351757:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126858240 00000100:00100000:1.0:1780997053.351808:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:1.0:1780997053.351817:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126858240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780997053.351853:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445265408 avail 1299025920 00010000:00000080:1.0:1780997053.351867:0:8242:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968986956a00 x1867507126858240/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:384/0 lens 224/368 e 0 to 0 dl 1780997064 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997053.351905:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126858240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997053.351911:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00000100:00100000:0.0:1780997053.351988:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126858240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997053.352927:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126858368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780997053.352974:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997053.353110:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126858496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997053.353139:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997053.353171:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126858368 00000100:00100000:1.0:1780997053.353176:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126858368 00000100:00100000:1.0:1780997053.353206:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126858496 00000100:00100000:1.0:1780997053.353208:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126858496 00000100:00100000:1.0:1780997053.353221:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:1.0:1780997053.353228:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126858368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780997053.353253:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997053.353492:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:0.0:1780997053.353502:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126858496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780997053.353519:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997053.353555:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126858496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997053.353562:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:0.0:1780997053.353613:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126858496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997053.353793:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126858368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 565us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997053.353801:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00100000:2.0:1780997053.353850:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126858368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780997053.861705:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780997053.861735:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126858624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780997053.861804:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997053.862041:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126858624 00000100:00100000:0.0:1780997053.862050:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126858624 00000100:00100000:0.0:1780997053.862107:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:0.0:1780997053.862118:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126858624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997053.862140:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997053.862199:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126858624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997053.862208:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00100000:2.0:1780997053.862354:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997053.862364:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126858752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997053.862395:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997053.862468:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126858752 00000100:00100000:0.0:1780997053.862472:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126858752 00000100:00100000:0.0:1780997053.862502:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:0.0:1780997053.862509:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126858752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997053.862520:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997053.862532:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126858624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997053.862553:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126858752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997053.862559:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00100000:0.0:1780997053.862586:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126858752:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1780997054.188391:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997054.222707:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997054.222759:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997054.222787:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997054.222805:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997054.222830:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997054.222863:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110352384 00000100:00100000:3.0:1780997054.222873:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110352384 00000100:00100000:1.0:1780997054.222934:0:83319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110352128 00000100:00100000:1.0:1780997054.222940:0:83319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110352128 00000100:00100000:3.0:1780997054.222941:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110352256 00000100:00100000:3.0:1780997054.222947:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110352256 00000100:00100000:3.0:1780997054.222987:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1172 00000100:00100000:1.0:1780997054.222998:0:83319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:3.0:1780997054.223003:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110352384:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997054.223012:0:83319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110352128:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997054.223090:0:83319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110352128:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 82us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997054.223117:0:83319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:3.0:1780997054.223214:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110352384:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 218us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997054.223221:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1172 00000100:00100000:3.0:1780997054.223236:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1173 00000100:00100000:3.0:1780997054.223243:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:2395:x1867507110352256:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000080:3.0:1780997054.223298:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968888605500 x1867507110352256/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:385/0 lens 224/224 e 0 to 0 dl 1780997065 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997054.223324:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:2395:x1867507110352256:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 82us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997054.223332:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1173 00000100:00100000:3.0:1780997054.223355:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110352640 00000100:00100000:3.0:1780997054.223359:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110352640 00000100:00100000:3.0:1780997054.223386:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110352512 00000100:00100000:3.0:1780997054.223390:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110352512 00000100:00100000:3.0:1780997054.223412:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2504 00000100:00100000:3.0:1780997054.223419:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110352640:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997054.223442:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110352640:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997054.223448:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2504 00000100:00100000:3.0:1780997054.223458:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2505 00000100:00100000:3.0:1780997054.223465:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110352512:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997054.223488:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2395:x1867507110352512:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997054.223496:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2505 00000100:00080000:3.0:1780997054.223531:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780997054.223535:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997054.223537:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780997054.223539:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1780997055.208826:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1780997055.400387:0:83312:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215112 is committed 00010000:00010000:1.0:1780997055.400453:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059ee0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.400466:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059ee0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.400474:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059ee0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.400480:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997055.400485:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059ee0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.400504:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059ee0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.400521:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689a5f8fd00) 00010000:00010000:1.0:1780997055.400524:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997055.400529:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059ee0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.400536:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c03059ee0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.400556:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954c00/0x30fd811c03059f18 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.400563:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888954c00/0x30fd811c03059f18 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.400582:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888954c00/0x30fd811c03059f18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.400587:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997055.400590:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888954c00/0x30fd811c03059f18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.400597:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888954c00/0x30fd811c03059f18 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.400607:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689a5f8fd00) 00010000:00010000:1.0:1780997055.400609:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997055.400612:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888954c00/0x30fd811c03059f18 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.400747:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954c00/0x30fd811c03059f18 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1780997055.447128:0:84421:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1780997055.518242:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997055.518337:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110352768 00000100:00100000:2.0:1780997055.518347:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110352768 00000100:00100000:2.0:1780997055.518426:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1172 00000100:00100000:2.0:1780997055.518437:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:67228:x1867507110352768:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997055.518459:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997055.518484:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c03059f2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b53 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997055.518561:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843400/0x30fd811c03059f34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997055.518578:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843400/0x30fd811c03059f34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997055.518591:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843400/0x30fd811c03059f34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997055.518654:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780997055.518658:0:63419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780997055.518701:0:63419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843400/0x30fd811c03059f34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997055.518727:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c03059f2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b53 expref: 9 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997055.518747:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843400/0x30fd811c03059f34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b53 expref: 8 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997055.518756:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3c00) 00010000:00010000:2.0:1780997055.518759:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780997055.518763:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc843400, rc 0) 00010000:00000080:2.0:1780997055.518772:0:63419:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968988617b80 x1867507110352768/t0(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:386/0 lens 576/688 e 0 to 0 dl 1780997066 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997055.518839:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67228:x1867507110352768:12345-192.168.206.51@tcp:101:dd.0 Request processed in 404us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997055.518846:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1172 00000100:00100000:1.0:1780997055.522541:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997055.523158:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110353024 00000100:00100000:3.0:1780997055.523172:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110353024 00000100:00100000:3.0:1780997055.523258:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1173 00000100:00100000:3.0:1780997055.523309:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67228:x1867507110353024:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997055.523343:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997055.523347:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1780997055.523386:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843400/0x30fd811c03059f34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b53 expref: 8 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523412:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898b4c3c00) 00010000:00010000:3.0:1780997055.523429:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997055.523452:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f3b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b5a expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523624:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c03059f42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523642:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c03059f42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523656:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c03059f42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523671:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c03059f49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523679:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c03059f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523685:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c03059f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523765:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c03059f50 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523779:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c03059f50 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523786:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c03059f50 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997055.523905:0:63584:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1780997055.523909:0:63584:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1780997048 00000004:00010000:3.0:1780997055.523911:0:63584:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1780997048 00000004:00010000:3.0:1780997055.523914:0:63584:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1780997048 00000004:00010000:3.0:1780997055.523916:0:63584:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:3.0:1780997055.523920:0:63584:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:3.0:1780997055.523926:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c03059f42 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523933:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c03059f42 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523939:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c03059f42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523945:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c03059f42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523950:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997055.523955:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c03059f42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523963:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c03059f42 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523982:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689a5f8fa00) 00010000:00010000:3.0:1780997055.523984:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997055.523989:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c03059f42 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.523996:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c03059f42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.524006:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c03059f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.524011:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c03059f49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.524017:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c03059f49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.524022:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997055.524024:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c03059f49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.524030:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c03059f49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.524037:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9689a5f8f200) 00010000:00010000:3.0:1780997055.524039:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997055.524042:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c03059f49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.524047:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c03059f49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.524096:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f3b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 10 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.524111:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c03059f50 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 9 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.524118:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9689a5f8f100) 00010000:00010000:3.0:1780997055.524120:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1780997055.524122:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3600, rc 0) 00010000:00000080:3.0:1780997055.524130:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968988617800 x1867507110353024/t103079215113(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:386/0 lens 752/824 e 0 to 0 dl 1780997066 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997055.524256:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:67228:x1867507110353024:12345-192.168.206.51@tcp:101:dd.0 Request processed in 988us (1727us total) trans 103079215113 rc 0/0 00000100:00100000:3.0:1780997055.524263:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1173 00000100:00100000:1.0:1780997055.528435:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997055.528715:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110353152 00000100:00100000:2.0:1780997055.528728:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110353152 00000100:00100000:2.0:1780997055.531371:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1174 00000100:00100000:2.0:1780997055.531390:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:67228:x1867507110353152:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997055.531414:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997055.531436:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c03059f5e lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b61 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997055.531482:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842400/0x30fd811c03059f65 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997055.531494:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842400/0x30fd811c03059f65 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997055.531505:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842400/0x30fd811c03059f65 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997055.531595:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c03059f5e lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b61 expref: 11 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997055.531613:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842400/0x30fd811c03059f65 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b61 expref: 10 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997055.531620:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9689a5f8f100) 00010000:00010000:2.0:1780997055.531623:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780997055.531627:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc842400, rc 0) 00010000:00000080:2.0:1780997055.531634:0:80049:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968988614380 x1867507110353152/t0(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:386/0 lens 568/1272 e 0 to 0 dl 1780997066 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997055.531697:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:67228:x1867507110353152:12345-192.168.206.51@tcp:101:dd.0 Request processed in 315us (3269us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997055.531703:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1174 00000100:00100000:1.0:1780997055.537528:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997055.537780:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110353408 00000100:00100000:3.0:1780997055.537790:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110353408 00000100:00100000:3.0:1780997055.537848:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1175 00000100:00100000:3.0:1780997055.537858:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:67228:x1867507110353408:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:3.0:1780997055.537980:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.537998:0:63419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c03059f50 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 10 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.538007:0:63419:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.538054:0:63419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c03059f50 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 10 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.538069:0:63419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c03059f50 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 10 pid: 63584 timeout: 3683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997055.538084:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888605f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63419:1867507126858880:192.168.206.51@tcp:104: 00000100:00100000:3.0:1780997055.538167:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc9dd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997055.541364:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888605f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63419:1867507126858880:192.168.206.51@tcp:104: 00010000:00010000:3.0:1780997055.541391:0:63419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997055.541774:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997055.541844:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110353536 00000100:00100000:1.0:1780997055.541852:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110353536 00010000:00010000:1.0:1780997055.541887:0:18812:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c03059f50 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 11 pid: 63584 timeout: 3683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997055.541923:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2555 00000100:00100000:1.0:1780997055.541946:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b620d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:2395:x1867507110353536:12345-192.168.206.51@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1780997055.541963:0:18812:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c03059f50 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 11 pid: 63584 timeout: 3683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.541975:0:18812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c03059f50 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 11 pid: 63584 timeout: 3683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.541986:0:18812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c03059f50 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 11 pid: 63584 timeout: 3683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.541995:0:18812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9689a5f8f100) 00010000:00010000:1.0:1780997055.541998:0:18812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1780997055.542001:0:18812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.542011:0:18812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.542018:0:18812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997055.542050:0:18812:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c03059f50 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 11 pid: 63584 timeout: 3683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997055.542104:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b620d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:2395:x1867507110353536:12345-192.168.206.51@tcp:102:ldlm_bl.0 Request processed in 160us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997055.542112:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2555 00010000:00010000:3.0:1780997055.542300:0:63419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.542308:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997055.542455:0:63419:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1780997055.542459:0:63419:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1780997048 -> 1780997055 00000004:00010000:3.0:1780997055.542462:0:63419:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1780997048 -> 1780997048 00000004:00010000:3.0:1780997055.542464:0:63419:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1780997048 -> 1780997055 00000004:00010000:3.0:1780997055.542467:0:63419:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:3.0:1780997055.542474:0:63419:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b26c97d reply state 000000006cd6f4c3 transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.542487:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997055.542501:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9689a5f8f100) 00010000:00010000:3.0:1780997055.542504:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997055.542506:0:63419:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1780997055.542560:0:63419:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968988616d80 x1867507110353408/t103079215114(0) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:386/0 lens 488/456 e 0 to 0 dl 1780997066 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997055.542611:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:67228:x1867507110353408:12345-192.168.206.51@tcp:36:dd.0 Request processed in 4756us (5093us total) trans 103079215114 rc 0/0 00000100:00100000:3.0:1780997055.542619:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1175 00000100:00100000:0.0:1780997055.544848:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997055.544927:0:63430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110353664 00000100:00100000:3.0:1780997055.544936:0:63430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110353664 00002000:00010000:3.0:1780997055.544971:0:63430:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:3.0:1780997055.544977:0:63430:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff968986955180 with x1867507110353664 00000100:00100000:3.0:1780997055.545041:0:63430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1780997055.545051:0:63430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2394:x1867507110353664:12345-192.168.206.51@tcp:10:dd.0 00000004:00010000:3.0:1780997055.545238:0:63430:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1780997055.545242:0:63430:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1780997055 -> 1780997055 00000004:00010000:3.0:1780997055.545245:0:63430:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1780997048 -> 1780997048 00000004:00010000:3.0:1780997055.545248:0:63430:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1780997055 -> 1780997055 00000004:00010000:3.0:1780997055.545250:0:63430:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780997055.545267:0:63430:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968986955180 x1867507110353664/t103079215115(0) o10->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:386/0 lens 440/432 e 0 to 0 dl 1780997066 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997055.545359:0:63430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:2394:x1867507110353664:12345-192.168.206.51@tcp:10:dd.0 Request processed in 310us (518us total) trans 103079215115 rc 0/0 00000100:00100000:3.0:1780997055.545367:0:63430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00002000:00010000:3.0:1780997055.545371:0:63430:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:3.0:1780997055.545386:0:63430:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff968986955180 with x1867507110353664 00000100:00100000:1.0:1780997055.556752:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997055.556839:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110353920 00000100:00100000:3.0:1780997055.556850:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110353920 00000100:00100000:3.0:1780997055.556926:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 222 00000100:00100000:3.0:1780997055.556939:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889fe6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:67228:x1867507110353920:12345-192.168.206.51@tcp:35:dd.0 00010000:00000080:3.0:1780997055.557160:0:63420:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968889fe6050 x1867507110353920/t103079215116(0) o35->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:386/0 lens 392/456 e 0 to 0 dl 1780997066 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997055.557238:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889fe6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:67228:x1867507110353920:12345-192.168.206.51@tcp:35:dd.0 Request processed in 302us (495us total) trans 103079215116 rc 0/0 00000100:00100000:3.0:1780997055.557246:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 222 00010000:00010000:0.0:1780997056.229716:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997057.255098:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1780997057.341547:0:84518:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1780997057.341605:0:84518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.341620:0:84518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.341628:0:84518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.341636:0:84518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.341661:0:84518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1780997057.341667:0:84518:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1780997057.341692:0:84518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1780997057.341696:0:84518:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1780997057.341714:0:84518:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1780997057.341741:0:84518:0:(import.c:65:import_set_state_nolock()) ffff968986141000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1780997057.341800:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997057.341807:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.341825:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454000 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997057.341829:0:37626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.341839:0:37626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997057.341846:0:37626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997057.341852:0:37626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1780997057.341854:0:37626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1780997057.341857:0:37626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1780997057.341883:0:37626:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.341890:0:37626:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997057.341910:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.341917:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c03059ae9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059af0 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.341928:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997057.341930:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997057.341932:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997057.341947:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126859008:0@lo:39:umount.0 00000100:00100000:2.0:1780997057.342018:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997057.342070:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888961b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126859136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997057.342106:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997057.342152:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126859008 00000100:00100000:2.0:1780997057.342159:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126859008 00000100:00100000:2.0:1780997057.342208:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1780997057.342218:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1867507126859008:12345-0@lo:39:umount.0 00000020:00000080:2.0:1780997057.342245:0:63417:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059c01 00000100:00080000:2.0:1780997057.342260:0:63417:0:(import.c:65:import_set_state_nolock()) ffff96888b410000 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1780997057.342324:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a6794e00 x1867507126859008/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:388/0 lens 224/224 e 0 to 0 dl 1780997068 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997057.342365:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3495:x1867507126859008:12345-0@lo:39:umount.0 Request processed in 149us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997057.342373:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000020:00000080:2.0:1780997057.342382:0:63417:0:(genops.c:906:class_export_put()) final put ffff96888b411000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1780997057.342405:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126859136 00000100:00100000:2.0:1780997057.342409:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126859136 00000100:00100000:2.0:1780997057.342442:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:2.0:1780997057.342449:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126859136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997057.342459:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997057.342473:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c1a00/0x30fd811c03059af0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059ae9 expref: 23 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.342486:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997057.342516:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3498:x1867507126859136:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997057.342522:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00010000:00010000:2.0:1780997057.342560:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1780997057.342567:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96888b411000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1780997057.342611:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888b410000 for lustre-MDT0000 00000100:00100000:2.0:1780997057.342654:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888961b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126859136:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1780997057.342697:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968986141000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1780997057.342706:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126859008:0@lo:39:umount.0 00000100:00080000:3.0:1780997057.343002:0:84518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1780997057.343006:0:84518:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1780997057.343011:0:84518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1780997057.343929:0:84518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.343941:0:84518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.343949:0:84518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.343957:0:84518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.343980:0:84518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997057.343986:0:84518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.343994:0:84518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344000:0:84518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344006:0:84518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344035:0:84518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997057.344049:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997057.344055:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344062:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02c00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997057.344066:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344073:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997057.344079:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997057.344085:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1780997057.344087:0:14480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1780997057.344110:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344116:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997057.344131:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344138:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c03059a02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059a09 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344150:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997057.344153:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344164:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8a00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997057.344167:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344173:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997057.344180:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997057.344185:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1780997057.344187:0:14480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1780997057.344189:0:14480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1780997057.344203:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344209:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997057.344221:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344227:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689a56c8a00/0x30fd811c03059b28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059b2f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344237:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997057.344239:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997057.344241:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997057.344249:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780997057.344261:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126859392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997057.344346:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1780997057.344401:0:84518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344410:0:84518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344417:0:84518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344424:0:84518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344435:0:84518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997057.344441:0:84518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344448:0:84518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344456:0:84518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344463:0:84518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.344471:0:84518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1780997057.344474:0:84518:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1780997057.344478:0:84518:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1780997057.344503:0:84518:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1780997057.344508:0:84518:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1780997057.344512:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1780997057.344522:0:84518:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:0.0:1780997057.344776:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126859264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997057.344807:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997057.344849:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126859392 00000100:00100000:0.0:1780997057.344855:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126859392 00000100:00100000:0.0:1780997057.344891:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126859264 00000100:00100000:0.0:1780997057.344894:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126859264 00000100:00100000:0.0:1780997057.344917:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1780997057.344926:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126859392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997057.344938:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997057.344951:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455000/0x30fd811c03059b2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059b28 expref: 23 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.344975:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997057.345012:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3497:x1867507126859392:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997057.345021:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1780997057.345037:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1780997057.345044:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3499:x1867507126859264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997057.345052:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997057.345061:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02200/0x30fd811c03059a09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059a02 expref: 21 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.345070:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997057.345095:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3499:x1867507126859264:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997057.345101:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1780997057.345138:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126859392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997057.345170:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126859264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997057.346532:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997057.346542:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.346552:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454800 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997057.346556:0:6339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.346565:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997057.346572:0:6339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997057.346578:0:6339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1780997057.346580:0:6339:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1780997057.346582:0:6339:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1780997057.346617:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.346623:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997057.346646:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.346653:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c03059adb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059ae2 expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.346683:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997057.346686:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.346692:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03400 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997057.346695:0:6339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.346702:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997057.346708:0:6339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997057.346713:0:6339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1780997057.346715:0:6339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1780997057.346717:0:6339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1780997057.346729:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.346734:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997057.346742:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.346749:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c030599f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c030599fb expref: -99 pid: 83311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.346757:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997057.346758:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997057.346764:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997057.346773:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997057.346787:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888961b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126859648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997057.346840:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997057.346893:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126859648 00000100:00100000:2.0:1780997057.346899:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126859648 00000100:00100000:2.0:1780997057.346935:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:2.0:1780997057.346942:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3498:x1867507126859648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997057.346954:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997057.346966:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c0c00/0x30fd811c030599fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c030599f4 expref: 20 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.346976:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997057.347002:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3498:x1867507126859648:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997057.347009:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00010000:00010000:2.0:1780997057.347026:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997057.347043:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888961b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126859648:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1780997057.348624:0:84518:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:0.0:1780997057.349102:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997057.349126:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126859520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997057.349192:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1780997057.349961:0:83312:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215116 is committed 00000020:00000080:2.0:1780997057.350114:0:84518:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1780997057.350123:0:84518:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff96888b410800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780997057.350129:0:84518:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff96888b414800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780997057.350134:0:84518:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff968986142800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780997057.350140:0:84518:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689bfab0800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780997057.350147:0:84518:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689bfab4000 285c134c-d3a6-4c01-bb4d-8148c50d5f95 192.168.206.51@tcp 9 (0 0 3) 0 0 0 1: ffff968984d97000 103079215116 stale:0 00000020:00080000:2.0:1780997057.350152:0:84518:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff96888ac53380) has exports, disconnecting them 00000020:00080000:2.0:1780997057.350155:0:84518:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96888b410800), last request at 1780997032 00000020:00000080:2.0:1780997057.350169:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059bfa 00000100:00080000:2.0:1780997057.350177:0:84518:0:(import.c:65:import_set_state_nolock()) ffff96888b413800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780997057.350216:0:84518:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96888b410800): rc 0 00000020:00000080:2.0:1780997057.350218:0:84518:0:(genops.c:906:class_export_put()) final put ffff96888b410800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1780997057.350229:0:84518:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96888b414800), last request at 1780997052 00000020:00000080:2.0:1780997057.350232:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059bf3 00000100:00080000:2.0:1780997057.350235:0:84518:0:(import.c:65:import_set_state_nolock()) ffff96888b415800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1780997057.350250:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96888b410800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1780997057.350477:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888b413800 for lustre-MDT0000 00010000:00010000:2.0:1780997057.350492:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1780997057.350501:0:84518:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96888b414800): rc 0 00000020:00000080:2.0:1780997057.350503:0:84518:0:(genops.c:906:class_export_put()) final put ffff96888b414800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1780997057.350511:0:84518:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff968986142800), last request at 1780997052 00000020:00000080:2.0:1780997057.350514:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059bec 00000100:00080000:2.0:1780997057.350519:0:84518:0:(import.c:65:import_set_state_nolock()) ffff968986147000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1780997057.350531:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96888b414800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1780997057.350551:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888b415800 for lustre-MDT0000 00010000:00010000:2.0:1780997057.350559:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1780997057.350567:0:84518:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff968986142800): rc 0 00000020:00000080:2.0:1780997057.350569:0:84518:0:(genops.c:906:class_export_put()) final put ffff968986142800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1780997057.350576:0:84518:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689bfab0800), last request at 1780997026 00000020:00000080:2.0:1780997057.350583:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059a5d 00000100:00080000:2.0:1780997057.350593:0:84518:0:(import.c:65:import_set_state_nolock()) ffff968986142000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1780997057.350605:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968986142800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1780997057.350626:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968986147000 for lustre-MDT0000 00010000:00010000:2.0:1780997057.350661:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1780997057.350670:0:84518:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bfab0800): rc 0 00000020:00000080:2.0:1780997057.350672:0:84518:0:(genops.c:906:class_export_put()) final put ffff9689bfab0800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1780997057.350687:0:84518:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.206.51@tcp (ffff9689bfab4000), last request at 1780997055 00000020:00000080:2.0:1780997057.350691:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059a56 00000020:00010000:2.0:1780997057.350697:0:84518:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689bfab4000: total 1 00000100:00080000:2.0:1780997057.350700:0:84518:0:(import.c:65:import_set_state_nolock()) ffff9689891ae000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1780997057.350712:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bfab0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1780997057.350752:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968986142000 for lustre-MDT0000 00000020:00010000:2.0:1780997057.350760:0:6339:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689bfab4000: total 0 00010000:00010000:2.0:1780997057.350809:0:6339:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689bfab4000, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1780997057.350845:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842400/0x30fd811c03059f65 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b61 expref: 8 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.350868:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c03059f50 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 7 pid: 63584 timeout: 3683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.350885:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955c00/0x30fd811c03059e3f lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b14 expref: 6 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997057.350907:0:6339:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689bfab4000, canceled 3 locks, left on hash table 0. 00000100:00100000:0.0:1780997057.351158:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126859520 00000100:00100000:0.0:1780997057.351169:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126859520 00000100:00100000:0.0:1780997057.351223:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1780997057.351232:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3496:x1867507126859520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997057.351248:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997057.351260:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c1400/0x30fd811c03059ae2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059adb expref: 19 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997057.353441:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997057.353854:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.353870:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.353877:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.353884:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997057.353889:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.353897:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.353915:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9689a5f8f100) 00010000:00010000:3.0:1780997057.353919:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997057.353926:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997057.353932:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c03059f6c lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1780997057.354360:0:84518:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.206.51@tcp (ffff9689bfab4000): rc 0 00000004:00000080:1.0:1780997057.354372:0:84518:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa8c8c2c13ae0 00000100:00080000:1.0:1780997057.354398:0:84518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1780997057.354403:0:84518:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1780997057.355447:0:84518:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1780997057.355478:0:84518:0:(import.c:65:import_set_state_nolock()) ffff968990f72000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1780997057.355539:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126859776:0@lo:39:umount.0 00000100:00100000:3.0:1780997057.355609:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780997057.355837:0:84518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1780997057.355841:0:84518:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 3 00000004:00080000:1.0:1780997057.355853:0:84518:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:1.0:1780997057.355917:0:84518:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1780997057.355929:0:84518:0:(import.c:65:import_set_state_nolock()) ffff968990cc2000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1780997057.356687:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997057.356746:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3496:x1867507126859520:12345-0@lo:103:ldlm_bl.0 Request processed in 5513us (7552us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997057.356757:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1780997057.356817:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126859520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997057.357642:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126859904:0@lo:9:umount.0 00000100:00100000:3.0:1780997057.357690:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997057.357735:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126859904 00000100:00100000:3.0:1780997057.357752:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126859904 00000100:00100000:3.0:1780997057.357808:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5923 00000100:00100000:3.0:1780997057.357816:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126859904:12345-0@lo:9:umount.0 00000020:00000080:3.0:1780997057.357841:0:8233:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059aaa 00000100:00080000:3.0:1780997057.357849:0:8233:0:(import.c:65:import_set_state_nolock()) ffff9689ba675000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780997057.357910:0:8233:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:3.0:1780997057.358058:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3495:x1867507126859904:12345-0@lo:9:umount.0 Request processed in 242us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997057.358066:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5923 00000100:00080000:3.0:1780997057.358084:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1780997057.358096:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780997057.358117:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968990cc2000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1780997057.358130:0:3495:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:3.0:1780997057.358133:0:3495:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780997057.358136:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126859904:0@lo:9:umount.0 00000100:00100000:0.0:1780997057.358971:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126859776 00000100:00100000:0.0:1780997057.358982:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126859776 00000100:00100000:0.0:1780997057.359037:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:0.0:1780997057.359046:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126859776:12345-0@lo:39:umount.0 00000020:00000080:0.0:1780997057.359070:0:23042:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059a9c 00000100:00080000:0.0:1780997057.359077:0:23042:0:(import.c:65:import_set_state_nolock()) ffff96898d685800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780997057.359099:0:23042:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378730 00000100:00100000:0.0:1780997057.359260:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3495:x1867507126859776:12345-0@lo:39:umount.0 Request processed in 215us (3650us total) trans 81604378731 rc 0/0 00000100:00100000:0.0:1780997057.359290:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00010000:00010000:0.0:1780997057.359309:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780997057.359332:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968990f72000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1780997057.359339:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126859776:0@lo:39:umount.0 00000100:00080000:1.0:1780997057.359438:0:84518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1780997057.359442:0:84518:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 3 00000004:00080000:1.0:1780997057.359456:0:84518:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:1.0:1780997057.359576:0:84518:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1780997057.359598:0:84518:0:(import.c:65:import_set_state_nolock()) ffff968983330800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1780997057.359645:0:84518:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff96888ac53380) has no exports 00000100:00100000:3.0:1780997057.359882:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126860032:0@lo:9:umount.0 00000100:00100000:3.0:1780997057.359925:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997057.360727:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126860032 00000100:00100000:0.0:1780997057.360735:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126860032 00000100:00100000:0.0:1780997057.360777:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5924 00000100:00100000:0.0:1780997057.360785:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126860032:12345-0@lo:9:umount.0 00000020:00000080:0.0:1780997057.360807:0:23044:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059ac6 00000100:00080000:0.0:1780997057.360814:0:23044:0:(import.c:65:import_set_state_nolock()) ffff9689ba677800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780997057.360851:0:23044:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969450 00000020:00080000:1.0:1780997057.361348:0:84518:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff96888ac53380) has no exports 00000100:00100000:0.0:1780997057.361392:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3495:x1867507126860032:12345-0@lo:9:umount.0 Request processed in 607us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997057.361401:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5924 00010000:00010000:0.0:1780997057.361435:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780997057.363799:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997057.363861:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968983330800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1780997057.363880:0:3495:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:3.0:1780997057.363882:0:3495:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780997057.363888:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126860032:0@lo:9:umount.0 00000020:00000080:2.0:1780997057.395389:0:6339:0:(genops.c:906:class_export_put()) final put ffff9689bfab4000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:0.0:1780997057.395635:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bfab4000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-MDT0000 00000020:00000080:0.0:1780997057.395711:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689891ae000 for lustre-MDT0000 00010000:00010000:3.0:1780997057.395819:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997057.395822:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997057.395825:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1780997057.422712:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059a72 00000020:00000080:1.0:1780997057.422733:0:84518:0:(genops.c:906:class_export_put()) final put ffff9689869cf800/lustre-QMT0000_UUID 00000020:01000000:1.0:1780997057.422802:0:84518:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1780997057.422888:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780997057.422903:0:84518:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1780997057.422909:0:84518:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff968990fe19c0) has no exports 00000020:00000080:0.0:1780997057.423300:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059a6b 00000020:00000080:0.0:1780997057.423306:0:84518:0:(genops.c:906:class_export_put()) final put ffff968990f77000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1780997057.423461:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689869cf800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1780997057.423547:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff968990f77000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780997057.423613:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997057.423621:0:84518:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1780997057.423625:0:84518:0:(genops.c:906:class_export_put()) final put ffff96888969e000/lustre-QMT0000_UUID 00000020:00000080:0.0:1780997057.423627:0:84518:0:(genops.c:865:class_export_destroy()) destroying export ffff96888969e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1780997057.423636:0:84518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1780997057.423763:0:84518:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96888b44cde0 - data ffff9689aee176c0/ffff9689b7892c00 00000020:01000000:0.0:1780997057.423891:0:84518:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968887c39900 - data ffff9689aee14438/ffff9689bc632800 00000100:00080000:2.0:1780997057.487705:0:84518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780997057.487715:0:84518:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1780997057.487732:0:84518:0:(client.c:3169:ptlrpc_free_committed()) @@@ free request with old gen req@ffff968988617100 x1867507126859776/t81604378731(81604378731) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997067 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997057.487759:0:84518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1780997057.495320:0:84518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780997057.495329:0:84518:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 4 00000004:00080000:2.0:1780997057.495471:0:84518:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997057.495474:0:84518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1780997057.497989:0:83332:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1780997057.497999:0:83332:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:0.0:1780997057.498019:0:83332:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:2.0:1780997057.498895:0:84518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780997057.498902:0:84518:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 4 00000004:00080000:2.0:1780997057.498921:0:84518:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997057.498923:0:84518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1780997057.499831:0:83334:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1780997057.499837:0:83334:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:0.0:1780997057.499847:0:83334:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:2.0:1780997057.502580:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059a25 00000020:00000080:2.0:1780997057.502593:0:84518:0:(genops.c:906:class_export_put()) final put ffff9689bc96e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1780997057.503246:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059a3a 00000020:00000080:2.0:1780997057.503253:0:84518:0:(genops.c:906:class_export_put()) final put ffff968990f97000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780997057.503259:0:84518:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1780997057.503293:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997057.503312:0:84518:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1780997057.503316:0:84518:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff96888ac519c0) has no exports 00000004:01000000:2.0:1780997057.503480:0:84518:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1780997057.503489:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059abf 00000020:00000080:2.0:1780997057.503493:0:84518:0:(genops.c:906:class_export_put()) final put ffff9689bcb9f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780997057.503497:0:84518:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1780997057.503501:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997057.503506:0:84518:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780997057.503508:0:84518:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff96888ac54d40) has no exports 00000020:00000080:2.0:1780997057.503514:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059ab8 00000020:00000080:2.0:1780997057.503517:0:84518:0:(genops.c:906:class_export_put()) final put ffff968983332800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1780997057.503832:0:84518:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1780997057.503837:0:84518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780997057.503841:0:84518:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 5 00000004:00080000:2.0:1780997057.503847:0:84518:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997057.503849:0:84518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780997057.503876:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780997057.503882:0:84518:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780997057.503887:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059aa3 00000020:00000080:2.0:1780997057.503892:0:84518:0:(genops.c:906:class_export_put()) final put ffff968987775000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780997057.503895:0:84518:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1780997057.503913:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997057.503916:0:84518:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780997057.503919:0:84518:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff968886ec3380) has no exports 00000020:00000080:2.0:1780997057.503923:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059a95 00000020:00000080:2.0:1780997057.503926:0:84518:0:(genops.c:906:class_export_put()) final put ffff968990cc7000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1780997057.504227:0:84518:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1780997057.504230:0:84518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780997057.504233:0:84518:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 5 00000004:00080000:2.0:1780997057.504236:0:84518:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997057.504238:0:84518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780997057.504291:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780997057.504296:0:84518:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1780997057.504306:0:84518:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1780997057.504311:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059a87 00000020:00000080:2.0:1780997057.504315:0:84518:0:(genops.c:906:class_export_put()) final put ffff9689bc96c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780997057.504319:0:84518:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1780997057.504322:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997057.504325:0:84518:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780997057.504328:0:84518:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff968990fe0000) has no exports 00000020:00000080:2.0:1780997057.504331:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059a80 00000020:00000080:2.0:1780997057.504334:0:84518:0:(genops.c:906:class_export_put()) final put ffff968990f70800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780997057.505086:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780997057.505095:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff968990f97000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1780997057.505101:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcb9f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780997057.505105:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff968983332800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780997057.505110:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968983330800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780997057.505114:0:38:0:(genops.c:906:class_export_put()) final put ffff9689bc96a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780997057.505117:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1780997057.505121:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997057.505194:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff968987775000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780997057.505206:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff968990cc7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780997057.505210:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968990cc2000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780997057.505213:0:38:0:(genops.c:906:class_export_put()) final put ffff9689bc96b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780997057.505215:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1780997057.505218:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997057.505250:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1780997057.505254:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff968990f70800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1780997057.532721:0:84518:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1780997057.532731:0:84518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780997057.532736:0:84518:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1780997057.532744:0:84518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780997057.532931:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780997057.532946:0:84518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780997057.532977:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780997057.532981:0:84518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780997057.532987:0:84518:0:(genops.c:906:class_export_put()) final put ffff9689bc968800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780997057.532995:0:84518:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc968800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1780997057.533008:0:84518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780997057.533134:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059a41 00000020:00000080:2.0:1780997057.533141:0:84518:0:(genops.c:906:class_export_put()) final put ffff968990f91800/lustre-MDD0000_UUID 00000020:00000080:0.0:1780997057.533168:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968990f72000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1780997057.533174:0:38:0:(genops.c:906:class_export_put()) final put ffff9689bc969000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780997057.533177:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc969000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1780997057.533251:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1780997057.533613:0:84518:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1780997057.533647:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff968990f91800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1780997057.533664:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780997057.533669:0:84518:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1780997057.533673:0:84518:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff96888ac50000) has no exports 00000020:00000080:1.0:1780997057.533692:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997057.533695:0:84518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1780997057.533698:0:84518:0:(genops.c:906:class_export_put()) final put ffff9689bc96c800/lustre-MDD0000_UUID 00000020:00000080:1.0:1780997057.533700:0:84518:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1780997057.533708:0:84518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1780997057.533746:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059a48 00000020:00000080:1.0:1780997057.533750:0:84518:0:(genops.c:906:class_export_put()) final put ffff968990f92800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1780997057.533791:0:84518:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689a5872000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1780997057.533794:0:84518:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689a5872000 3 00000020:01000004:1.0:1780997057.533798:0:84518:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9689a5872000 from lustre-MDT0000 00000020:00000080:1.0:1780997057.533816:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997057.533821:0:84518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1780997057.533823:0:84518:0:(genops.c:906:class_export_put()) final put ffff9689bc969800/lustre-MDT0000_UUID 00000020:00000080:1.0:1780997057.533825:0:84518:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc969800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1780997057.533831:0:84518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1780997057.533860:0:84518:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1780997057.533863:0:84518:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1780997057.533866:0:84518:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1780997057.533868:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780997057.533940:0:84518:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1780997057.533947:0:84518:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9689bcd79000 bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780997057.533955:0:84518:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff96888b411800 5bc603cc-b633-43af-a003-872c004686c8 192.168.206.51@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780997057.533960:0:84518:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9689aeba3380) has exports, disconnecting them 00000020:00080000:1.0:1780997057.533963:0:84518:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9689bcd79000), last request at 1780997026 00000020:00000080:1.0:1780997057.533982:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c030599e6 00000020:00010000:1.0:1780997057.533986:0:84518:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689bcd79000: total 1 00000100:00080000:1.0:1780997057.533991:0:84518:0:(import.c:65:import_set_state_nolock()) ffff9688888d3800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780997057.534003:0:84518:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bcd79000): rc 0 00000020:00080000:1.0:1780997057.534006:0:84518:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.206.51@tcp (ffff96888b411800), last request at 1780997026 00000020:00000080:1.0:1780997057.534044:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c030599df 00000020:00010000:1.0:1780997057.534048:0:84518:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96888b411800: total 1 00000100:00080000:1.0:1780997057.534051:0:84518:0:(import.c:65:import_set_state_nolock()) ffff96888b417800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780997057.534059:0:84518:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.206.51@tcp (ffff96888b411800): rc 0 00000020:00080000:1.0:1780997057.534063:0:84518:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9689aeba3380) has no exports 00000100:00100000:1.0:1780997057.534130:0:83319:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff96888a545200:83319] 2 exiting: rc = 0 00000020:00010000:0.0:1780997057.540444:0:6340:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689bcd79000: total 1 00010000:00010000:0.0:1780997057.540519:0:6340:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689bcd79000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1780997057.540556:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03a00/0x30fd811c03059b59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059b52 expref: 14 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.540577:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02800/0x30fd811c03059bd7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059bd0 expref: 13 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.540591:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03600/0x30fd811c03059b67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059b60 expref: 12 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.540603:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03000/0x30fd811c03059b4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059b44 expref: 11 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.540614:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c9800/0x30fd811c03059bc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059bc2 expref: 10 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.540626:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c9400/0x30fd811c03059b83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059b7c expref: 9 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.540650:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c1600/0x30fd811c03059be5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059bde expref: 8 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.540660:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c8e00/0x30fd811c03059b75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059b6e expref: 7 pid: 83325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.540672:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc4c1e00/0x30fd811c03059b91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059b8a expref: 6 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.540681:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455600/0x30fd811c03059b9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059b98 expref: 5 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.540690:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c8400/0x30fd811c03059bad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059ba6 expref: 4 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.540700:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455a00/0x30fd811c03059b3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059b36 expref: 3 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.540710:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c9600/0x30fd811c03059bbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059bb4 expref: 2 pid: 83319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997057.540718:0:6340:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689bcd79000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1780997057.540738:0:6340:0:(genops.c:906:class_export_put()) final put ffff9689bcd79000/bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 00000020:00000080:2.0:1780997057.540799:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff968990f92800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1780997057.540855:0:83317:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff968885803400:83317] 0 exiting: rc = 1 00000020:00010000:1.0:1780997057.541149:0:37626:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96888b411800: total 1 00000100:00100000:3.0:1780997057.543223:0:83323:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9689ad824800:83323] 3 exiting: rc = 0 00010000:00010000:1.0:1780997057.545573:0:37626:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96888b411800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1780997057.545641:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c9000/0x30fd811c03059b0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8af1 expref: 5 pid: 83317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997057.545667:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c8c00/0x30fd811c03059b1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8aff expref: 4 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997057.545685:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03c00/0x30fd811c03059b13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8af8 expref: 3 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997057.545697:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba454200/0x30fd811c03059b21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b06 expref: 2 pid: 83318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997057.545708:0:37626:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96888b411800, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1780997057.545726:0:37626:0:(genops.c:906:class_export_put()) final put ffff96888b411800/5bc603cc-b633-43af-a003-872c004686c8 00010000:00010000:1.0:1780997057.545756:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997057.545758:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997057.545761:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997057.545829:0:83325:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff9689bbd9ea00:83325] 4 exiting: rc = 0 00000100:00100000:1.0:1780997057.550490:0:83318:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff96888687b200:83318] 1 exiting: rc = 0 00000020:00000080:1.0:1780997057.550588:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96888b411800/5bc603cc-b633-43af-a003-872c004686c8 for MGS 00000020:00000080:1.0:1780997057.550639:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888b417800 for MGS 00000100:00100000:1.0:1780997057.550684:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550695:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550702:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550714:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550721:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550730:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550737:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550770:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550777:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550783:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550790:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550796:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550804:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550811:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550818:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550824:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550831:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550837:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550844:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550849:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550858:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550863:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.550870:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1780997057.551010:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcd79000/bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 for MGS 00000020:00000080:0.0:1780997057.551033:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9688888d3800 for MGS 00010000:00010000:0.0:1780997057.551043:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997057.551045:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997057.551048:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997057.555077:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555085:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555093:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555099:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555104:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555111:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555117:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555122:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555127:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555133:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555139:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555145:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555152:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555157:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555162:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555167:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555172:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.555178:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556405:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556438:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556445:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556451:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556457:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556463:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556468:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556473:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556478:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556484:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556488:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556493:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556499:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556505:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556510:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556516:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556522:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556527:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556532:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556538:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556543:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556549:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997057.556554:0:84518:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1780997057.561475:0:84518:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9688868c69c0 - data ffff9689ae2c4288/ffff9689bc4ccc00 00000020:01000000:1.0:1780997057.561608:0:84518:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968887c397e0 - data ffff9689aee15e58/ffff9689bfb34800 00000020:00000080:1.0:1780997057.562069:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c030599d8 00000020:00000080:1.0:1780997057.562077:0:84518:0:(genops.c:906:class_export_put()) final put ffff9689bcd7b000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1780997057.562097:0:84518:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689a5872000 from MGS, refs=2 00000020:01000004:1.0:1780997057.562101:0:84518:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689a5872000 2 00000020:01000004:1.0:1780997057.562104:0:84518:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9689a5872000 from MGS 00000020:00000080:1.0:1780997057.562124:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997057.562131:0:84518:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1780997057.562134:0:84518:0:(genops.c:906:class_export_put()) final put ffff9689bcd7d800/MGS 00000020:00000080:1.0:1780997057.562136:0:84518:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcd7d800/MGS for MGS 00000020:01000000:1.0:1780997057.562142:0:84518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:0.0:1780997057.563322:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcd7b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1780997057.564004:0:84518:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1780997057.564011:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780997057.564020:0:84518:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1780997057.564029:0:84518:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff96888a013800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780997057.564036:0:84518:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9689aeba0000) has exports, disconnecting them 00000020:00080000:1.0:1780997057.564041:0:84518:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff96888a013800), last request at 1780997026 00000020:00000080:1.0:1780997057.564046:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059afe 00000020:00080000:1.0:1780997057.564062:0:84518:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96888a013800): rc 0 00000020:00000080:1.0:1780997057.564067:0:84518:0:(genops.c:906:class_export_put()) final put ffff96888a013800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1780997057.568584:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96888a013800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1780997057.569444:0:84518:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1780997057.569450:0:84518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1780997057.569454:0:84518:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1780997057.569464:0:84518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780997057.569638:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997057.569647:0:84518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1780997057.569654:0:84518:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689a5872000 1 00000020:00000080:0.0:1780997057.569660:0:84518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c030599ca 00000020:00000080:0.0:1780997057.569667:0:84518:0:(genops.c:906:class_export_put()) final put ffff9689bcd7f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1780997057.572005:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968986141000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1780997057.572020:0:38:0:(genops.c:906:class_export_put()) final put ffff9689bca5b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1780997057.572023:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bca5b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1780997057.572036:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1780997057.573983:0:84518:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1780997057.573996:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780997057.574003:0:84518:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1780997057.574008:0:84518:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff968990fe4d40) has no exports 00000020:00000080:2.0:1780997057.575437:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcd7f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1780997057.664057:0:84518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780997057.664071:0:84518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1780997057.664077:0:84518:0:(genops.c:906:class_export_put()) final put ffff9689a5876000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1780997057.664081:0:84518:0:(genops.c:865:class_export_destroy()) destroying export ffff9689a5876000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1780997057.664093:0:84518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1780997057.664216:0:84518:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9689a5873000 00000020:02000400:3.0:1780997057.664309:0:84518:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1780997057.957516:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126860416:0@lo:400:kworker.0 00000100:00100000:3.0:1780997057.957594:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997057.957624:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126860928:0@lo:400:kworker.0 00000100:00100000:3.0:1780997057.957645:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997057.957665:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1780997057.957670:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126860288:0@lo:400:kworker.0 00000100:00100000:3.0:1780997057.957689:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997057.957703:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126860800:0@lo:400:kworker.0 00000100:00100000:3.0:1780997057.957723:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997057.957754:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126860416 00000100:00100000:3.0:1780997057.957760:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126860416 00000100:00100000:3.0:1780997057.957808:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126860288 00000100:00100000:3.0:1780997057.957811:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126860288 00000100:00100000:3.0:1780997057.957826:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:3.0:1780997057.957835:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126860416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997057.957886:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126860416:12345-0@lo:400:kworker.0 Request processed in 54us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997057.957893:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:3.0:1780997057.957910:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:3.0:1780997057.957913:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3497:x1867507126860288:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1780997057.957934:0:63418:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1780997057.957959:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3497:x1867507126860288:12345-0@lo:400:kworker.0 Request processed in 44us (268us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780997057.957964:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00080000:3.0:1780997057.957979:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997057.958003:0:3497:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780997057.958008:0:3497:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1780997057.958011:0:3497:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1780997057.958017:0:3497:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997057.958020:0:3497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3559 00000100:00080000:3.0:1780997057.958026:0:3497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997057.958047:0:3497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968887e07800 x1867507126861312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997057.958064:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126860288:0@lo:400:kworker.0 00000100:00100000:3.0:1780997057.958079:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126860416:0@lo:400:kworker.0 00000100:00100000:3.0:1780997057.958101:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126861312:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1780997057.958124:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997057.958416:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126860160:0@lo:400:kworker.0 00000400:00000100:1.0:1780997057.958442:0:3499:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126860160 offset 0 length 224: 4 00000100:00100000:1.0:1780997057.958463:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126860672:0@lo:400:kworker.0 00000100:00100000:1.0:1780997057.958484:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997057.958500:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126861184:0@lo:400:kworker.0 00000100:00100000:1.0:1780997057.958519:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997057.958536:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1780997057.958542:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126860544:0@lo:400:kworker.0 00000100:00100000:0.0:1780997057.958698:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126860928 00000100:00100000:0.0:1780997057.958704:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126860928 00000100:00100000:0.0:1780997057.958743:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506 00000100:00100000:0.0:1780997057.958751:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126860928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997057.958794:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126860928:12345-0@lo:400:kworker.0 Request processed in 44us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997057.958799:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506 00000100:00080000:0.0:1780997057.958817:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780997057.958835:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126860928:0@lo:400:kworker.0 00000100:00100000:1.0:1780997057.958889:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997057.958953:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126861056:0@lo:400:kworker.0 00000100:00100000:1.0:1780997057.958977:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997057.959016:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126860800 00000100:00100000:1.0:1780997057.959020:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126860800 00000100:00100000:1.0:1780997057.959045:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:1.0:1780997057.959051:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3497:x1867507126860800:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780997057.959058:0:8242:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780997057.959088:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3497:x1867507126860800:12345-0@lo:400:kworker.0 Request processed in 36us (1363us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780997057.959103:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00000100:00100000:0.0:1780997057.964452:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126861312 00000100:00100000:0.0:1780997057.964467:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126861312 00000100:00100000:0.0:1780997057.964504:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126860672 00000100:00100000:0.0:1780997057.964507:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126860672 00000100:00100000:0.0:1780997057.964543:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126861184 00000100:00100000:0.0:1780997057.964547:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126861184 00000100:00100000:0.0:1780997057.964569:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126860544 00000100:00100000:0.0:1780997057.964585:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126860544 00000100:00100000:0.0:1780997057.964606:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1780997057.964617:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126860672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997057.964714:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126860672:12345-0@lo:400:kworker.0 Request processed in 99us (6228us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997057.964722:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1780997057.964739:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1780997057.964743:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126861312:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1780997057.964762:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997057.964799:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126861312:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 54us (6674us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997057.964805:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1780997057.964816:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1780997057.964820:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3499:x1867507126861184:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780997057.964825:0:63419:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780997057.964848:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3499:x1867507126861184:12345-0@lo:400:kworker.0 Request processed in 27us (6328us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780997057.964854:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1780997057.964864:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1780997057.964868:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adeded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3499:x1867507126860544:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780997057.964872:0:63419:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780997057.964893:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adeded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3499:x1867507126860544:12345-0@lo:400:kworker.0 Request processed in 24us (6003us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780997057.964899:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1780997057.964923:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126861056 00000100:00100000:0.0:1780997057.964927:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126861056 00000100:00100000:0.0:1780997057.964954:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507 00000100:00100000:0.0:1780997057.964968:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126861056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997057.964997:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126861056:12345-0@lo:400:kworker.0 Request processed in 30us (6019us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997057.965003:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507 00000100:00080000:0.0:1780997057.965044:0:3499:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780997057.965050:0:3499:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780997057.965053:0:3499:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780997057.965058:0:3499:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997057.965062:0:3499:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3559 00000100:00080000:0.0:1780997057.965068:0:3499:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997057.965098:0:3499:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968986936300 x1867507126861440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997057.965117:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126860544:0@lo:400:kworker.0 00000100:00100000:0.0:1780997057.965134:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126861056:0@lo:400:kworker.0 00000100:00100000:0.0:1780997057.965146:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126860672:0@lo:400:kworker.0 00000100:00080000:0.0:1780997057.965154:0:3499:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780997057.965157:0:3499:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780997057.965160:0:3499:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780997057.965163:0:3499:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997057.965166:0:3499:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3559 00000100:00080000:0.0:1780997057.965170:0:3499:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997057.965183:0:3499:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6797480 x1867507126861568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997057.965201:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126861184:0@lo:400:kworker.0 00000100:00080000:0.0:1780997057.965230:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997057.965234:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997057.965245:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126861440:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780997057.965313:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997057.965335:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126861568:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780997057.965356:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997057.965373:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997057.965378:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997057.965380:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126861312:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1780997057.965410:0:3497:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780997057.965413:0:3497:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780997057.965416:0:3497:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780997057.965420:0:3497:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997057.965423:0:3497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3559 00000100:00080000:0.0:1780997057.965426:0:3497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997057.965438:0:3497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7a4ed80 x1867507126861696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997057.965453:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126860800:0@lo:400:kworker.0 00000100:00100000:0.0:1780997057.965468:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126861696:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1780997057.965490:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997057.965515:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126861696 00000100:00100000:0.0:1780997057.965525:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126861696 00000100:00100000:0.0:1780997057.965544:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:0.0:1780997057.965549:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126861696:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1780997057.965560:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997057.965587:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126861696:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 37us (97us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997057.965593:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00080000:0.0:1780997057.965621:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997057.965624:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997057.965627:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126861696:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1780997057.965643:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126861440 00000100:00100000:0.0:1780997057.965646:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126861440 00000100:00100000:0.0:1780997057.965656:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126861568 00000100:00100000:0.0:1780997057.965658:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126861568 00000100:00100000:0.0:1780997057.965666:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1780997057.965670:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126861440:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1780997057.965679:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997057.965706:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126861440:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 34us (393us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997057.965712:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1780997057.965723:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1780997057.965727:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126861568:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1780997057.965735:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997057.965758:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126861568:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 30us (401us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997057.965764:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00080000:0.0:1780997057.965795:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997057.965799:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997057.965801:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126861440:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1780997057.965809:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997057.965812:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997057.965815:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126861568:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1780997058.277496:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997058.981507:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126861824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997058.981579:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997058.981633:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126861824 00000100:00100000:0.0:1780997058.981641:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126861824 00000100:00100000:0.0:1780997058.981686:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:0.0:1780997058.981695:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126861824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997058.981724:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997058.981768:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126861824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997058.981775:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:0.0:1780997058.981826:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126861824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997058.984905:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126861952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997058.984974:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997058.987454:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126861952 00000100:00100000:0.0:1780997058.987468:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126861952 00000100:00100000:0.0:1780997058.987534:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:0.0:1780997058.987545:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adeddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126861952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997058.987579:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997058.987655:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adeddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126861952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (2680us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997058.987674:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:1.0:1780997058.987844:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126861952:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1780997059.305127:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1780997059.332006:0:3491:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110354048 offset 0 length 224: 4 00000100:00100000:3.0:1780997059.332055:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997059.332102:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997059.332148:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110354432 00000100:00100000:3.0:1780997059.332159:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110354432 00000100:00100000:1.0:1780997059.332294:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110354176 00000100:00100000:1.0:1780997059.332299:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110354176 00000100:00100000:1.0:1780997059.332357:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1183 00000100:00100000:1.0:1780997059.332367:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1867507110354176:12345-192.168.206.51@tcp:400:kworker.0 00000020:00080000:1.0:1780997059.332376:0:63419:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.206.51@tcp 00000100:00100000:1.0:1780997059.332444:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1867507110354176:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 77us (388us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780997059.332452:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1183 00000100:00100000:3.0:1780997059.333167:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2508 00000100:00100000:3.0:1780997059.333233:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110354432:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997059.333397:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2397:x1867507110354432:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 220us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997059.333405:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2508 00000100:00080000:3.0:1780997059.333427:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997059.344154:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997059.344202:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997059.344760:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110354304 00000100:00100000:1.0:1780997059.344770:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110354304 00000100:00100000:1.0:1780997059.344845:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1176 00000100:00100000:1.0:1780997059.344856:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110354304:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997059.344928:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110354304:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 74us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997059.344936:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1176 00000100:00080000:3.0:1780997059.344987:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997059.346728:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110354560 00000100:00100000:0.0:1780997059.346741:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110354560 00000100:00100000:0.0:1780997059.346873:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2509 00000100:00100000:0.0:1780997059.346885:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110354560:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997059.346951:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110354560:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (2748us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997059.346959:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2509 00000100:00080000:3.0:1780997059.349333:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997059.378985:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997059.379086:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110354688 00000100:00100000:2.0:1780997059.379097:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110354688 00000100:00100000:2.0:1780997059.379148:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1184 00000100:00100000:2.0:1780997059.379157:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110354688:12345-192.168.206.51@tcp:38:ptlrpcd_01_01.0 00010000:00020000:2.0:1780997059.379180:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997059.379263:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110354688:12345-192.168.206.51@tcp:38:ptlrpcd_01_01.0 Request processed in 94us (957us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997059.379296:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1184 00010000:00010000:1.0:1780997060.327086:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997061.349744:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997062.375544:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780997063.077475:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997063.077481:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997063.077485:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997063.077492:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3585 00000100:00080000:3.0:1780997063.077498:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1780997063.077504:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997063.077527:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968887e05500 x1867507126862208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997063.077564:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997063.077568:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997063.077569:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997063.077573:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3585 00000100:00080000:3.0:1780997063.077575:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1780997063.077578:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997063.077592:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba187480 x1867507126862464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997063.077641:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997063.077645:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997063.077646:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1780997063.077651:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126862336:0@lo:400:kworker.0 00000100:00080000:3.0:1780997063.077652:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3585 00000100:00080000:3.0:1780997063.077658:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1780997063.077664:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997063.077680:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba186d80 x1867507126862720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997063.077703:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997063.077707:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997063.077709:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997063.077712:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3585 00000100:00080000:3.0:1780997063.077715:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1780997063.077719:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997063.077725:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997063.077735:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba185f80 x1867507126863104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997063.077764:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1780997063.077766:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126862592:0@lo:400:kworker.0 00000100:00100000:0.0:1780997063.077774:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126862080:0@lo:400:kworker.0 00000400:00000100:0.0:1780997063.077802:0:3499:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126862080 offset 0 length 224: 4 00000100:00100000:3.0:1780997063.077809:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997063.077831:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126862976:0@lo:400:kworker.0 00000100:00100000:3.0:1780997063.077851:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997063.077859:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997063.077862:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126862848:0@lo:400:kworker.0 00000100:00100000:3.0:1780997063.077893:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997063.077920:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126862976 00000100:00100000:0.0:1780997063.077927:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126862976 00000100:00100000:0.0:1780997063.077994:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126862848 00000100:00100000:0.0:1780997063.077997:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126862848 00000100:00100000:0.0:1780997063.078033:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510 00000100:00100000:0.0:1780997063.078042:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126862976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997063.078091:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126862976:12345-0@lo:400:kworker.0 Request processed in 51us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997063.078108:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510 00000100:00100000:0.0:1780997063.078123:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2511 00000100:00100000:0.0:1780997063.078129:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126862848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997063.078173:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126862848:12345-0@lo:400:kworker.0 Request processed in 32us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997063.078179:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2511 00000100:00100000:0.0:1780997063.078219:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126862976:0@lo:400:kworker.0 00000100:00100000:1.0:1780997063.078304:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126862208:0@lo:38:kworker.0 00000100:00100000:1.0:1780997063.078337:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997063.078368:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126862464:0@lo:38:kworker.0 00000100:00100000:1.0:1780997063.078389:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997063.078417:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba186d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126862720:0@lo:38:kworker.0 00000100:00080000:3.0:1780997063.078427:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780997063.078432:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997063.078444:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997063.078461:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126862848:0@lo:400:kworker.0 00000100:00100000:1.0:1780997063.078467:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126863104:0@lo:38:kworker.0 00000100:00100000:1.0:1780997063.078495:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997063.078519:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126862336 00000100:00100000:3.0:1780997063.078524:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126862336 00000100:00100000:1.0:1780997063.078534:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126862592 00000100:00100000:1.0:1780997063.078540:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126862592 00000100:00100000:3.0:1780997063.078564:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126862208 00000100:00100000:1.0:1780997063.078569:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126862464 00000100:00100000:3.0:1780997063.078570:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126862208 00000100:00100000:1.0:1780997063.078575:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126862464 00000100:00100000:3.0:1780997063.078588:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126863104 00000100:00100000:3.0:1780997063.078592:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126863104 00000100:00100000:1.0:1780997063.078596:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1780997063.078606:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126862336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997063.078612:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1780997063.078622:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126862592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997063.078652:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126862336:12345-0@lo:400:kworker.0 Request processed in 48us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997063.078660:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:3.0:1780997063.078672:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126862592:12345-0@lo:400:kworker.0 Request processed in 51us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997063.078679:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:1.0:1780997063.078684:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126862208:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997063.078767:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997063.078803:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126862208:12345-0@lo:38:kworker.0 Request processed in 117us (465us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997063.079193:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1780997063.079212:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1780997063.079217:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126862464:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997063.079228:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997063.079292:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126862464:12345-0@lo:38:kworker.0 Request processed in 53us (881us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997063.079300:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1780997063.079313:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1780997063.079317:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126863104:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997063.079327:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997063.079549:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126863104:12345-0@lo:38:kworker.0 Request processed in 229us (1053us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997063.079556:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00080000:3.0:1780997063.079583:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997063.079611:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126862592:0@lo:400:kworker.0 00000100:00100000:3.0:1780997063.079696:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126862720 00000100:00100000:3.0:1780997063.079713:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126862720 00000100:00100000:3.0:1780997063.079743:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937 00000100:00100000:3.0:1780997063.079748:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126862720:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997063.079759:0:8242:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997063.079787:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126862720:12345-0@lo:38:kworker.0 Request processed in 37us (1344us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997063.079793:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00000100:00080000:3.0:1780997063.084047:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997063.084060:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997063.084066:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126862208:0@lo:38:kworker.0 00000100:00080000:3.0:1780997063.084096:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997063.084100:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997063.084103:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126862464:0@lo:38:kworker.0 00000100:00100000:0.0:1780997063.084407:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126862336:0@lo:400:kworker.0 00000100:00080000:3.0:1780997063.084436:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997063.084442:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997063.084446:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba186d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126862720:0@lo:38:kworker.0 00000100:00080000:3.0:1780997063.084462:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997063.084465:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997063.084468:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126863104:0@lo:38:kworker.0 00000100:00100000:1.0:1780997063.086619:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00010000:00010000:3.0:1780997063.397521:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1780997063.595470:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780997063.595479:0:9294:0:(genops.c:906:class_export_put()) final put ffff9689ba670800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1780997063.595711:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780997063.595716:0:8226:0:(genops.c:906:class_export_put()) final put ffff9689ba676800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1780997063.596377:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba670800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1780997063.596426:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba676800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1780997063.596443:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689ba677800 for lustre-OST0001 00000020:00000080:3.0:1780997063.596447:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689ba675000 for lustre-OST0000 00000001:00100000:3.0:1780997063.596933:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1780997063.596954:0:72364:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378731 is committed 00000020:00000080:3.0:1780997063.596958:0:72364:0:(genops.c:906:class_export_put()) final put ffff96898d684000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780997063.598150:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96898d684000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1780997063.598224:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96898d685800 for lustre-MDT0001 00000100:00100000:3.0:1780997064.101664:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780997064.101686:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126863232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780997064.101761:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997064.101806:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126863232 00000100:00100000:3.0:1780997064.101813:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126863232 00000100:00100000:3.0:1780997064.101853:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:3.0:1780997064.101862:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126863232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997064.101892:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997064.101932:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126863232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997064.101939:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:0.0:1780997064.102292:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997064.102302:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126863360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997064.102332:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997064.102359:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126863360 00000100:00100000:0.0:1780997064.102363:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126863360 00000100:00100000:0.0:1780997064.102389:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:0.0:1780997064.102396:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126863360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997064.102412:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997064.102441:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126863360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997064.102447:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00100000:0.0:1780997064.102479:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126863360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780997064.103477:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126863232:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1780997064.422643:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1780997064.453900:0:3490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110355072 offset 0 length 224: 4 00000100:00100000:0.0:1780997064.453999:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997064.454115:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997064.454154:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997064.454251:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110355584 00000100:00100000:1.0:1780997064.454261:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110355584 00000100:00100000:1.0:1780997064.454349:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110355456 00000100:00100000:1.0:1780997064.454359:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110355456 00000100:00100000:1.0:1780997064.454387:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2512 00000100:00100000:1.0:1780997064.454397:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110355584:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997064.454475:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110355584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 80us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997064.454483:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2512 00000100:00100000:1.0:1780997064.454501:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2513 00000100:00100000:1.0:1780997064.454508:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110355456:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997064.454533:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110355456:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997064.454540:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2513 00000100:00080000:0.0:1780997064.454759:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780997064.454764:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997064.455234:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110355200 00000100:00100000:3.0:1780997064.455241:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110355200 00000100:00100000:1.0:1780997064.455544:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1188 00000100:00100000:1.0:1780997064.455551:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110355200:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:1.0:1780997064.455572:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997064.455669:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110355200:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 116us (1669us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997064.455676:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1188 00000100:00100000:0.0:1780997064.459930:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997064.460111:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110355328 00000100:00100000:3.0:1780997064.460122:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110355328 00000100:00100000:3.0:1780997064.460201:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1179 00000100:00100000:3.0:1780997064.460212:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110355328:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997064.460327:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110355328:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 117us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997064.460335:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1179 00000100:00080000:0.0:1780997064.460697:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1780997065.446889:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997066.469758:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997067.493497:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780997068.199223:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997068.199230:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997068.199234:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997068.199242:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3590 00000100:00080000:0.0:1780997068.199248:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780997068.199255:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997068.199259:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126863488:0@lo:400:kworker.0 00000100:00100000:0.0:1780997068.199326:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfaa8e00 x1867507126863616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1780997068.199328:0:3497:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126863488 offset 0 length 224: 4 00000100:00080000:0.0:1780997068.199366:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997068.199370:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997068.199372:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997068.199375:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3590 00000100:00080000:0.0:1780997068.199379:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780997068.199383:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997068.199397:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfaa9180 x1867507126863872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997068.199402:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997068.199414:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126863744:0@lo:400:kworker.0 00000100:00080000:0.0:1780997068.199416:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997068.199421:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997068.199437:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997068.199442:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3590 00000100:00080000:0.0:1780997068.199445:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1780997068.199450:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997068.199452:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997068.199469:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bb5b8000 x1867507126864128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997068.199475:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126864000:0@lo:400:kworker.0 00000100:00100000:2.0:1780997068.199501:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997068.199508:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997068.199512:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997068.199514:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997068.199518:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3590 00000100:00080000:0.0:1780997068.199521:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780997068.199525:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997068.199540:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b78c2a00 x1867507126864512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997068.199545:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126863744 00000100:00100000:2.0:1780997068.199553:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126863744 00000100:00100000:0.0:1780997068.199595:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126864384:0@lo:400:kworker.0 00000100:00100000:2.0:1780997068.199602:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126864000 00000100:00100000:2.0:1780997068.199606:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126864000 00000100:00100000:2.0:1780997068.199628:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1780997068.199633:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997068.199639:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126863744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997068.199656:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997068.199663:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126864256:0@lo:400:kworker.0 00000100:00100000:0.0:1780997068.199696:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997068.199697:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126863744:12345-0@lo:400:kworker.0 Request processed in 58us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997068.199706:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:2.0:1780997068.199724:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1780997068.199729:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126864384 00000100:00100000:2.0:1780997068.199731:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126864000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997068.199734:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126864384 00000100:00100000:2.0:1780997068.199761:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126864000:12345-0@lo:400:kworker.0 Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997068.199768:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1780997068.199771:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126864256 00000100:00100000:0.0:1780997068.199775:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126864256 00000100:00080000:2.0:1780997068.199786:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997068.199791:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997068.199794:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997068.199802:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514 00000100:00100000:0.0:1780997068.199810:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126864384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997068.199831:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126864000:0@lo:400:kworker.0 00000100:00100000:2.0:1780997068.199845:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126863744:0@lo:400:kworker.0 00000100:00100000:0.0:1780997068.199856:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126864384:12345-0@lo:400:kworker.0 Request processed in 46us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997068.199870:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514 00000100:00100000:2.0:1780997068.199882:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515 00000100:00100000:2.0:1780997068.199891:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126864256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997068.199914:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126864384:0@lo:400:kworker.0 00000100:00100000:2.0:1780997068.199922:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126864256:12345-0@lo:400:kworker.0 Request processed in 32us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997068.199929:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515 00000100:00100000:0.0:1780997068.199937:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126864256:0@lo:400:kworker.0 00000100:00100000:1.0:1780997068.200932:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126863616:0@lo:38:kworker.0 00000100:00100000:1.0:1780997068.200974:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997068.200995:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126863872:0@lo:38:kworker.0 00000100:00100000:1.0:1780997068.201015:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997068.201043:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126864128:0@lo:38:kworker.0 00000100:00100000:1.0:1780997068.201064:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997068.201092:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126864512:0@lo:38:kworker.0 00000100:00100000:1.0:1780997068.201112:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997068.201158:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126864128 00000100:00100000:1.0:1780997068.201163:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126864128 00000100:00100000:1.0:1780997068.201185:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:1.0:1780997068.201190:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126864128:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997068.201219:0:23042:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997068.201253:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126864128:12345-0@lo:38:kworker.0 Request processed in 62us (187us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997068.201261:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00000100:00100000:1.0:1780997068.201296:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126863616 00000100:00100000:1.0:1780997068.201300:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126863616 00000100:00100000:3.0:1780997068.201411:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126863872 00000100:00100000:3.0:1780997068.201415:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126863872 00000100:00100000:3.0:1780997068.201430:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126864512 00000100:00100000:3.0:1780997068.201437:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126864512 00000100:00100000:3.0:1780997068.201449:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1780997068.201454:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126863616:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997068.201464:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997068.201492:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126863616:12345-0@lo:38:kworker.0 Request processed in 37us (518us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997068.201498:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1780997068.201510:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1780997068.201514:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126863872:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997068.201523:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997068.201545:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126863872:12345-0@lo:38:kworker.0 Request processed in 29us (528us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997068.201551:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1780997068.201562:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1780997068.201567:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126864512:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997068.201575:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997068.201596:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126864512:12345-0@lo:38:kworker.0 Request processed in 28us (483us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997068.201601:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00080000:3.0:1780997068.201896:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997068.201902:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997068.201905:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126863616:0@lo:38:kworker.0 00000100:00080000:3.0:1780997068.201915:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997068.201918:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997068.201920:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126863872:0@lo:38:kworker.0 00000100:00080000:3.0:1780997068.201938:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997068.201942:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997068.201945:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126864128:0@lo:38:kworker.0 00000100:00080000:3.0:1780997068.201953:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997068.201956:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997068.201958:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126864512:0@lo:38:kworker.0 00010000:00010000:1.0:1780997068.517400:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997069.221655:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba186d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126864640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997069.221727:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997069.221785:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126864768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997069.221822:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997069.221916:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126864640 00000100:00100000:0.0:1780997069.221923:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126864640 00000100:00100000:0.0:1780997069.221965:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126864768 00000100:00100000:0.0:1780997069.221969:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126864768 00000100:00100000:0.0:1780997069.221986:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:0.0:1780997069.221997:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126864640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997069.222027:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997069.222074:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126864640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997069.222321:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba186d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126864640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780997069.225155:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:3.0:1780997069.226818:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126864768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997069.226857:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997069.226941:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126864768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1774us (5118us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997069.226950:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00100000:1.0:1780997069.227114:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126864768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997069.229109:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00010000:00010000:0.0:1780997069.542599:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997069.576479:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997069.576528:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997069.576560:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:2.0:1780997069.576592:0:3491:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110355712 offset 0 length 224: 4 00000100:00100000:3.0:1780997069.576605:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110355840 00000100:00100000:3.0:1780997069.576616:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110355840 00000100:00100000:2.0:1780997069.576621:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997069.576658:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110355968 00000100:00100000:3.0:1780997069.576662:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110355968 00000100:00100000:2.0:1780997069.576674:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1192 00000100:00100000:2.0:1780997069.576684:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110355840:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:2.0:1780997069.576708:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997069.576713:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1182 00000100:00100000:3.0:1780997069.576723:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110355968:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997069.576770:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110356096 00000100:00100000:2.0:1780997069.576777:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110355840:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 91us (305us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997069.576778:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110355968:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 54us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997069.576778:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110356096 00000100:00100000:2.0:1780997069.576794:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1192 00000100:00100000:1.0:1780997069.576814:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110356224 00000100:00100000:1.0:1780997069.576818:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110356224 00000100:00100000:1.0:1780997069.576841:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5925 00000100:00100000:1.0:1780997069.576849:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2393:x1867507110356096:12345-192.168.206.51@tcp:9:kworker.0 00000100:00100000:0.0:1780997069.576866:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5926 00000020:00000080:1.0:1780997069.576871:0:25179:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059e1c 00000100:00100000:0.0:1780997069.576880:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2393:x1867507110356224:12345-192.168.206.51@tcp:9:kworker.0 00000100:00080000:1.0:1780997069.576882:0:25179:0:(import.c:65:import_set_state_nolock()) ffff9689886b4000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1780997069.576902:0:25169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059e23 00000100:00080000:0.0:1780997069.576910:0:25169:0:(import.c:65:import_set_state_nolock()) ffff9689ba419000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1780997069.576931:0:25179:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969450 00000001:00000004:0.0:1780997069.576960:0:25169:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:3.0:1780997069.577070:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1182 00000100:00100000:1.0:1780997069.577079:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:285c134c-d3a6-4c01-bb4d-8148c50d5f95+2:2393:x1867507110356096:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 230us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997069.577085:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:285c134c-d3a6-4c01-bb4d-8148c50d5f95+2:2393:x1867507110356224:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 209us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997069.577091:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5925 00000100:00080000:2.0:1780997069.577136:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997069.577141:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997069.577144:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1780997069.577150:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997069.577174:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997069.578095:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5926 00010000:00010000:1.0:1780997070.565516:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997071.594764:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997072.613432:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780997073.317450:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997073.317457:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997073.317460:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997073.317474:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3595 00000100:00080000:0.0:1780997073.317480:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00000400:3.0:1780997073.317588:0:3499:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780997057/real 1780997057] req@ffff968888605f80 x1867507126860160/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997073 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997073.317615:0:3499:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff968888605f80 x1867507126860160/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997073 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997073.317630:0:3499:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1780997073.317634:0:3499:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1780997073.317636:0:3499:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.151@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1780997073.317638:0:3499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1780997073.317642:0:3499:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff968888605f80 x1867507126860160/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997073 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997073.317651:0:3499:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff968887e04a80 x1867507126862080/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997079 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997073.317659:0:3499:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff968986936300 x1867507126863488/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997084 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1780997073.317675:0:3499:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1780997073.317678:0:3499:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1780997073.317679:0:3499:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1780997073.317680:0:3499:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1780997073.317702:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:0:1867507126864896:0@lo:400:kworker.0 00000100:00100000:3.0:1780997073.317716:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126862080:0@lo:400:kworker.0 00000100:00100000:3.0:1780997073.317720:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126860160:0@lo:400:kworker.0 00000100:00100000:3.0:1780997073.317760:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126863488:0@lo:400:kworker.0 00000100:00080000:0.0:1780997073.317908:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997073.317929:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b78c2a00 x1867507126865024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997073.317973:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997073.317977:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997073.317979:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997073.317982:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3595 00000100:00080000:0.0:1780997073.317985:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1780997073.317988:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997073.318001:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bb5b8000 x1867507126865280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997073.318015:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997073.318018:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997073.318019:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997073.318023:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3595 00000100:00080000:0.0:1780997073.318025:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1780997073.318027:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997073.318037:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bb5b8a80 x1867507126865536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997073.318064:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997073.318068:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997073.318070:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997073.318078:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3595 00000100:00080000:0.0:1780997073.318081:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1780997073.318085:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997073.318096:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ad886d80 x1867507126865920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997073.318109:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997073.318112:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1780997073.318114:0:36:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997073.318117:0:36:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3554 00000100:00080000:0.0:1780997073.318120:0:36:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997073.318128:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ad884e00 x1867507126866048/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997073.318146:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126865664:0@lo:400:kworker.0 00000100:00100000:0.0:1780997073.318216:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997073.318247:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997073.318253:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126865792:0@lo:400:kworker.0 00000100:00100000:0.0:1780997073.318302:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997073.318330:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126865664 00000100:00100000:0.0:1780997073.318337:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126865664 00000100:00100000:0.0:1780997073.318391:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126865792 00000100:00100000:0.0:1780997073.318394:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126865792 00000100:00100000:0.0:1780997073.318416:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516 00000100:00100000:0.0:1780997073.318424:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126865664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997073.318479:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126865664:12345-0@lo:400:kworker.0 Request processed in 57us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997073.318670:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126865152:0@lo:400:kworker.0 00000100:00100000:2.0:1780997073.318705:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997073.318730:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997073.318736:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126865408:0@lo:400:kworker.0 00000100:00100000:2.0:1780997073.318757:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997073.318786:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126865152 00000100:00100000:2.0:1780997073.318789:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126865152 00000100:00100000:2.0:1780997073.318821:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126865408 00000100:00100000:2.0:1780997073.318825:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126865408 00000100:00100000:2.0:1780997073.318845:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1780997073.318851:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126865152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997073.318898:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126865152:12345-0@lo:400:kworker.0 Request processed in 46us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997073.318905:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1780997073.318925:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1780997073.318931:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126865408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997073.318956:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126865408:12345-0@lo:400:kworker.0 Request processed in 25us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997073.318962:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1780997073.319017:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126865408:0@lo:400:kworker.0 00000100:00100000:2.0:1780997073.319029:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126865152:0@lo:400:kworker.0 00000100:00100000:0.0:1780997073.319398:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516 00000100:00100000:0.0:1780997073.319429:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517 00000100:00100000:0.0:1780997073.319438:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126865792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997073.319474:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126865792:12345-0@lo:400:kworker.0 Request processed in 38us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997073.319480:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517 00000100:00080000:0.0:1780997073.319512:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780997073.319516:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997073.319518:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780997073.319547:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126865792:0@lo:400:kworker.0 00000100:00100000:0.0:1780997073.319558:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126865664:0@lo:400:kworker.0 00000100:00100000:3.0:1780997073.323426:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126865024:0@lo:38:kworker.0 00000100:00100000:3.0:1780997073.324776:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997073.324874:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126865280:0@lo:38:kworker.0 00000100:00100000:3.0:1780997073.324911:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997073.327066:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126865024 00000100:00100000:0.0:1780997073.327079:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126865024 00000100:00100000:0.0:1780997073.327123:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126865280 00000100:00100000:0.0:1780997073.327126:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126865280 00000100:00100000:0.0:1780997073.327147:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1780997073.327155:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126865024:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1780997073.327197:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1780997073.327203:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126865280:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997073.327223:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997073.327298:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126865280:12345-0@lo:38:kworker.0 Request processed in 94us (2386us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997073.327305:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:3.0:1780997073.327359:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126865536:0@lo:38:kworker.0 00000100:00100000:3.0:1780997073.327400:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997073.327441:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126865920:0@lo:38:kworker.0 00000100:00100000:3.0:1780997073.327466:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997073.327486:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126866048:0@lo:250:kworker.0 00000400:00000100:3.0:1780997073.327503:0:3495:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126866048 offset 0 length 520: 4 00000100:00080000:3.0:1780997073.327548:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997073.327553:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997073.327557:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126865280:0@lo:38:kworker.0 00000100:00100000:2.0:1780997073.327661:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126865536 00000100:00100000:2.0:1780997073.327666:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126865536 00000100:00100000:2.0:1780997073.327690:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:2.0:1780997073.327695:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126865536:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1780997073.327757:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126865920 00000100:00100000:3.0:1780997073.327761:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126865920 00000100:00100000:3.0:1780997073.327782:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1780997073.327787:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126865920:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997073.329358:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1780997073.329427:0:80061:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997073.329446:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126865024:12345-0@lo:38:kworker.0 Request processed in 2290us (4675us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997073.329457:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1780997073.329459:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126865536:12345-0@lo:38:kworker.0 Request processed in 1764us (2059us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997073.329466:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00000100:00080000:1.0:1780997073.329684:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997073.329691:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997073.329695:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126865024:0@lo:38:kworker.0 00000100:00080000:1.0:1780997073.329709:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997073.329713:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997073.329715:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126865536:0@lo:38:kworker.0 00010000:00020000:3.0:1780997073.330068:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997073.330144:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126865920:12345-0@lo:38:kworker.0 Request processed in 2355us (2676us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997073.330151:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00080000:1.0:1780997073.330266:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997073.330291:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997073.330295:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126865920:0@lo:38:kworker.0 00010000:00010000:3.0:1780997073.639716:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997074.341456:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780997074.341480:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126866176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997074.341555:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997074.341609:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126866176 00000100:00100000:1.0:1780997074.341617:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126866176 00000100:00100000:1.0:1780997074.341667:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:1.0:1780997074.341676:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126866176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780997074.341710:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997074.341756:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126866176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997074.341763:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00100000:1.0:1780997074.341806:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126866176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997074.342055:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997074.342067:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126866304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997074.342098:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997074.342160:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126866304 00000100:00100000:0.0:1780997074.342174:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126866304 00000100:00100000:0.0:1780997074.342211:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:0.0:1780997074.342219:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126866304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997074.342235:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997074.342301:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126866304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997074.342317:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:2.0:1780997074.342457:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126866304:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1780997074.668196:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997074.693428:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:3.0:1780997074.693472:0:3490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110356352 offset 0 length 224: 4 00000100:00100000:1.0:1780997074.693549:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110356608 00000100:00100000:1.0:1780997074.693560:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110356608 00000100:00100000:1.0:1780997074.693632:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1185 00000100:00100000:1.0:1780997074.693643:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110356608:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997074.693722:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110356608:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 81us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997074.693729:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1185 00000100:00080000:1.0:1780997074.693751:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997074.694091:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997074.694186:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110356480 00000100:00100000:2.0:1780997074.694192:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110356480 00000100:00100000:2.0:1780997074.694216:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1196 00000100:00100000:2.0:1780997074.694222:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2393:x1867507110356480:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:2.0:1780997074.694244:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997074.694318:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2393:x1867507110356480:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 94us (228us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997074.694325:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1196 00000001:00100000:2.0:1780997075.368775:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:2.0:1780997075.368785:0:9294:0:(genops.c:906:class_export_put()) final put ffff9689ba41c800/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:3.0:1780997075.368845:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba41c800/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-OST0001 00000020:00000080:3.0:1780997075.368905:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689ba419000 for lustre-OST0001 00000001:00100000:0.0:1780997075.370264:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:0.0:1780997075.370294:0:8226:0:(genops.c:906:class_export_put()) final put ffff9689886b0000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:3.0:1780997075.370369:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689886b0000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-OST0000 00000020:00000080:3.0:1780997075.370414:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689886b4000 for lustre-OST0000 00010000:00010000:1.0:1780997075.685385:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1780997075.742658:0:3491:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110356736 offset 0 length 520: 4 00000100:00100000:0.0:1780997075.742714:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997075.742754:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997075.743524:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110356864 00000100:00100000:3.0:1780997075.743534:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110356864 00000100:00100000:3.0:1780997075.743570:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110356992 00000100:00100000:3.0:1780997075.743573:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110356992 00000100:00100000:3.0:1780997075.743612:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1186 00000100:00100000:3.0:1780997075.743621:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110356992:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997075.743695:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110356992:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 75us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997075.743702:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1186 00000100:00100000:3.0:1780997075.743719:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1197 00000100:00100000:3.0:1780997075.743723:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110356864:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:3.0:1780997075.743742:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997075.743763:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110356864:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 39us (1051us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997075.743769:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1197 00010000:00010000:1.0:1780997076.711165:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997077.733554:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780997078.440468:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997078.440480:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1780997078.440482:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997078.440487:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997078.440491:0:38:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997078.440498:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3600 00000100:00080000:2.0:1780997078.440503:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997078.440509:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997078.440552:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b78c3b80 x1867507126866432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997078.440605:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997078.440616:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997078.440618:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997078.440622:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3600 00000100:00080000:2.0:1780997078.440625:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997078.440629:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997078.440643:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bb5b8000 x1867507126866688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997078.440659:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997078.440676:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997078.440678:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997078.440681:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3600 00000100:00080000:2.0:1780997078.440683:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997078.440688:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997078.440701:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfaa9180 x1867507126866944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997078.440737:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997078.440741:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997078.440742:0:38:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997078.440745:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3600 00000100:00080000:2.0:1780997078.440748:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997078.440751:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997078.440774:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfaa9500 x1867507126867328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997078.440809:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126866560:0@lo:400:kworker.0 00000100:00100000:0.0:1780997078.440814:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126866432:0@lo:38:kworker.0 00000100:00100000:0.0:1780997078.443408:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997078.443452:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126866688:0@lo:38:kworker.0 00000100:00100000:0.0:1780997078.443483:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997078.443502:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126866944:0@lo:38:kworker.0 00000100:00100000:0.0:1780997078.443526:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997078.443543:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126867328:0@lo:38:kworker.0 00000100:00100000:0.0:1780997078.443563:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997078.443620:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126866432 00000100:00100000:0.0:1780997078.443627:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126866432 00000100:00100000:0.0:1780997078.443659:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126866688 00000100:00100000:0.0:1780997078.443662:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126866688 00000100:00100000:0.0:1780997078.443675:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126867328 00000100:00100000:0.0:1780997078.443678:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126867328 00000100:00100000:0.0:1780997078.443694:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1780997078.443701:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126866432:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997078.443800:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997078.443847:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126866432:12345-0@lo:38:kworker.0 Request processed in 145us (447us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997078.443864:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1780997078.443881:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:0.0:1780997078.443886:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126866688:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997078.443896:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997078.443919:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126866688:12345-0@lo:38:kworker.0 Request processed in 32us (436us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997078.443926:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:0.0:1780997078.443936:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1780997078.443940:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126867328:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997078.444098:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997078.444125:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126867328:12345-0@lo:38:kworker.0 Request processed in 183us (561us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997078.444131:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1780997078.444162:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126866944 00000100:00100000:0.0:1780997078.444166:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126866944 00000100:00100000:0.0:1780997078.444184:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:0.0:1780997078.444189:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126866944:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997078.444199:0:23042:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997078.444485:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126866944:12345-0@lo:38:kworker.0 Request processed in 34us (697us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997078.444494:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00000100:00080000:0.0:1780997078.444551:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997078.444557:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997078.444561:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126866432:0@lo:38:kworker.0 00000100:00080000:0.0:1780997078.444582:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997078.444585:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997078.444588:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126866688:0@lo:38:kworker.0 00000100:00080000:0.0:1780997078.444597:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997078.444600:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997078.444603:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126866944:0@lo:38:kworker.0 00000100:00080000:0.0:1780997078.444611:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997078.444614:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997078.444616:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126867328:0@lo:38:kworker.0 00000100:00100000:2.0:1780997078.449332:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997078.449383:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997078.449395:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126866816:0@lo:400:kworker.0 00000100:00100000:2.0:1780997078.449430:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997078.449465:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126867072:0@lo:400:kworker.0 00000100:00100000:2.0:1780997078.449492:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997078.449509:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997078.449515:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126867200:0@lo:400:kworker.0 00000100:00100000:2.0:1780997078.449535:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997078.449569:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126866560 00000100:00100000:2.0:1780997078.449577:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126866560 00000100:00100000:2.0:1780997078.449626:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126866816 00000100:00100000:2.0:1780997078.449628:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126866816 00000100:00100000:2.0:1780997078.449646:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1780997078.449654:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126866560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997078.449702:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126866560:12345-0@lo:400:kworker.0 Request processed in 48us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997078.449708:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1780997078.449724:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:2.0:1780997078.449730:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126866816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997078.449755:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126866816:12345-0@lo:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997078.449761:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1780997078.449944:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126867072 00000100:00100000:0.0:1780997078.449949:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126867072 00000100:00100000:0.0:1780997078.449974:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126867200 00000100:00100000:0.0:1780997078.449976:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126867200 00000100:00100000:0.0:1780997078.449993:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518 00000100:00100000:0.0:1780997078.449998:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126867072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997078.450033:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126867072:12345-0@lo:400:kworker.0 Request processed in 35us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997078.450039:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518 00000100:00100000:0.0:1780997078.450051:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519 00000100:00100000:0.0:1780997078.450056:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126867200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997078.450081:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126867200:12345-0@lo:400:kworker.0 Request processed in 25us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997078.450086:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519 00000100:00080000:2.0:1780997078.450927:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997078.450931:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997078.450933:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997078.450964:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126867200:0@lo:400:kworker.0 00000100:00100000:2.0:1780997078.450985:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126867072:0@lo:400:kworker.0 00000100:00100000:2.0:1780997078.451014:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126866816:0@lo:400:kworker.0 00000100:00100000:2.0:1780997078.451025:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126866560:0@lo:400:kworker.0 00010000:00010000:0.0:1780997078.757415:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1780997079.199742:0:85137:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1780997079.199749:0:85137:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1780997079.199750:0:85137:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1780997079.199862:0:85137:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9689bcd7b000 00000020:01000004:1.0:1780997079.199876:0:85137:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1780997079.199890:0:85137:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1780997079.199905:0:85137:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff96888ac53380) 00000020:00000080:1.0:1780997079.199921:0:85137:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1780997079.319060:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1780997079.319434:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1780997079.320805:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1780997079.321027:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1780997079.321427:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1780997079.322486:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1780997079.322744:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1780997079.323195:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1780997079.326528:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1780997079.327643:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1780997079.327944:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1780997079.328208:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1780997079.328558:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1780997079.335106:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1780997079.336903:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1780997079.345173:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.345645:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.345908:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.346134:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.346421:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.346698:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.346917:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.347129:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.347610:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.347931:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.348196:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.348714:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.348911:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.349125:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.349476:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.349730:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.349904:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.350119:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.350554:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.350802:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.351028:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.351401:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.351625:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.351838:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.352034:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.352364:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.352528:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.352727:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.352918:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1780997079.353134:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.353394:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.353593:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1780997079.354219:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1780997079.354893:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1780997079.355341:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1780997079.355781:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1780997079.356018:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1780997079.356369:0:85137:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1780997079.356946:0:85137:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1780997079.357191:0:85137:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1780997079.357201:0:85137:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1780997079.357213:0:85137:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c03059f7a 00000020:01000004:2.0:1780997079.357219:0:85137:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1780997079.357231:0:85137:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1780997079.357237:0:85137:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9689bcd7b000 from MGS 00000020:01000004:2.0:1780997079.357241:0:85137:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1780997079.357253:0:85137:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff968990fe4d40) 00000020:00000080:2.0:1780997079.357266:0:85137:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1780997079.357820:0:85137:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689bcd7b000 from MGS, refs=2 00080000:01000000:2.0:1780997079.357826:0:85137:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1780997079.357833:0:85137:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c03059f88 00010000:00010000:2.0:1780997079.357969:0:85137:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1780997079.371051:0:85137:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1780997079.377228:0:85141:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1780997079.379157:0:85137:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1780997079.379223:0:85137:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1780997079.380507:0:85137:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1780997079.380774:0:85137:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1780997079.380925:0:85137:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1780997079.380931:0:85137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1780997079.383619:0:85137:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1780997079.383636:0:85137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1780997079.384181:0:85137:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1780997079.384188:0:85137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1780997079.385167:0:85137:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1780997079.385192:0:85137:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1780997079.385195:0:85137:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1780997079.385198:0:85137:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1780997079.385203:0:85137:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96898d0e6000 already not connected (conn 67, was 0): CONNECTING 00000100:00100000:1.0:1780997079.385209:0:85137:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:1.0:1780997079.463573:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780997079.463592:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126867456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997079.463672:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997079.463726:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126867456 00000100:00100000:1.0:1780997079.463735:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126867456 00000100:00100000:1.0:1780997079.463782:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014 00000100:00100000:1.0:1780997079.463791:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126867456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780997079.463818:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997079.463862:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126867456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997079.463869:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014 00000100:00100000:1.0:1780997079.463917:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126867456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997079.464330:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888917a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126867584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997079.464369:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997079.464447:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126867584 00000100:00100000:0.0:1780997079.464453:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126867584 00000100:00100000:0.0:1780997079.464486:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:0.0:1780997079.464493:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126867584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997079.464511:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997079.464545:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126867584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997079.464552:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00000100:00100000:1.0:1780997079.464629:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888917a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126867584:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1780997079.782984:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997080.805610:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997080.840635:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997080.840736:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997080.840875:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110357248 00000100:00100000:1.0:1780997080.840886:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110357248 00000100:00100000:1.0:1780997080.840958:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110357120 00000100:00100000:1.0:1780997080.840962:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110357120 00000100:00100000:1.0:1780997080.840982:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1189 00000100:00100000:1.0:1780997080.840992:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888917bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110357248:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997080.841075:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888917bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110357248:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 84us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997080.841083:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1189 00000100:00100000:2.0:1780997080.841092:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1201 00000100:00100000:2.0:1780997080.841101:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888917a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110357120:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:2.0:1780997080.841123:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997080.841190:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888917a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110357120:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 83us (448us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997080.841198:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1201 00000100:00080000:3.0:1780997080.841226:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1780997081.829529:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997082.854651:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997083.561350:0:3495:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780997073/real 1780997073] req@ffff9689ad884e00 x1867507126866048/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780997083 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997083.561511:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997083.561516:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1780997083.561519:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997083.561523:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997083.561526:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997083.561531:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3605 00000100:00080000:0.0:1780997083.561535:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997083.561542:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997083.561584:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bb5b8a80 x1867507126867712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997083.561665:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997083.561669:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997083.561671:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997083.561675:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3605 00000100:00080000:0.0:1780997083.561677:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997083.561681:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997083.561693:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bb5b8000 x1867507126867968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997083.561709:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997083.561712:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997083.561714:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997083.561718:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3605 00000100:00080000:0.0:1780997083.561720:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997083.561725:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997083.561736:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc639500 x1867507126868224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997083.561749:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126868096:0@lo:400:kworker.0 00000100:00080000:0.0:1780997083.561778:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997083.561781:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997083.561783:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997083.561788:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3605 00000100:00080000:0.0:1780997083.561790:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997083.561794:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997083.561805:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bb576d80 x1867507126868608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997083.561828:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997083.561841:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126868352:0@lo:400:kworker.0 00000100:00100000:1.0:1780997083.561871:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780997083.561882:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126867840:0@lo:400:kworker.0 00000100:00100000:0.0:1780997083.561882:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997083.561917:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997083.561929:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997083.561938:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126868480:0@lo:400:kworker.0 00000100:00100000:1.0:1780997083.561963:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126868352 00000100:00100000:0.0:1780997083.561969:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997083.561974:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126868352 00000100:00100000:0.0:1780997083.562007:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126868096 00000100:00100000:0.0:1780997083.562013:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126868096 00000100:00100000:1.0:1780997083.562035:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126868480 00000100:00100000:1.0:1780997083.562040:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126868480 00000100:00100000:0.0:1780997083.562053:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126867840 00000100:00100000:0.0:1780997083.562058:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126867840 00000100:00100000:1.0:1780997083.562078:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:1.0:1780997083.562092:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126868352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997083.562094:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:0.0:1780997083.562107:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126868096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997083.562166:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126868096:12345-0@lo:400:kworker.0 Request processed in 60us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997083.562174:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126868352:12345-0@lo:400:kworker.0 Request processed in 84us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997083.562179:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1780997083.562188:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:0.0:1780997083.562201:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1780997083.562212:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126867840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997083.562218:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521 00000100:00100000:1.0:1780997083.562229:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126868480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997083.562246:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126867840:12345-0@lo:400:kworker.0 Request processed in 37us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997083.562252:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1780997083.562305:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126868480:12345-0@lo:400:kworker.0 Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997083.562313:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521 00000100:00100000:0.0:1780997083.562391:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126868480:0@lo:400:kworker.0 00000100:00100000:1.0:1780997083.562400:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126867840:0@lo:400:kworker.0 00000100:00100000:0.0:1780997083.562409:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126868352:0@lo:400:kworker.0 00000100:00100000:1.0:1780997083.562420:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126868096:0@lo:400:kworker.0 00000100:00100000:2.0:1780997083.562576:0:3495:0:(client.c:2511:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9689ad884e00 x1867507126866048/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780997083 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997083.562594:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126867712:0@lo:38:kworker.0 00000100:00100000:2.0:1780997083.562624:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.562644:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126867968:0@lo:38:kworker.0 00000100:00100000:2.0:1780997083.562666:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.562694:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126868224:0@lo:38:kworker.0 00000100:00100000:1.0:1780997083.562724:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126867712 00000100:00100000:2.0:1780997083.562726:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997083.562732:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126867712 00000100:00100000:2.0:1780997083.562750:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126868608:0@lo:38:kworker.0 00000100:00100000:1.0:1780997083.562754:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126867968 00000100:00100000:1.0:1780997083.562758:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126867968 00000100:00100000:1.0:1780997083.562780:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1780997083.562781:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997083.562791:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126867712:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1780997083.562805:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to DISCONN 00010000:00020000:1.0:1780997083.562814:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1780997083.562822:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1780997083.562831:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126866048:0@lo:250:kworker.0 00000100:00100000:1.0:1780997083.562854:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126867712:12345-0@lo:38:kworker.0 Request processed in 63us (228us total) trans 0 rc -19/-19 00000100:00080000:2.0:1780997083.562859:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1780997083.562864:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00080000:2.0:1780997083.562868:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997083.562874:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126867712:0@lo:38:kworker.0 00000100:00100000:1.0:1780997083.562883:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126868608 00000100:00100000:1.0:1780997083.562888:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126868608 00000100:00100000:1.0:1780997083.562908:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1780997083.562914:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126867968:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997083.562924:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997083.562951:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126867968:12345-0@lo:38:kworker.0 Request processed in 37us (284us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997083.562957:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1780997083.562970:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:1.0:1780997083.562983:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126868608:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997083.562993:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1780997083.563008:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997083.563015:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997083.563018:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997083.563025:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126868608:12345-0@lo:38:kworker.0 Request processed in 41us (247us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997083.563032:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00080000:3.0:1780997083.563053:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997083.563058:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1780997083.563061:0:36:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 10000000:01000000:1.0:1780997083.563066:0:85137:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:3.0:1780997083.563067:0:36:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3600 00000100:00080000:3.0:1780997083.563078:0:36:0:(import.c:591:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 5s 00010000:00010000:1.0:1780997083.563082:0:85137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba454a00/0x30fd811c03059bd0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059bd7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1780997083.563084:0:36:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 10000000:00010000:1.0:1780997083.563098:0:85137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba454a00/0x30fd811c03059bd0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059bd7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997083.563106:0:85137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1780997083.563109:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968986936300 x1867507126868736/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1780997083.563132:0:85137:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780997083.563144:0:85137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba454a00/0x30fd811c03059bd0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059bd7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00020000:3.0:1780997083.563158:0:3495:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff968986936300 x1867507126868736/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1780997083.563178:0:85137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689a56c8600/0x30fd811c03059b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059b3d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997083.563188:0:85137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c8600/0x30fd811c03059b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059b3d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997083.563194:0:85137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997083.563201:0:85137:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780997083.563206:0:85137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689a56c8600/0x30fd811c03059b36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059b3d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.563217:0:85137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c03059b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059b59 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997083.563235:0:85137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c03059b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059b59 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997083.563241:0:85137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997083.563256:0:85137:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780997083.563261:0:85137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c03059b52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059b59 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.563303:0:85137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1000/0x30fd811c03059b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059b83 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997083.563311:0:85137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1000/0x30fd811c03059b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059b83 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997083.563316:0:85137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997083.563340:0:85137:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780997083.563345:0:85137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1000/0x30fd811c03059b7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059b83 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.563367:0:85137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689a56c8000/0x30fd811c03059b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059b91 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997083.563372:0:85137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c8000/0x30fd811c03059b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059b91 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997083.563377:0:85137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997083.563390:0:85137:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780997083.563394:0:85137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689a56c8000/0x30fd811c03059b8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059b91 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.563414:0:85137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c03059ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059bad expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997083.563420:0:85137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c03059ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059bad expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997083.563424:0:85137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997083.563438:0:85137:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780997083.563442:0:85137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c03059ba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059bad expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.563450:0:85137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689a56c9c00/0x30fd811c03059bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059bbb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997083.563456:0:85137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c9c00/0x30fd811c03059bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059bbb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997083.563461:0:85137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997083.563475:0:85137:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780997083.563479:0:85137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689a56c9c00/0x30fd811c03059bb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059bbb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.563492:0:85137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c03059bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059be5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997083.563498:0:85137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c03059bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059be5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997083.563502:0:85137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997083.563523:0:85137:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780997083.563529:0:85137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c03059bde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059be5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.563551:0:85137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059b4b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997083.563558:0:85137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059b4b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997083.563563:0:85137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997083.563572:0:85137:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780997083.563576:0:85137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c03059b44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059b4b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.563593:0:85137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0a00/0x30fd811c03059b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059b67 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997083.563601:0:85137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0a00/0x30fd811c03059b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059b67 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997083.563607:0:85137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997083.563619:0:85137:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780997083.563623:0:85137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0a00/0x30fd811c03059b60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059b67 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.563634:0:85137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1800/0x30fd811c03059b6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059b75 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997083.563640:0:85137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1800/0x30fd811c03059b6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059b75 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997083.563655:0:85137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1780997083.563661:0:85137:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780997083.563667:0:85137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1800/0x30fd811c03059b6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059b75 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.563679:0:85137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1c00/0x30fd811c03059b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059b9f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997083.563686:0:85137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1c00/0x30fd811c03059b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059b9f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997083.563691:0:85137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1780997083.563709:0:85137:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:2.0:1780997083.563713:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126868224 00010000:00010000:1.0:1780997083.563714:0:85137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1c00/0x30fd811c03059b98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059b9f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997083.563722:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126868224 00010000:00010000:1.0:1780997083.563727:0:85137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c03059bc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c03059bc9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997083.563734:0:85137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c03059bc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c03059bc9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997083.563739:0:85137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1780997083.563743:0:85137:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780997083.563747:0:85137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c03059bc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c03059bc9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997083.563755:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:2.0:1780997083.563768:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126868224:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997083.563851:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997083.563888:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126868224:12345-0@lo:38:kworker.0 Request processed in 120us (1163us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997083.563895:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00000100:00080000:1.0:1780997083.576857:0:85137:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96898d0e6000 already not connected (conn 68, was 0): CONNECTING 00000100:00080000:3.0:1780997083.576859:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997083.576983:0:85137:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997083.577013:0:85137:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3611 00000100:00080000:1.0:1780997083.577020:0:85137:0:(import.c:591:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1780997083.577028:0:85137:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00080000:3.0:1780997083.577057:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:3.0:1780997083.577065:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:0:1867507126868736:0@lo:250:kworker.0 00000100:00100000:1.0:1780997083.577070:0:85137:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9688858b1f80 x1867507126868864/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997083.577165:0:85137:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:3.0:1780997083.577199:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997083.577204:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997083.577208:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126867968:0@lo:38:kworker.0 00000100:00080000:3.0:1780997083.577223:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997083.577226:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997083.577230:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126868224:0@lo:38:kworker.0 00000100:00080000:3.0:1780997083.577241:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997083.577244:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997083.577247:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126868608:0@lo:38:kworker.0 00000100:00100000:3.0:1780997083.577336:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126868864:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1780997083.577763:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997083.578125:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126868864 00000100:00100000:1.0:1780997083.578134:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126868864 00000100:00100000:1.0:1780997083.578457:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1780997083.578466:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3495:x1867507126868864:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1780997083.578493:0:85143:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo t0 exp 0000000000000000 cur 3611 last 0 00000020:00000080:1.0:1780997083.578526:0:85143:0:(genops.c:1406:class_connect()) connect: client bdcd4e03-8d56-43b8-bfda-3b2f97e67d18, cookie 0x30fd811c03059f8f 00000100:00080000:1.0:1780997083.578661:0:85143:0:(import.c:65:import_set_state_nolock()) ffff9689868b8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997083.578733:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:3495:x1867507126868864:12345-0@lo:250:mount.lustre.0 Request processed in 267us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997083.578741:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1780997083.578838:0:3495:0:(client.c:3131:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 25 00000100:00080000:2.0:1780997083.578850:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:2.0:1780997083.578860:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1780997083.578865:0:3495:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1780997083.578881:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1780997083.578884:0:3495:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1780997083.578921:0:3495:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1780997083.578930:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126868864:0@lo:250:mount.lustre.0 00000020:01000000:2.0:1780997083.578995:0:38:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.206.151@tcp 10000000:01000000:2.0:1780997083.579016:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1780997083.579019:0:38:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780997083.579022:0:38:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1780997083.579023:0:38:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780997083.579025:0:38:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780997083.579026:0:38:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780997083.579027:0:38:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780997083.579029:0:38:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780997083.579031:0:38:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780997083.579033:0:38:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1780997083.579082:0:38:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1780997083.579090:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1780997083.579092:0:38:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780997083.579093:0:38:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1780997083.579094:0:38:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780997083.579095:0:38:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780997083.579096:0:38:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780997083.579097:0:38:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780997083.579104:0:38:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780997083.579105:0:38:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780997083.579106:0:38:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1780997083.579134:0:38:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1780997083.579140:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1780997083.579141:0:38:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780997083.579143:0:38:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1780997083.579144:0:38:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780997083.579145:0:38:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780997083.579146:0:38:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780997083.579147:0:38:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780997083.579148:0:38:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780997083.579150:0:38:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780997083.579151:0:38:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1780997083.579173:0:38:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1780997083.579212:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126868992:0@lo:253:kworker.0 00000100:00100000:2.0:1780997083.579253:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997083.579608:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126869248:0@lo:253:kworker.0 00000100:00100000:0.0:1780997083.579651:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.580017:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997083.580025:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126869120:0@lo:253:kworker.0 00000100:00100000:2.0:1780997083.580145:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997083.580207:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997083.580224:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126869376:0@lo:400:kworker.0 00000100:00100000:0.0:1780997083.580249:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997083.580312:0:85137:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1780997083.580322:0:85137:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1780997083.580360:0:85137:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1780997083.580365:0:85137:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1780997083.580489:0:85137:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1780997083.580520:0:85137:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1780997083.580524:0:85137:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1780997083.580525:0:85137:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780997083.580527:0:85137:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997083.580528:0:85137:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997083.580529:0:85137:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997083.580530:0:85137:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997083.580532:0:85137:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997083.580533:0:85137:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780997083.580535:0:85137:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997083.580536:0:85137:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1780997083.580538:0:85137:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1780997083.580540:0:85137:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1780997083.580541:0:85137:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780997083.580543:0:85137:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997083.580544:0:85137:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997083.580545:0:85137:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997083.580546:0:85137:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997083.580547:0:85137:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997083.580548:0:85137:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780997083.580549:0:85137:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997083.580550:0:85137:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1780997083.580567:0:85137:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1780997083.580579:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126869504:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1780997083.580610:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997083.580622:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bb46e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997083.580735:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126868992 00000100:00100000:3.0:1780997083.580743:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126868992 00000100:00100000:3.0:1780997083.580775:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126869248 00000100:00100000:3.0:1780997083.580778:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126869248 00000100:00100000:3.0:1780997083.580788:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126869376 00000100:00100000:3.0:1780997083.580796:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126869376 00000100:00100000:3.0:1780997083.580808:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126869504 00000100:00100000:3.0:1780997083.580810:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126869504 00000100:00100000:3.0:1780997083.580823:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1780997083.580833:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3496:x1867507126868992:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1780997083.580861:0:85144:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:3.0:1780997083.580984:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1780997083.580991:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3498:x1867507126869248:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1780997083.581005:0:85145:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:3.0:1780997083.581412:0:85147:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1780997083.581529:0:85144:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 108 20000000:01000000:0.0:1780997083.583185:0:85148:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1780997083.583202:0:85148:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1780997083.583205:0:85148:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1780997083.583208:0:85148:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1780997083.583478:0:85148:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1780997083.583708:0:85144:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1780997083.583739:0:85144:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1780997083.584313:0:85143:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1780997083.584323:0:85143:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1780997083.584768:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126869120 00000100:00100000:0.0:1780997083.584779:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126869120 00000100:00100000:2.0:1780997083.584948:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1780997083.584962:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:3498:x1867507126869376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997083.585074:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:3498:x1867507126869376:12345-0@lo:400:kworker.0 Request processed in 116us (4823us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.585082:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1780997083.585127:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1780997083.585135:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:85137:x1867507126869504:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1780997083.585172:0:85149:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1780997083.585176:0:85149:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1780997083.585179:0:85149:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1780997083.585189:0:85149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1780997083.585455:0:85144:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000100:00100000:0.0:1780997083.585789:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126869376:0@lo:400:kworker.0 20000000:01000000:1.0:1780997083.585849:0:85144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1780997083.585926:0:85147:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780997083.585932:0:85147:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780997083.585958:0:85147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96898d6dae00/0x30fd811c03059f96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.585974:0:85147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96898d6dae00/0x30fd811c03059f96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780997083.586024:0:85147:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000093569s 00010000:00010000:1.0:1780997083.586030:0:85147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96898d6dae00/0x30fd811c03059f96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.586049:0:85147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96898d6dae00/0x30fd811c03059f96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.586056:0:85147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96898d6dae00/0x30fd811c03059f96 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.586063:0:85147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96898d6dae00/0x30fd811c03059f96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.586070:0:85147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dae00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997083.586074:0:85147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96898d6dae00/0x30fd811c03059f96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.586083:0:85147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96898d6dae00/0x30fd811c03059f96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.586096:0:85147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96898d6dae00/0x30fd811c03059f96 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.586104:0:85147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96898d6dae00/0x30fd811c03059f96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.586110:0:85147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96898d6dae00/0x30fd811c03059f96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997083.586160:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3496:x1867507126868992:12345-0@lo:253:kworker.0 Request processed in 5328us (6906us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997083.586169:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:1.0:1780997083.586174:0:3496:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1780997083.586176:0:3496:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1780997083.586178:0:3496:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997083.586179:0:3496:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997083.586181:0:3496:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997083.586183:0:3496:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997083.586184:0:3496:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1780997083.586191:0:3496:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997083.586192:0:3496:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1780997083.586195:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126868992:0@lo:253:kworker.0 00000100:00100000:0.0:1780997083.586199:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1780997083.586207:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:3496:x1867507126869120:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1780997083.586225:0:85144:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1780997083.586238:0:85144:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1780997083.586322:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:85137:x1867507126869504:12345-0@lo:253:mount.lustre.0 Request processed in 1187us (5710us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997083.586329:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1780997083.586351:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126869504:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1780997083.586364:0:85137:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1780997083.586366:0:85137:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1780997083.586368:0:85137:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780997083.586369:0:85137:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997083.586370:0:85137:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997083.586371:0:85137:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997083.586372:0:85137:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997083.586373:0:85137:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780997083.586375:0:85137:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780997083.586376:0:85137:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997083.586377:0:85137:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1780997083.586394:0:85137:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9689bcd7b000 from lustre-MDT0000 10000000:01000000:1.0:1780997083.586423:0:85137:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1780997083.586425:0:85137:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1780997083.586436:0:85137:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9689bcd7b000 10000000:01000000:1.0:1780997083.586439:0:85137:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1780997083.586443:0:85137:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9689bcd7b000 10000000:01000000:1.0:1780997083.586446:0:85137:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1780997083.586449:0:85137:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9689bcd7b000 from 1 10000000:01000000:1.0:1780997083.586453:0:85137:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1780997083.586683:0:85137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.586693:0:85137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.586704:0:85137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997083.586727:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126869632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1780997083.586768:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997083.586842:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688874596c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997083.587311:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126869632 00000100:00100000:0.0:1780997083.587318:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126869632 00000100:00100000:0.0:1780997083.587353:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1780997083.587360:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:85137:x1867507126869632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780997083.587371:0:85143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997083.587384:0:85143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888955400/0x30fd811c03059fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059f9d expref: -99 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.587402:0:85143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888955400/0x30fd811c03059fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059f9d expref: 7 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.587413:0:85143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888955400/0x30fd811c03059fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059f9d expref: 7 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.587434:0:85143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955400, rc 0) 00000100:00100000:0.0:1780997083.587743:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:85137:x1867507126869632:12345-0@lo:101:mount.lustre.0 Request processed in 383us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.587746:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126869632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780997083.587750:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1780997083.587760:0:85137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.587768:0:85137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997083.587783:0:85137:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1780997083.587794:0:85137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.587802:0:85137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997083.587808:0:85137:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1780997083.588153:0:85137:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1780997083.588159:0:85137:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9689bcd7b000 10000000:01000000:2.0:1780997083.588162:0:85137:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1780997083.588166:0:85137:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1780997083.588168:0:85137:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1780997083.588192:0:85137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.588199:0:85137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.588206:0:85137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997083.588222:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6798700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126869760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780997083.588265:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.588329:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886bae180 going to sleep for 11 seconds 00000100:00100000:3.0:1780997083.588340:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126869760 00000100:00100000:3.0:1780997083.588346:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126869760 00000100:00100000:3.0:1780997083.588376:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1780997083.588383:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689872c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:85137:x1867507126869760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997083.588392:0:85149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997083.588404:0:85149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb3e00/0x30fd811c03059fb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c03059fab expref: -99 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997083.588420:0:85149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb3e00/0x30fd811c03059fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c03059fab expref: 8 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997083.588430:0:85149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb3e00/0x30fd811c03059fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c03059fab expref: 8 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997083.588447:0:85149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3e00, rc 0) 00000100:00100000:3.0:1780997083.588490:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689872c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:85137:x1867507126869760:12345-0@lo:101:mount.lustre.0 Request processed in 107us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997083.588496:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1780997083.588635:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6798700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126869760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997083.588647:0:85137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.588655:0:85137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997083.588715:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6798700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126869888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997083.588742:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.588852:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886bae180 going to sleep for 11 seconds 00000100:00100000:0.0:1780997083.589034:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126869888 00000100:00100000:0.0:1780997083.589051:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126869888 00000100:00100000:0.0:1780997083.589083:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1780997083.589091:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689872ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:85137:x1867507126869888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780997083.589244:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689872ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85137:x1867507126869888:12345-0@lo:501:mount.lustre.0 Request processed in 153us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997083.589251:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1780997083.589449:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6798700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126869888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780997083.589913:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126870016:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780997083.589969:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997083.590002:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff968887459240 going to sleep for 11 seconds 00000100:00100000:0.0:1780997083.590121:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126870016 00000100:00100000:0.0:1780997083.590127:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126870016 00000100:00100000:0.0:1780997083.590200:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1780997083.590209:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689872c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85137:x1867507126870016:12345-0@lo:503:mount.lustre.0 20000000:01000000:3.0:1780997083.590891:0:85144:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780997083.590954:0:85145:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1780997083.591078:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689872c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85137:x1867507126870016:12345-0@lo:503:mount.lustre.0 Request processed in 868us (1106us total) trans 0 rc 0/0 20000000:01000000:3.0:1780997083.591081:0:85144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1780997083.591086:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 20000000:01000000:1.0:1780997083.591175:0:85147:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780997083.591180:0:85147:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1780997083.591214:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126870016:0@lo:503:mount.lustre.0 00010000:00010000:1.0:1780997083.591342:0:85147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96898d6db800/0x30fd811c03059fb9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.591358:0:85147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96898d6db800/0x30fd811c03059fb9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780997083.591368:0:85147:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000188091s 00010000:00010000:1.0:1780997083.591372:0:85147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96898d6db800/0x30fd811c03059fb9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.591378:0:85147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96898d6db800/0x30fd811c03059fb9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.591384:0:85147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96898d6db800/0x30fd811c03059fb9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.591391:0:85147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96898d6db800/0x30fd811c03059fb9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.591397:0:85147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997083.591407:0:85147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96898d6db800/0x30fd811c03059fb9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.591415:0:85147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96898d6db800/0x30fd811c03059fb9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.591429:0:85147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96898d6db800/0x30fd811c03059fb9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.591441:0:85147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96898d6db800/0x30fd811c03059fb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.591448:0:85147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96898d6db800/0x30fd811c03059fb9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997083.591666:0:85150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85150:1867507126870144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997083.591719:0:85150:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.591759:0:85150:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886bae240 going to sleep for 11 seconds 00000100:00100000:3.0:1780997083.591812:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126870144 00000100:00100000:3.0:1780997083.591817:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126870144 00000100:00100000:3.0:1780997083.591857:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1780997083.591875:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689872c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85150:x1867507126870144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997083.592588:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689872c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85150:x1867507126870144:12345-0@lo:502:llog_process_th.0 Request processed in 581us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997083.592596:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1780997083.592731:0:85150:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85150:1867507126870144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780997083.592763:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780997083.592775:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997083.592778:0:85150:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1780997083.592783:0:85150:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1780997083.592786:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780997083.592804:0:85150:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff968886ec3380) 00000020:00000080:0.0:1780997083.592836:0:85150:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:0.0:1780997083.592843:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1780997083.592947:0:85150:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1780997083.592954:0:85150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c03059fc7 00000020:00000080:0.0:1780997083.593199:0:85150:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1780997083.593204:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997083.593208:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997083.593209:0:85150:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1780997083.593211:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780997083.593215:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997083.593216:0:85150:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1780997083.593219:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780997083.593227:0:85150:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff968886ec4d40) 00000020:00000080:0.0:1780997083.593240:0:85150:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:0.0:1780997083.593245:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1780997083.593247:0:85150:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1780997083.593250:0:85150:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1780997083.593256:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1780997083.593325:0:85150:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689bcd7b000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1780997083.593337:0:85150:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff968886ec19c0) 00000020:00000080:0.0:1780997083.593347:0:85150:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 20000000:01000000:2.0:1780997083.593382:0:85145:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780997083.593423:0:85145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1780997083.593441:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:3496:x1867507126869120:12345-0@lo:253:kworker.0 Request processed in 7235us (13295us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997083.593450:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:3.0:1780997083.593514:0:3496:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1780997083.593517:0:3496:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1780997083.593519:0:3496:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997083.593520:0:3496:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997083.593522:0:3496:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997083.593524:0:3496:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997083.593525:0:3496:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780997083.593527:0:3496:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997083.593528:0:3496:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1780997083.593531:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126869120:0@lo:253:kworker.0 00000100:00100000:2.0:1780997083.593639:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3498:x1867507126869248:12345-0@lo:253:kworker.0 Request processed in 12647us (13986us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.593647:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:1.0:1780997083.593710:0:85147:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780997083.593714:0:85147:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780997083.593735:0:85147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96898d6dbc00/0x30fd811c03059fdc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.593751:0:85147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96898d6dbc00/0x30fd811c03059fdc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780997083.593761:0:85147:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000188091s 00010000:00010000:1.0:1780997083.593766:0:85147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96898d6dbc00/0x30fd811c03059fdc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780997083.593770:0:3498:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1780997083.593771:0:3498:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1780997083.593773:0:3498:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00010000:00010000:1.0:1780997083.593773:0:85147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96898d6dbc00/0x30fd811c03059fdc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.593779:0:85147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96898d6dbc00/0x30fd811c03059fdc lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780997083.593781:0:3498:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997083.593783:0:3498:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997083.593784:0:3498:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997083.593786:0:3498:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780997083.593787:0:3498:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997083.593788:0:3498:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1780997083.593792:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126869248:0@lo:253:kworker.0 00010000:00010000:1.0:1780997083.593797:0:85147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96898d6dbc00/0x30fd811c03059fdc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.593803:0:85147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dbc00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997083.593807:0:85147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96898d6dbc00/0x30fd811c03059fdc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.593815:0:85147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96898d6dbc00/0x30fd811c03059fdc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.593830:0:85147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96898d6dbc00/0x30fd811c03059fdc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.593838:0:85147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96898d6dbc00/0x30fd811c03059fdc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.593844:0:85147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96898d6dbc00/0x30fd811c03059fdc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:01000000:0.0:1780997083.594008:0:85150:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1780997083.594015:0:85150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c03059fe3 00000020:00000080:0.0:1780997083.594211:0:85150:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1780997083.594218:0:85150:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1780997083.594223:0:85150:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x30fd811c03059fea 00080000:01000000:0.0:1780997083.594228:0:85150:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1780997083.594232:0:85150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c03059ff1 00010000:00010000:2.0:1780997083.682646:0:85150:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1780997083.682826:0:85150:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 285c134c-d3a6-4c01-bb4d-8148c50d5f95 idx: 0 lr: 98784247817 srv lr: 103079215104 lx: 0 gen 22 00000001:00080000:2.0:1780997083.685251:0:85150:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 21 00000001:00000004:2.0:1780997083.685404:0:85150:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:2.0:1780997083.685591:0:85150:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1780997083.685664:0:85150:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff968886bae300: xid 1867507110349696, transno 103079215109, client gen 22, slot idx 0 00000001:00080000:2.0:1780997083.685681:0:85150:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff968886baee40: xid 1867507110349952, transno 103079215110, client gen 22, slot idx 1 00000020:00000080:2.0:1780997083.689263:0:85150:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff968990fe0000) 00000020:00000080:2.0:1780997083.689323:0:85150:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:2.0:1780997083.689424:0:85150:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1780997083.689432:0:85150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305a00d 00000020:00000080:2.0:1780997083.692576:0:85150:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1780997083.707055:0:85150:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x30fd811c0305a014 00000020:00000080:3.0:1780997083.709565:0:85150:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1780997083.709580:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780997083.709589:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997083.709591:0:85150:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1780997083.709595:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1780997083.709608:0:85150:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1780997083.709611:0:85150:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1780997083.709612:0:85150:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1780997083.709613:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1780997083.709616:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997083.709617:0:85150:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1780997083.709620:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997083.709624:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997083.709625:0:85150:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1780997083.709630:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1780997083.709688:0:85150:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1780997083.709706:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780997083.709709:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997083.709711:0:85150:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1780997083.709713:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997083.709716:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997083.709717:0:85150:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1780997083.709720:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1780997083.709726:0:85150:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:00000080:3.0:1780997083.709752:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1780997083.709771:0:85150:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9689aeba0000) 00000020:00000080:3.0:1780997083.709814:0:85150:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1780997083.709821:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1780997083.709883:0:85150:0:(osp_dev.c:1197:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1780997083.709889:0:85150:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1780997083.709895:0:85150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305a022 00010000:00080000:3.0:1780997083.709931:0:85150:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689a67f5800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1780997083.711509:0:85150:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1780997083.713871:0:85150:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997083.713886:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1780997083.713919:0:85150:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1780997083.713937:0:85150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305a029 00000100:00080000:1.0:1780997083.713946:0:85150:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780997083.713952:0:85150:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9689a67f5800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997083.713987:0:85150:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9688858b3480 x1867507126870272/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997083.714016:0:85150:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1780997083.715913:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126870272:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1780997083.716014:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997083.716125:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126870272 00000100:00100000:0.0:1780997083.716134:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126870272 00000100:00100000:0.0:1780997083.716180:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:0.0:1780997083.716204:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126870272:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1780997083.716239:0:23042:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3611 last 0 00000020:00000080:0.0:1780997083.716299:0:23042:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305a030 00000004:00100000:0.0:1780997083.716315:0:23042:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780997083.716418:0:23042:0:(import.c:65:import_set_state_nolock()) ffff9689bfab4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997083.716477:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126870272:12345-0@lo:38:llog_process_th.0 Request processed in 273us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997083.716484:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000100:00100000:0.0:1780997083.716547:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1780997083.716556:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:0.0:1780997083.716564:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1780997083.716569:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1780997083.716572:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689a67f5800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1780997083.716577:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126870272:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1780997083.716898:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997083.716911:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997083.716913:0:85150:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1780997083.716917:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780997083.716920:0:85150:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1780997083.716921:0:85150:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997083.716923:0:85150:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997083.716924:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780997083.716926:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997083.716927:0:85150:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780997083.716929:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1780997083.716934:0:85150:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1780997083.716937:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997083.716938:0:85150:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1780997083.716940:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780997083.716944:0:85150:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:1.0:1780997083.716965:0:85150:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1780997083.716967:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780997083.716981:0:85150:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96888ac50000) 00000020:00000080:1.0:1780997083.716998:0:85150:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1780997083.717003:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1780997083.717334:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997083.717344:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126870400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997083.717380:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997083.717411:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126870400 00000100:00100000:0.0:1780997083.717415:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126870400 00000100:00100000:0.0:1780997083.717444:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00100000:0.0:1780997083.717451:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126870400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780997083.717475:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780997083.717523:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126870400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997083.717530:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00000100:00100000:0.0:1780997083.717574:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126870400:0@lo:41:osp-pre-1-0.0 00000004:00080000:1.0:1780997083.717733:0:85150:0:(osp_dev.c:1197:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1780997083.717741:0:85150:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1780997083.717748:0:85150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305a03e 00010000:00080000:1.0:1780997083.717781:0:85150:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689bfa9b800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1780997083.717991:0:85150:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:1.0:1780997083.719937:0:85150:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1780997083.719965:0:85150:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1780997083.720167:0:85150:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:1.0:1780997083.722204:0:85150:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780997083.722243:0:85150:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:1.0:1780997083.722462:0:85150:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000040:00080000:3.0:1780997083.726100:0:85156:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:3.0:1780997083.726121:0:85156:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1780997083.726378:0:85156:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:3.0:1780997083.726404:0:85156:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1780997083.726536:0:85156:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:3.0:1780997083.726540:0:85156:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1780997083.727979:0:85150:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997083.727993:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1780997083.728058:0:85150:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1780997083.728080:0:85150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305a045 00000100:00080000:1.0:1780997083.728091:0:85150:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780997083.728096:0:85150:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9689bfa9b800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997083.728144:0:85150:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9688858b2d80 x1867507126870528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997083.728185:0:85150:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1780997083.728245:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997083.728249:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997083.728251:0:85150:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1780997083.728254:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780997083.728256:0:85150:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1780997083.728258:0:85150:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997083.728260:0:85150:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997083.728261:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780997083.728264:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997083.728266:0:85150:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780997083.728293:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1780997083.728297:0:85150:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1780997083.728301:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997083.728303:0:85150:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1780997083.728306:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780997083.728309:0:85150:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:1.0:1780997083.728332:0:85150:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1780997083.728335:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780997083.728358:0:85150:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96888ac519c0) 00000020:00000080:1.0:1780997083.728375:0:85150:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:1.0:1780997083.728381:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1780997083.728439:0:85150:0:(osp_dev.c:1197:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1780997083.728445:0:85150:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1780997083.728450:0:85150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305a053 00010000:00080000:1.0:1780997083.728480:0:85150:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689bfa9f000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1780997083.728877:0:85150:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1780997083.728956:0:85150:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1780997083.728971:0:85150:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1780997083.729085:0:85150:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000100:00100000:2.0:1780997083.729532:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126870528:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780997083.729627:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.729698:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126870528 00000100:00100000:2.0:1780997083.729706:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126870528 00000100:00100000:2.0:1780997083.729739:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5927 00000100:00100000:2.0:1780997083.729745:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3495:x1867507126870528:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1780997083.729774:0:25173:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3611 last 0 00000020:00000080:2.0:1780997083.729799:0:25173:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305a05a 00002000:00100000:2.0:1780997083.729812:0:25173:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9689891ad000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1780997083.729817:0:25173:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1780997083.729819:0:25173:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1780997083.729874:0:25173:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1780997083.729897:0:25173:0:(import.c:65:import_set_state_nolock()) ffff9689bc85f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997083.729949:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126870528:12345-0@lo:8:llog_process_th.0 Request processed in 203us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.729956:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5927 00000100:00100000:2.0:1780997083.729996:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780997083.730005:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1780997083.730013:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1780997083.730018:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1780997083.730031:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bfa9b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1780997083.730057:0:3495:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:2.0:1780997083.730063:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126870528:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1780997083.730092:0:85156:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1780997083.730153:0:85156:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3611275881566ns, next at 0ns, rc = 0 00080000:00080000:2.0:1780997083.730160:0:85156:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1780997083.732030:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126870656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997083.732582:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997083.732795:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126870656 00000100:00100000:1.0:1780997083.732803:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126870656 00000100:00100000:1.0:1780997083.732902:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:1.0:1780997083.732910:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126870656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780997083.732940:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997083.732989:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126870656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997083.732996:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00100000:1.0:1780997083.733068:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126870656:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1780997083.736562:0:85150:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780997083.736779:0:85150:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:2.0:1780997083.736961:0:85150:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000040:00080000:1.0:1780997083.738991:0:85158:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:1.0:1780997083.738998:0:85158:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1780997083.740185:0:85158:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:1.0:1780997083.740220:0:85158:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1780997083.740756:0:85158:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:1.0:1780997083.740762:0:85158:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1780997083.740913:0:85138:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:1.0:1780997083.741553:0:85150:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997083.741566:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1780997083.742004:0:85150:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1780997083.742025:0:85150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305a061 00000100:00080000:1.0:1780997083.742035:0:85150:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780997083.742042:0:85150:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9689bfa9f000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997083.742102:0:85150:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9688858b3100 x1867507126870784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997083.742142:0:85150:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1780997083.742233:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126870784:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780997083.742315:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.742370:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126870784 00000100:00100000:2.0:1780997083.742377:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126870784 00000100:00100000:2.0:1780997083.742404:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5928 00000100:00100000:2.0:1780997083.742411:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3495:x1867507126870784:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1780997083.742437:0:25171:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3611 last 0 00000020:00000080:2.0:1780997083.742462:0:25171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305a068 00002000:00100000:2.0:1780997083.742477:0:25171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9689bc96a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1780997083.742482:0:25171:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1780997083.742485:0:25171:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1780997083.742564:0:25171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1780997083.742590:0:25171:0:(import.c:65:import_set_state_nolock()) ffff9689bc969800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997083.742656:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126870784:12345-0@lo:8:llog_process_th.0 Request processed in 244us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.742663:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5928 00000100:00100000:2.0:1780997083.742705:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780997083.742714:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1780997083.742729:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1780997083.742733:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1780997083.742737:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bfa9f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1780997083.742751:0:3495:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:2.0:1780997083.742756:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126870784:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1780997083.742888:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997083.742894:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997083.742896:0:85150:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1780997083.742899:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997083.742903:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997083.742904:0:85150:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1780997083.742907:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1780997083.742908:0:85150:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1780997083.742910:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997083.742911:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997083.742913:0:85150:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1780997083.742914:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997083.742916:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997083.742917:0:85150:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1780997083.742920:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1780997083.742947:0:85150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85150:1867507126870912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997083.742993:0:85150:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997083.743021:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126870912 00000100:00100000:1.0:1780997083.743025:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126870912 00000100:00100000:1.0:1780997083.743062:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1780997083.743069:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:85150:x1867507126870912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997083.743178:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:85150:x1867507126870912:12345-0@lo:502:llog_process_th.0 Request processed in 109us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997083.743185:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:1.0:1780997083.743223:0:85158:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1780997083.743284:0:85158:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3611288997493ns, next at 0ns, rc = 0 00080000:00080000:1.0:1780997083.743292:0:85158:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1780997083.743700:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997083.743709:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126871040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997083.743737:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.743767:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126871040 00000100:00100000:2.0:1780997083.743772:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126871040 00000100:00080000:3.0:1780997083.743874:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997083.743879:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997083.744156:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:2.0:1780997083.744163:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126871040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780997083.744398:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997083.744455:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126871040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 292us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.744462:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00100000:0.0:1780997083.744624:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126871040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997083.744835:0:85150:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689ba401300 going to sleep for 11 seconds 00000100:00100000:1.0:1780997083.744853:0:85150:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85150:1867507126870912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780997083.744900:0:85150:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997083.744908:0:85150:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997083.744910:0:85150:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1780997083.744914:0:85150:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1780997083.745205:0:85137:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1780997083.745229:0:85137:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1780997083.745254:0:85137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.745265:0:85137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997083.745302:0:85137:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9689bcd7b000 from 1 10000000:01000000:2.0:1780997083.745305:0:85137:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1780997083.745336:0:85137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.745357:0:85137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.745367:0:85137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997083.745384:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126871168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780997083.745423:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.745445:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898acc7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1780997083.745464:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126871168 00000100:00100000:2.0:1780997083.745469:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126871168 00000100:00100000:2.0:1780997083.745785:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1780997083.745798:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:85137:x1867507126871168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997083.745811:0:85144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997083.745826:0:85144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc843a00/0x30fd811c0305a076 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a06f expref: -99 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.745850:0:85144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc843a00/0x30fd811c0305a076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a06f expref: 8 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.745861:0:85144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc843a00/0x30fd811c0305a076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a06f expref: 8 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.745869:0:85144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc843a00, rc 0) 00000100:00100000:2.0:1780997083.745907:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:85137:x1867507126871168:12345-0@lo:101:mount.lustre.0 Request processed in 113us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.745913:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1780997083.745999:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126871168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997083.746014:0:85137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a076 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997083.746024:0:85137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a076 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997083.746817:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986936300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126871296:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1780997083.746867:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997083.746898:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986925f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997083.747026:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126871296 00000100:00100000:1.0:1780997083.747034:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126871296 00000100:00100000:1.0:1780997083.747083:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1780997083.747091:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:85137:x1867507126871296:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1780997083.747108:0:85143:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1780997083.747137:0:85143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1780997083.747142:0:85143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1780997083.747145:0:85143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1780997083.747148:0:85143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 111 00000100:00100000:1.0:1780997083.747259:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:85137:x1867507126871296:12345-0@lo:256:mount.lustre.0 Request processed in 168us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997083.747266:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1780997083.747509:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986936300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126871296:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1780997083.748149:0:85137:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1780997083.748185:0:85137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a076 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.748198:0:85137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a076 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997083.748206:0:85137:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9689bcd7b000 from 1 10000000:01000000:2.0:1780997083.748209:0:85137:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1780997083.748246:0:85137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.748254:0:85137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.748264:0:85137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997083.748313:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126871424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780997083.748355:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.748387:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688874ce000 going to sleep for 11 seconds 00000100:00100000:2.0:1780997083.748414:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126871424 00000100:00100000:2.0:1780997083.748421:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126871424 00000100:00100000:2.0:1780997083.748459:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1780997083.748467:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:85137:x1867507126871424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997083.748477:0:85144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997083.748491:0:85144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc843600/0x30fd811c0305a084 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a07d expref: -99 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.748529:0:85144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc843600/0x30fd811c0305a084 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a07d expref: 9 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.748539:0:85144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc843600/0x30fd811c0305a084 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a07d expref: 9 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.748548:0:85144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc843600, rc 0) 00000100:00100000:2.0:1780997083.748581:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85137:x1867507126871424:12345-0@lo:101:mount.lustre.0 Request processed in 115us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.748587:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1780997083.748630:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126871424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997083.748641:0:85137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.748649:0:85137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997083.748703:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126871552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997083.748728:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.748740:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688874ce000 going to sleep for 11 seconds 00000100:00100000:1.0:1780997083.749185:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126871552 00000100:00100000:1.0:1780997083.749191:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126871552 00000100:00100000:1.0:1780997083.749222:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1780997083.749228:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85137:x1867507126871552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780997083.749382:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85137:x1867507126871552:12345-0@lo:501:mount.lustre.0 Request processed in 153us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997083.749388:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1780997083.749655:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126871552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997083.749687:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126871680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997083.749734:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.749755:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688874ce000 going to sleep for 11 seconds 00000100:00100000:3.0:1780997083.749795:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126871680 00000100:00100000:3.0:1780997083.749800:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126871680 00000100:00100000:3.0:1780997083.749856:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1780997083.749864:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85137:x1867507126871680:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780997083.749951:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85137:x1867507126871680:12345-0@lo:503:mount.lustre.0 Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997083.749957:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1780997083.750017:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126871680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997083.750580:0:85160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85160:1867507126871808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997083.750634:0:85160:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.750949:0:85160:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688874ce0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997083.751027:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126871808 00000100:00100000:1.0:1780997083.751035:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126871808 00000100:00100000:1.0:1780997083.751083:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1780997083.751092:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85160:x1867507126871808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997083.752696:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85160:x1867507126871808:12345-0@lo:502:llog_process_th.0 Request processed in 1598us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.752709:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1780997083.752792:0:85160:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85160:1867507126871808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780997083.752831:0:85160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780997083.752841:0:85160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997083.752844:0:85160:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1780997083.752851:0:85160:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9689bcd7b000 00000020:00000080:2.0:1780997083.752853:0:85160:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1780997083.752863:0:85160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997083.752865:0:85160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997083.752866:0:85160:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1780997083.752868:0:85160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780997083.752870:0:85160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997083.752871:0:85160:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1780997083.752874:0:85160:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9689bcd7b000 00000020:00000080:2.0:1780997083.752876:0:85160:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1780997083.754617:0:85160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85160:1867507126871936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997083.754697:0:85160:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.754738:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126871936 00000100:00100000:2.0:1780997083.754745:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126871936 00000100:00100000:2.0:1780997083.754791:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1780997083.754806:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96899673b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85160:x1867507126871936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997083.754923:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96899673b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85160:x1867507126871936:12345-0@lo:502:llog_process_th.0 Request processed in 124us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.754941:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1780997083.754995:0:85160:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1780997083.755015:0:85160:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85160:1867507126871936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780997083.755046:0:85160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997083.755052:0:85160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997083.755054:0:85160:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1780997083.755059:0:85160:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1780997083.755141:0:85137:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1780997083.755181:0:85137:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780997083.755201:0:85137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.755213:0:85137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997083.755267:0:85137:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1780997083.755285:0:85137:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9689bcd7b000 10000000:01000000:2.0:1780997083.755287:0:85137:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9689bcd7b000 10000000:01000000:2.0:1780997083.755291:0:85137:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1780997083.755297:0:85137:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689bcd7b000 from 1 10000000:01000000:2.0:1780997083.755301:0:85137:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780997083.755328:0:85137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.755336:0:85137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.755345:0:85137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997083.755369:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126872064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780997083.755398:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.755421:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997083.755426:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126872064 00000100:00100000:3.0:1780997083.755432:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126872064 00000100:00100000:3.0:1780997083.755529:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1780997083.755538:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96899673a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:85137:x1867507126872064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997083.755549:0:85145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997083.755561:0:85145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb3000/0x30fd811c0305a092 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a08b expref: -99 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997083.755584:0:85145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb3000/0x30fd811c0305a092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a08b expref: 10 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997083.755595:0:85145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb3000/0x30fd811c0305a092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a08b expref: 10 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997083.755604:0:85145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3000, rc 0) 00000100:00100000:3.0:1780997083.755634:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96899673a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:85137:x1867507126872064:12345-0@lo:101:mount.lustre.0 Request processed in 98us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997083.758807:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126872064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780997083.758851:0:85137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.758866:0:85137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997083.759358:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126872192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780997083.759427:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997083.759471:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689898b5900 going to sleep for 11 seconds 00000100:00100000:0.0:1780997083.759553:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126872192 00000100:00100000:0.0:1780997083.759675:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126872192 00000004:00080000:1.0:1780997083.761858:0:85138:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1780997083.762014:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1780997083.765085:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1780997083.765107:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96899673a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:85137:x1867507126872192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997083.765355:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96899673a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:85137:x1867507126872192:12345-0@lo:501:mount.lustre.0 Request processed in 256us (5926us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.765364:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1780997083.765428:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126872192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997083.765487:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126872320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997083.765544:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997083.765574:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c600 going to sleep for 11 seconds 00000100:00100000:2.0:1780997083.765592:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126872320 00000100:00100000:2.0:1780997083.765904:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126872320 00000100:00100000:2.0:1780997083.765946:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1780997083.765953:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968996738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:85137:x1867507126872320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997083.766123:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968996738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:85137:x1867507126872320:12345-0@lo:503:mount.lustre.0 Request processed in 160us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.766131:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1780997083.766167:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126872320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780997083.766898:0:85162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85162:1867507126872448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997083.766943:0:85162:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997083.767229:0:85162:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689898b50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997083.768061:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126872448 00000100:00100000:1.0:1780997083.768073:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126872448 00000100:00100000:1.0:1780997083.768175:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1780997083.768186:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96899673b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:85162:x1867507126872448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997083.768369:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96899673b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:85162:x1867507126872448:12345-0@lo:502:llog_process_th.0 Request processed in 184us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997083.768377:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1780997083.768575:0:85162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85162:1867507126872448:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1780997083.768774:0:85162:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1780997083.768794:0:85162:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff968886ec0000) 00000020:00000080:0.0:1780997083.768829:0:85162:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1780997083.769252:0:85162:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689bcd7b000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1780997083.769258:0:85162:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689bcd7b000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1780997083.769262:0:85162:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689bcd7b000 4 00010000:00080000:0.0:1780997083.769336:0:85162:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689ba670800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1780997083.781631:0:85162:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1780997083.781761:0:85162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1780997083.781823:0:85162:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1780997083.781836:0:85162:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x30fd811c0305a0a0 00000100:00080000:1.0:1780997083.781848:0:85162:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780997083.781856:0:85162:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9689ba670800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997083.781900:0:85162:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9688858b0700 x1867507126872576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997083.781929:0:85162:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1780997083.781964:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126872576:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780997083.782049:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997083.782601:0:85162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85162:1867507126872704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997083.782928:0:85162:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997083.783571:0:85162:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984a72d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997083.783854:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126872704 00000100:00100000:2.0:1780997083.783862:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126872704 00000100:00100000:2.0:1780997083.783922:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1780997083.783931:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96899673a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:85162:x1867507126872704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997083.785220:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126872576 00000100:00100000:1.0:1780997083.785233:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126872576 00000100:00100000:1.0:1780997083.785261:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1780997083.785267:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126872576:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1780997083.785371:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126872576:12345-0@lo:38:llog_process_th.0 Request processed in 102us (3320us total) trans 0 rc -11/-11 00000100:00100000:1.0:1780997083.785379:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1780997083.785499:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96899673a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:85162:x1867507126872704:12345-0@lo:502:llog_process_th.0 Request processed in 1568us (2569us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.785524:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1780997083.786645:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780997083.786663:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ba670800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997083.786668:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1780997083.786672:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126872576:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1780997083.788214:0:85162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85162:1867507126872704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997083.788343:0:85162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85162:1867507126872832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997083.788433:0:85162:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997083.788485:0:85162:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689ba542840 going to sleep for 11 seconds 00000100:00100000:3.0:1780997083.788491:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126872832 00000100:00100000:3.0:1780997083.788499:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126872832 00000100:00100000:3.0:1780997083.788560:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1780997083.788570:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968996739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:85162:x1867507126872832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997083.788719:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968996739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:85162:x1867507126872832:12345-0@lo:502:llog_process_th.0 Request processed in 151us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997083.788728:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1780997083.788975:0:85162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85162:1867507126872832:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1780997083.789000:0:85162:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1780997083.792549:0:85137:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1780997083.792601:0:85137:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780997083.792627:0:85137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997083.792642:0:85137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780997083.792695:0:85137:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1780997083.792698:0:85137:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780997083.792699:0:85137:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997083.792700:0:85137:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997083.792701:0:85137:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997083.792703:0:85137:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997083.792704:0:85137:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780997083.792706:0:85137:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780997083.792708:0:85137:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997083.792709:0:85137:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780997083.792713:0:85137:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1780997083.792715:0:85137:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1780997083.792717:0:85137:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780997083.792723:0:85137:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997083.792724:0:85137:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997083.792725:0:85137:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997083.792726:0:85137:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997083.792727:0:85137:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780997083.792728:0:85137:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780997083.792729:0:85137:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997083.792730:0:85137:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780997083.792891:0:85137:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1780997083.792916:0:85137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126872960:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1780997083.793067:0:85137:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997083.793125:0:85137:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984a720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997083.793162:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126872960 00000100:00100000:2.0:1780997083.793172:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126872960 00000100:00100000:2.0:1780997083.793236:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1780997083.793247:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b74d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:85137:x1867507126872960:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1780997083.793296:0:85144:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1780997083.793314:0:85144:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1780997083.801253:0:85144:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780997083.801291:0:85144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1780997083.801401:0:85147:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780997083.801407:0:85147:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780997083.801429:0:85147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.801449:0:85147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bc843a00/0x30fd811c0305a076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a06f expref: 10 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.801458:0:85147:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.801518:0:85147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bc843a00/0x30fd811c0305a076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305a06f expref: 10 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.801533:0:85147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bc843a00/0x30fd811c0305a076 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305a06f expref: 10 pid: 85144 timeout: 3711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997083.801548:0:85147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85147:1867507126873088:0@lo:104: 00000100:00100000:1.0:1780997083.801638:0:85147:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997083.801695:0:85147:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688874ce3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997083.801924:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126873088 00000100:00100000:2.0:1780997083.801931:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126873088 00000100:00100000:2.0:1780997083.801987:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1780997083.801996:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:85147:x1867507126873088:12345-0@lo:104: 00010000:00010000:2.0:1780997083.802011:0:6334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305a076 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997083.802082:0:6334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1780997083.802088:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:85147:x1867507126873088:12345-0@lo:104: Request processed in 93us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997083.802095:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00010000:3.0:1780997083.802265:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997083.802307:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305a076 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997083.802316:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc843000 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997083.802320:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305a076 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997083.802329:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305a076 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997083.802336:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305a076 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997083.802343:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997083.802376:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305a076 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997083.802383:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997083.802403:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305a076 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997083.802427:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc843000/0x30fd811c0305a06f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305a076 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997083.802447:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997083.802449:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997083.802451:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997083.802459:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780997083.802473:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126873216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997083.802476:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b74d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:85137:x1867507126872960:12345-0@lo:253:mount.lustre.0 Request processed in 9228us (9405us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997083.802512:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997083.802696:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126873216 00000100:00100000:0.0:1780997083.802702:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126873216 00010000:00010000:0.0:1780997083.802725:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bc843a00/0x30fd811c0305a076 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305a06f expref: 11 pid: 85144 timeout: 3711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997083.802756:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1780997083.802763:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:3498:x1867507126873216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997083.802774:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997083.802779:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bc843a00/0x30fd811c0305a076 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305a06f expref: 11 pid: 85144 timeout: 3711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.802789:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bc843a00/0x30fd811c0305a076 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305a06f expref: 11 pid: 85144 timeout: 3711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.802807:0:25183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.802815:0:25183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1780997083.802835:0:25183:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001428725s 00010000:00010000:0.0:1780997083.802839:0:25183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.802846:0:25183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.802854:0:25183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.802868:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.802873:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dbc00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997083.802876:0:25183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.802883:0:25183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.802891:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997083.802900:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997083.803048:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:3498:x1867507126873216:12345-0@lo:103:ldlm_bl.0 Request processed in 285us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997083.803056:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:3.0:1780997083.803246:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126873216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997083.803335:0:85137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:85137:1867507126872960:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1780997083.803346:0:85137:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1780997083.803351:0:85137:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1780997083.803353:0:85137:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780997083.803354:0:85137:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997083.803355:0:85137:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997083.803356:0:85137:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997083.803358:0:85137:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997083.803359:0:85137:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780997083.803360:0:85137:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780997083.803362:0:85137:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997083.803363:0:85137:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1780997083.803378:0:85137:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1780997083.803432:0:85147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc843a00/0x30fd811c0305a076 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305a06f expref: 10 pid: 85144 timeout: 3711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997083.803446:0:85147:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85147:1867507126873088:0@lo:104: 00010000:00010000:1.0:1780997083.803461:0:85147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.803471:0:85147:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.803486:0:85147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997083.803510:0:85147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96898d6dbc00/0x30fd811c0305a0a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997083.803745:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00080000:0.0:1780997083.832190:0:85137:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444067 00000040:01000000:1.0:1780997083.833263:0:85137:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1780997083.833491:0:85168:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444067 00000020:00080000:0.0:1780997083.833496:0:85168:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444067 00000040:01000000:3.0:1780997083.834870:0:85169:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1780997083.835253:0:85137:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1780997083.837422:0:85169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780997083.839598:0:85169:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1780997083.839689:0:85169:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1780997083.840730:0:85170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85170:1867507126873344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780997083.840804:0:85170:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997083.840839:0:85170:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688810e46c0 going to sleep for 11 seconds 00000040:01000000:1.0:1780997083.841990:0:85137:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1780997083.842032:0:85137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1780997083.842473:0:85137:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1780997083.842480:0:85137:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1780997083.842514:0:85137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780997083.843537:0:85137:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1780997083.844083:0:85137:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1780997083.844133:0:85137:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1780997083.844267:0:85137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1780997083.844916:0:85137:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00000100:00100000:0.0:1780997083.845359:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126873344 00000100:00100000:0.0:1780997083.845370:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126873344 00000100:00100000:0.0:1780997083.845429:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:0.0:1780997083.845440:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85170:x1867507126873344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997083.845606:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85170:x1867507126873344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 157us (4792us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997083.845614:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00000100:00100000:0.0:1780997083.845672:0:85170:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85170:1867507126873344:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1780997083.845718:0:85170:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1780997083.845764:0:85170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85170:1867507126873472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997083.845809:0:85170:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997083.845837:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126873472 00000100:00100000:0.0:1780997083.845841:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126873472 00000100:00100000:0.0:1780997083.845862:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:0.0:1780997083.845868:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85170:x1867507126873472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997083.845959:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85170:x1867507126873472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 91us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997083.845965:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00000100:00100000:0.0:1780997083.845983:0:85170:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888795540 going to sleep for 11 seconds 00000100:00100000:0.0:1780997083.845996:0:85170:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85170:1867507126873472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997083.846063:0:85170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85170:1867507126873600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997083.846083:0:85170:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997083.846099:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126873600 00000100:00100000:0.0:1780997083.846102:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126873600 00000100:00100000:0.0:1780997083.846135:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:0.0:1780997083.846141:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85170:x1867507126873600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997083.846176:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85170:x1867507126873600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 35us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997083.846181:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00000100:00100000:0.0:1780997083.846196:0:85170:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888795540 going to sleep for 11 seconds 00000100:00100000:0.0:1780997083.846208:0:85170:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85170:1867507126873600:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1780997083.846244:0:85170:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1780997083.848314:0:85170:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1780997083.848407:0:85170:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1780997083.848412:0:85170:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1780997083.857530:0:85137:0:(ldlm_lib.c:3037:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215110 00010000:00080000:3.0:1780997083.858502:0:85171:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85171 00010000:02000000:3.0:1780997083.858552:0:85171:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1780997083.858564:0:85171:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1780997083.858568:0:85171:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1780997083.858908:0:85137:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1780997083.858925:0:85137:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1780997083.858942:0:85137:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:0.0:1780997083.858960:0:85137:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1780997083.861586:0:85137:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780997083.862739:0:85137:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1780997083.883164:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997084.582928:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126873728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997084.583025:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997084.583086:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126873728 00000100:00100000:2.0:1780997084.583094:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126873728 00000100:00100000:2.0:1780997084.583151:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:2.0:1780997084.583161:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126873728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997084.583182:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997084.583236:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126873728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997084.583243:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:2.0:1780997084.583314:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126873728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997084.587976:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997084.587999:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126873856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997084.588072:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997084.588391:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126873856 00000100:00100000:0.0:1780997084.588401:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126873856 00000100:00100000:0.0:1780997084.588458:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:0.0:1780997084.588634:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126873856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997084.588659:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997084.588719:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126873856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 252us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997084.588727:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:2.0:1780997084.588783:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126873856:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1780997084.905354:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997084.938704:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997084.938753:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997084.938818:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997084.938852:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110357632 00000100:00100000:2.0:1780997084.938861:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110357632 00000100:00100000:2.0:1780997084.938921:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110357504 00000100:00100000:2.0:1780997084.938925:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110357504 00000100:00100000:2.0:1780997084.938943:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1192 00000100:00100000:2.0:1780997084.938953:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110357632:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997084.939041:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110357632:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 83us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997084.939048:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1192 00000100:00100000:2.0:1780997084.939082:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1206 00000100:00100000:2.0:1780997084.939086:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110357504:12345-192.168.206.51@tcp:38:kworker.0 00010000:00080000:2.0:1780997084.939121:0:65272:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '285c134c-d3a6-4c01-bb4d-8148c50d5f95' at ffff968990f72000, cookie 0x30fd811c03059ff8 00010000:00080000:2.0:1780997084.939127:0:65272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp recovering/t103079215111 exp ffff968990f72000 cur 3612 last 1780997083 00010000:02000400:2.0:1780997084.939135:0:65272:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1780997084.939143:0:65272:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1780997084.939163:0:65272:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1780997084.939370:0:65272:0:(import.c:65:import_set_state_nolock()) ffff9689bc969000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997084.939403:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110357504:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 315us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997084.939410:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1206 00000100:00080000:3.0:1780997084.939673:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997084.945332:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110357376 00000100:00100000:0.0:1780997084.945346:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110357376 00000100:00100000:0.0:1780997084.945395:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:0.0:1780997084.945403:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2393:x1867507110357376:12345-192.168.206.51@tcp:250:kworker.0 00010000:00080000:0.0:1780997084.945432:0:85143:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 5bc603cc-b633-43af-a003-872c004686c8@192.168.206.51@tcp t0 exp 0000000000000000 cur 3612 last 0 00000020:00000080:0.0:1780997084.945460:0:85143:0:(genops.c:1406:class_connect()) connect: client 5bc603cc-b633-43af-a003-872c004686c8, cookie 0x30fd811c0305a0ae 00000100:00080000:0.0:1780997084.945596:0:85143:0:(import.c:65:import_set_state_nolock()) ffff9689bcb9d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997084.945665:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+4:2393:x1867507110357376:12345-192.168.206.51@tcp:250:kworker.0 Request processed in 262us (6910us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997084.945673:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1780997084.955607:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997084.956359:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110351488 00000100:00100000:3.0:1780997084.956370:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110351488 00000100:00100000:3.0:1780997084.956444:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1207 00000100:00100000:3.0:1780997084.956456:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110351488:12345-192.168.206.51@tcp:36:mcreate.0 00010000:00080000:3.0:1780997084.956476:0:63417:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:3.0:1780997084.956492:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110351488:12345-192.168.206.51@tcp:36:mcreate.0 Request processed in 39us (895us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997084.956499:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1207 00010000:00080000:3.0:1780997084.956517:0:85171:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:3.0:1780997085.415467:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1780997085.415474:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9689bcd7b000 from 112 10000000:01000000:3.0:1780997085.415480:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1780997085.415533:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.415545:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.415555:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997085.415583:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126873984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.415673:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997085.415718:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688810e4900 going to sleep for 11 seconds 00000100:00100000:2.0:1780997085.415873:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126873984 00000100:00100000:2.0:1780997085.415882:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126873984 00000100:00100000:2.0:1780997085.415954:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1780997085.415963:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:6348:x1867507126873984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997085.415978:0:85145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997085.416003:0:85145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc842400/0x30fd811c0305a0bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a0b5 expref: -99 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.416027:0:85145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc842400/0x30fd811c0305a0bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a0b5 expref: 10 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.416038:0:85145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc842400/0x30fd811c0305a0bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a0b5 expref: 10 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.416048:0:85145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc842400, rc 0) 00000100:00100000:2.0:1780997085.416098:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126873984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997085.416127:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1780997085.416230:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126873984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997085.416261:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.416302:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997085.416356:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1780997085.416389:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997085.416576:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968981254540 going to sleep for 11 seconds 00000100:00100000:2.0:1780997085.416648:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126874112 00000100:00100000:2.0:1780997085.416654:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126874112 00000100:00100000:2.0:1780997085.416694:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1780997085.416702:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126874112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1780997085.416717:0:85143:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1780997085.416747:0:85143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1780997085.416751:0:85143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 112 00000100:00100000:2.0:1780997085.416829:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126874112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997085.416836:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1780997085.416971:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1780997085.417019:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780997085.417026:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.417034:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997085.417044:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780997085.417046:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968886f5e000 from 52 10000000:01000000:1.0:1780997085.417049:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780997085.417069:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6dbe00/0x30fd811c0305a0c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.417075:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff96898d6dbe00/0x30fd811c0305a0c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.417083:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff96898d6dbe00/0x30fd811c0305a0c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997085.417095:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997085.417147:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997085.417176:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968981254540 going to sleep for 11 seconds 00000100:00100000:3.0:1780997085.417262:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126874240 00000100:00100000:3.0:1780997085.417291:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126874240 00000100:00100000:3.0:1780997085.417328:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1780997085.417335:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126874240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997085.417344:0:85144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997085.417355:0:85144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb2200/0x30fd811c0305a0ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a0c3 expref: -99 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.417373:0:85144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb2200/0x30fd811c0305a0ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a0c3 expref: 11 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.417382:0:85144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb2200/0x30fd811c0305a0ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a0c3 expref: 11 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.417390:0:85144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2200, rc 0) 00000100:00100000:3.0:1780997085.417422:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126874240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997085.417428:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1780997085.417464:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997085.417474:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff96898d6dbe00/0x30fd811c0305a0c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0ca expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.417482:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff96898d6dbe00/0x30fd811c0305a0c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a0ca expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997085.417538:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.417563:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997085.417573:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688810e4540 going to sleep for 11 seconds 00000100:00100000:2.0:1780997085.417639:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126874368 00000100:00100000:2.0:1780997085.417643:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126874368 00000100:00100000:2.0:1780997085.417672:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1780997085.417678:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126874368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.417812:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126874368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997085.417819:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1780997085.417992:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.418030:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.418069:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997085.418097:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688810e4540 going to sleep for 11 seconds 00000100:00100000:2.0:1780997085.420006:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126874496 00000100:00100000:2.0:1780997085.420020:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126874496 00000100:00100000:2.0:1780997085.420066:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1780997085.420075:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126874496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.420250:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126874496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997085.420258:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1780997085.420376:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997085.421321:0:85236:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1780997085.421564:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1780997085.421593:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780997085.421604:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6dbe00/0x30fd811c0305a0c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0ca expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.421614:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff96898d6dbe00/0x30fd811c0305a0c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0ca expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997085.421625:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1780997085.421627:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff968886f5e000 from 109 10000000:01000000:2.0:1780997085.421630:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1780997085.421666:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842800/0x30fd811c0305a0d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.421674:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc842800/0x30fd811c0305a0d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.421683:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc842800/0x30fd811c0305a0d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997085.421704:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997085.421905:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997085.421947:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac273c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997085.422141:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126874624 00000100:00100000:2.0:1780997085.422151:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126874624 00000100:00100000:2.0:1780997085.422199:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1780997085.422208:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126874624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997085.422220:0:85143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997085.422233:0:85143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc843c00/0x30fd811c0305a0d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a0d1 expref: -99 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.422258:0:85143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc843c00/0x30fd811c0305a0d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a0d1 expref: 12 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.422348:0:85143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc843c00/0x30fd811c0305a0d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a0d1 expref: 12 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.422357:0:85143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc843c00, rc 0) 00000100:00100000:2.0:1780997085.422450:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126874624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997085.422457:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1780997085.425862:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997085.425896:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc842800/0x30fd811c0305a0d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0d8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.425929:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc842800/0x30fd811c0305a0d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a0d8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997085.426013:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1780997085.426096:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997085.426143:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968981254240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997085.426223:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126874752 00000100:00100000:2.0:1780997085.426230:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126874752 00000100:00100000:2.0:1780997085.426315:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1780997085.426324:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126874752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1780997085.426345:0:85145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1780997085.426363:0:85145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1780997085.426367:0:85145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1780997085.426371:0:85145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1780997085.426374:0:85145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1780997085.426377:0:85145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:2.0:1780997085.426472:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126874752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997085.426481:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1780997085.428547:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1780997085.428643:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780997085.428654:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842800/0x30fd811c0305a0d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0d8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.428664:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc842800/0x30fd811c0305a0d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0d8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997085.428674:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1780997085.428676:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1780997085.428679:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1780997085.428709:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c0305a0df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.428718:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c0305a0df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.428728:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c0305a0df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997085.428762:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997085.428824:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997085.428863:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968981254240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997085.428974:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126874880 00000100:00100000:2.0:1780997085.428981:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126874880 00000100:00100000:2.0:1780997085.429026:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1780997085.429034:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126874880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997085.429046:0:85143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997085.429059:0:85143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc843400/0x30fd811c0305a0e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a0df expref: -99 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.429093:0:85143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc843400/0x30fd811c0305a0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a0df expref: 13 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.429113:0:85143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc843400/0x30fd811c0305a0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a0df expref: 13 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.429122:0:85143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc843400, rc 0) 00000100:00100000:2.0:1780997085.429169:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126874880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997085.429175:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1780997085.429371:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126874880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997085.429383:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c0305a0df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0e6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.429391:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c0305a0df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a0e6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997085.429460:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997085.429484:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997085.429499:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968981254240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997085.430080:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126875008 00000100:00100000:2.0:1780997085.430086:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126875008 00000100:00100000:2.0:1780997085.430125:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1780997085.430133:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126875008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.430358:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126875008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997085.430365:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1780997085.432150:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997085.432214:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997085.432326:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997085.432363:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968981254240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997085.432467:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126875136 00000100:00100000:2.0:1780997085.432475:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126875136 00000100:00100000:2.0:1780997085.432527:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1780997085.432535:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968885cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126875136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.440540:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968885cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126875136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7993us (8201us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997085.440558:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1780997085.440757:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997085.441680:0:85238:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1780997085.442558:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1780997085.442593:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1780997085.442605:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c0305a0df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0e6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.442617:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c0305a0df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0e6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997085.442627:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1780997085.442636:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff968886f5e000 from 1 10000000:01000000:1.0:1780997085.442640:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1780997085.442678:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6da000/0x30fd811c0305a0ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.442685:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff96898d6da000/0x30fd811c0305a0ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.442695:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff96898d6da000/0x30fd811c0305a0ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997085.442717:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997085.442791:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997085.442829:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968981254240 going to sleep for 11 seconds 00000100:00100000:3.0:1780997085.444627:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126875264 00000100:00100000:3.0:1780997085.444641:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126875264 00000100:00100000:3.0:1780997085.444703:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1780997085.444712:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968885cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126875264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997085.444739:0:85145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997085.444755:0:85145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305a0f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a0ed expref: -99 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.444783:0:85145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305a0f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a0ed expref: 14 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.444794:0:85145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305a0f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a0ed expref: 14 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.444803:0:85145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3a00, rc 0) 00000100:00100000:3.0:1780997085.444883:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968885cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507126875264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997085.444890:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1780997085.445145:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997085.445176:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff96898d6da000/0x30fd811c0305a0ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0f4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.445187:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff96898d6da000/0x30fd811c0305a0ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a0f4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997085.445214:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1780997085.445220:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6da000/0x30fd811c0305a0ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0f4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.445227:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff96898d6da000/0x30fd811c0305a0ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0f4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997085.445235:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1780997085.445238:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff968886f5e000 from 7 10000000:01000000:2.0:1780997085.445240:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1780997085.445264:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305a0fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.445299:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305a0fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.445307:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305a0fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997085.445328:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.445363:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997085.445399:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886bae300 going to sleep for 11 seconds 00000100:00100000:0.0:1780997085.446634:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126875392 00000100:00100000:0.0:1780997085.446657:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126875392 00000100:00100000:0.0:1780997085.446706:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1780997085.446715:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968885cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507126875392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997085.446811:0:85149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997085.446827:0:85149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888954e00/0x30fd811c0305a102 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a0fb expref: -99 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.446850:0:85149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888954e00/0x30fd811c0305a102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a0fb expref: 15 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.446861:0:85149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888954e00/0x30fd811c0305a102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a0fb expref: 15 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.446869:0:85149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954e00, rc 0) 00000100:00100000:0.0:1780997085.446929:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968885cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126875392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997085.446936:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1780997085.447018:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997085.447040:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305a0fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a102 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.447049:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305a0fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a102 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997085.447134:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.447169:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997085.447208:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886bae300 going to sleep for 11 seconds 00000100:00100000:0.0:1780997085.447247:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126875520 00000100:00100000:0.0:1780997085.447252:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126875520 00000100:00100000:0.0:1780997085.447301:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1780997085.447308:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126875520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.447422:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126875520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997085.447429:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1780997085.447530:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.447558:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.447599:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997085.447617:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886bae300 going to sleep for 11 seconds 00000100:00100000:0.0:1780997085.447699:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126875648 00000100:00100000:0.0:1780997085.447704:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126875648 00000100:00100000:0.0:1780997085.447773:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1780997085.447780:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888928a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126875648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.447863:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888928a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126875648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997085.447869:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1780997085.449862:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780997085.451709:0:85239:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1780997085.452209:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1780997085.452238:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1780997085.452251:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305a0fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a102 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.452262:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305a0fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a102 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997085.452389:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780997085.452392:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689bfa99000 from 52 10000000:01000000:2.0:1780997085.452396:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780997085.452436:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843800/0x30fd811c0305a109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.452641:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc843800/0x30fd811c0305a109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.452652:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc843800/0x30fd811c0305a109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997085.452678:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.452826:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997085.452871:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886bae540 going to sleep for 11 seconds 00000100:00100000:0.0:1780997085.452916:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126875776 00000100:00100000:0.0:1780997085.452922:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126875776 00000100:00100000:0.0:1780997085.452997:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1780997085.453006:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126875776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997085.453021:0:85143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997085.453034:0:85143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888954000/0x30fd811c0305a110 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a109 expref: -99 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.453057:0:85143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888954000/0x30fd811c0305a110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a109 expref: 16 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.453067:0:85143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888954000/0x30fd811c0305a110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a109 expref: 16 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.453075:0:85143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954000, rc 0) 00000100:00100000:0.0:1780997085.453126:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126875776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997085.453142:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1780997085.453212:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997085.453226:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc843800/0x30fd811c0305a109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a110 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.453234:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc843800/0x30fd811c0305a109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a110 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997085.453308:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.453334:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997085.453358:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886bae540 going to sleep for 11 seconds 00000100:00100000:1.0:1780997085.453574:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126875904 00000100:00100000:1.0:1780997085.453579:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126875904 00000100:00100000:1.0:1780997085.453606:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1780997085.453613:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888928a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126875904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997085.453728:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888928a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126875904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997085.453736:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1780997085.453876:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126875904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.453903:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.453943:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997085.453964:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886bae540 going to sleep for 11 seconds 00000100:00100000:3.0:1780997085.455238:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126876032 00000100:00100000:3.0:1780997085.455252:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126876032 00000100:00100000:3.0:1780997085.455315:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1780997085.455326:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bca6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126876032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.455690:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bca6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126876032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 366us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997085.455829:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780997085.461391:0:85241:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1780997085.461774:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1780997085.461801:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780997085.461812:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843800/0x30fd811c0305a109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a110 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.461824:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc843800/0x30fd811c0305a109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a110 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997085.461834:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1780997085.461837:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1780997085.461840:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1780997085.461875:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305a117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.461883:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305a117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.461894:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305a117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997085.461919:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.461986:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997085.462035:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5e600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997085.462145:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126876160 00000100:00100000:1.0:1780997085.462153:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126876160 00000100:00100000:1.0:1780997085.462196:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1780997085.462204:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bca6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126876160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997085.462218:0:85143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997085.462230:0:85143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96898d6dba00/0x30fd811c0305a11e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a117 expref: -99 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.462263:0:85143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96898d6dba00/0x30fd811c0305a11e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a117 expref: 18 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.462293:0:85143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96898d6dba00/0x30fd811c0305a11e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a117 expref: 18 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.462302:0:85143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96898d6dba00, rc 0) 00000100:00100000:1.0:1780997085.462460:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bca6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126876160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 256us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997085.462467:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1780997085.462698:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997085.462712:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305a117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a11e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.462726:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305a117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a11e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997085.462788:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.462817:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997085.462872:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5e600 going to sleep for 11 seconds 00000100:00100000:3.0:1780997085.462890:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1780997085.462905:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126876288 00000100:00100000:1.0:1780997085.462910:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126876288 00000100:00100000:3.0:1780997085.462937:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1780997085.462947:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bca6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126876288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.463114:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bca6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126876288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997085.463121:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1780997085.463569:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.463603:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.463651:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997085.463698:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5e600 going to sleep for 11 seconds 00000100:00100000:3.0:1780997085.464683:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126876416 00000100:00100000:3.0:1780997085.464692:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126876416 00000100:00100000:3.0:1780997085.464740:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1780997085.464749:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bca6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126876416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.466713:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bca6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126876416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1956us (3053us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997085.466725:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1780997085.466871:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780997085.470879:0:85242:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1780997085.474412:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1780997085.474983:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1780997085.474996:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305a117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a11e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.475010:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305a117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a11e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997085.478665:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1780997085.478673:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9689bfa99000 from 7 10000000:01000000:3.0:1780997085.478678:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1780997085.478722:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305a125 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.478753:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305a125 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.478765:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305a125 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997085.478794:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.478861:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997085.478920:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688883183c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997085.479258:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126876544 00000100:00100000:0.0:1780997085.479266:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126876544 00000100:00100000:0.0:1780997085.479337:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1780997085.479346:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bca6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126876544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997085.479360:0:85149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997085.479373:0:85149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888955000/0x30fd811c0305a12c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a125 expref: -99 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.479396:0:85149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888955000/0x30fd811c0305a12c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a125 expref: 18 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.479407:0:85149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888955000/0x30fd811c0305a12c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a125 expref: 18 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.479416:0:85149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955000, rc 0) 00000100:00100000:0.0:1780997085.479471:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bca6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126876544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997085.479486:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1780997085.479784:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997085.479799:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305a125 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a12c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.479807:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305a125 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a12c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997085.479870:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.479897:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997085.479931:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688883183c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997085.480030:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126876672 00000100:00100000:1.0:1780997085.480035:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126876672 00000100:00100000:1.0:1780997085.480066:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1780997085.480073:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bca6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126876672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997085.480184:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bca6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126876672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997085.480191:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1780997085.480258:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.480314:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.480350:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997085.480360:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688883183c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997085.480944:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126876800 00000100:00100000:0.0:1780997085.480950:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126876800 00000100:00100000:0.0:1780997085.480984:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1780997085.480992:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126876800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.481077:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126876800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997085.481084:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1780997085.481193:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780997085.482690:0:85243:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1780997085.483080:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1780997085.483123:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1780997085.483136:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305a125 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a12c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.483148:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305a125 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a12c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997085.483157:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1780997085.483160:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968990f90000 from 52 10000000:01000000:3.0:1780997085.483163:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780997085.483198:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2600/0x30fd811c0305a133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.483206:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2600/0x30fd811c0305a133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.483216:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2600/0x30fd811c0305a133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997085.483238:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.483425:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997085.483575:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688883183c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997085.483620:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126876928 00000100:00100000:1.0:1780997085.483627:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126876928 00000100:00100000:1.0:1780997085.483707:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1780997085.483715:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126876928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997085.483739:0:85143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997085.483751:0:85143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96898d6daa00/0x30fd811c0305a13a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a133 expref: -99 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.483787:0:85143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96898d6daa00/0x30fd811c0305a13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a133 expref: 19 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.483797:0:85143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96898d6daa00/0x30fd811c0305a13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a133 expref: 19 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.483806:0:85143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96898d6daa00, rc 0) 00000100:00100000:1.0:1780997085.483854:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126876928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997085.483860:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1780997085.483936:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126876928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997085.483949:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2600/0x30fd811c0305a133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a13a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.483958:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2600/0x30fd811c0305a133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a13a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997085.484017:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.484044:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997085.484238:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1780997085.484375:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126877056 00000100:00100000:3.0:1780997085.484379:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126877056 00000100:00100000:3.0:1780997085.484416:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1780997085.484423:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126877056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.484550:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126877056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997085.484556:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1780997085.484605:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.484635:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.484673:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997085.484692:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126877184 00000100:00100000:3.0:1780997085.484695:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126877184 00000100:00100000:3.0:1780997085.484711:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1780997085.484717:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126877184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.484793:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126877184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997085.484799:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1780997085.484831:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997085.484842:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997085.485486:0:85244:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1780997085.485549:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1780997085.485580:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780997085.485590:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2600/0x30fd811c0305a133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a13a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.485601:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2600/0x30fd811c0305a133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a13a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997085.485609:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1780997085.485612:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1780997085.485614:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1780997085.488458:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6da600/0x30fd811c0305a141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.488478:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff96898d6da600/0x30fd811c0305a141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997085.488489:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff96898d6da600/0x30fd811c0305a141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997085.488533:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997085.488613:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997085.488673:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898d6b5240 going to sleep for 11 seconds 00000100:00100000:3.0:1780997085.488695:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126877312 00000100:00100000:3.0:1780997085.488702:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126877312 00000100:00100000:3.0:1780997085.488832:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1780997085.488842:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126877312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997085.488855:0:85145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997085.488867:0:85145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a141 expref: -99 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.488889:0:85145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a141 expref: 20 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.488901:0:85145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a141 expref: 20 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.488920:0:85145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2e00, rc 0) 00000100:00100000:3.0:1780997085.488972:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126877312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997085.488979:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1780997085.489061:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997085.489074:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff96898d6da600/0x30fd811c0305a141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a148 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.489083:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff96898d6da600/0x30fd811c0305a141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a148 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997085.489155:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.489234:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997085.489256:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997085.489340:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126877440 00000100:00100000:3.0:1780997085.489345:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126877440 00000100:00100000:3.0:1780997085.489374:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1780997085.489381:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126877440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997085.489518:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126877440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997085.489525:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1780997085.489591:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.489624:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.489663:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997085.489689:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997085.489846:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126877568 00000100:00100000:2.0:1780997085.489851:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126877568 00000100:00100000:2.0:1780997085.489881:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1780997085.489888:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126877568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.492053:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126877568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2157us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997085.492066:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1780997085.493058:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997085.494199:0:85245:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1780997085.494468:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1780997085.494493:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1780997085.494505:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6da600/0x30fd811c0305a141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a148 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.494517:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff96898d6da600/0x30fd811c0305a141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a148 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997085.494526:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1780997085.494529:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff968990f90000 from 7 10000000:01000000:0.0:1780997085.494532:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780997085.494570:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954400/0x30fd811c0305a14f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.494579:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968888954400/0x30fd811c0305a14f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.494589:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968888954400/0x30fd811c0305a14f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997085.494611:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.494679:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997085.494722:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1780997085.494828:0:85144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126877696 00000100:00100000:3.0:1780997085.494835:0:85144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126877696 00000100:00100000:3.0:1780997085.494887:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1780997085.494896:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126877696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997085.494908:0:85144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997085.494920:0:85144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb2c00/0x30fd811c0305a156 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a14f expref: -99 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.494942:0:85144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb2c00/0x30fd811c0305a156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a14f expref: 21 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.494952:0:85144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb2c00/0x30fd811c0305a156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a14f expref: 21 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997085.494960:0:85144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2c00, rc 0) 00000100:00100000:3.0:1780997085.495068:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126877696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997085.495075:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1780997085.495403:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997085.495417:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968888954400/0x30fd811c0305a14f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a156 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.495426:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968888954400/0x30fd811c0305a14f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a156 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997085.495594:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.495625:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997085.495688:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688874ce180 going to sleep for 11 seconds 00000100:00100000:1.0:1780997085.495796:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126877824 00000100:00100000:1.0:1780997085.495802:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126877824 00000100:00100000:1.0:1780997085.495868:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1780997085.495877:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126877824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997085.496055:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126877824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997085.496062:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1780997085.496122:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.496152:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.496193:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997085.496306:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1780997085.496844:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126877952 00000100:00100000:2.0:1780997085.496851:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126877952 00000100:00100000:2.0:1780997085.496890:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1780997085.496898:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968989abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126877952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.496992:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968989abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126877952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997085.496999:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1780997085.497100:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126877952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997085.498147:0:85246:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1780997085.498378:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1780997085.498403:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780997085.498412:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954400/0x30fd811c0305a14f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a156 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.498423:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968888954400/0x30fd811c0305a14f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a156 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997085.498432:0:6348:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1780997085.498435:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9689b6283380 from 1 10000000:01000000:2.0:1780997085.498446:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1780997085.498493:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305a15d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.498501:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305a15d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.498508:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305a15d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997085.498528:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126878080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.498575:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997085.498615:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688874ce780 going to sleep for 11 seconds 00000100:00100000:0.0:1780997085.500139:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126878080 00000100:00100000:0.0:1780997085.500152:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126878080 00000100:00100000:0.0:1780997085.500207:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1780997085.500217:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968984e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126878080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997085.500233:0:85149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997085.500253:0:85149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888954200/0x30fd811c0305a164 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a15d expref: -99 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.500304:0:85149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888954200/0x30fd811c0305a164 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a15d expref: 22 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.500316:0:85149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888954200/0x30fd811c0305a164 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a15d expref: 22 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.500324:0:85149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954200, rc 0) 00000100:00100000:0.0:1780997085.500387:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968984e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126878080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997085.500393:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1780997085.501434:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126878080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997085.501455:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305a15d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a164 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.501467:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305a15d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a164 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997085.501488:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1780997085.501494:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305a15d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a164 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.501501:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305a15d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a164 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997085.501508:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1780997085.501511:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9689b6283380 from 1 10000000:01000000:2.0:1780997085.501513:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1780997085.501540:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842e00/0x30fd811c0305a16b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.501556:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc842e00/0x30fd811c0305a16b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.501564:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc842e00/0x30fd811c0305a16b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997085.501584:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126878208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.501629:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997085.501660:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688874ce780 going to sleep for 11 seconds 00000100:00100000:0.0:1780997085.501741:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126878208 00000100:00100000:0.0:1780997085.501747:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126878208 00000100:00100000:0.0:1780997085.501786:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1780997085.501793:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126878208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997085.501803:0:85149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997085.501813:0:85149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888954600/0x30fd811c0305a172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a16b expref: -99 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.501830:0:85149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888954600/0x30fd811c0305a172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a16b expref: 23 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.501838:0:85149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888954600/0x30fd811c0305a172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a16b expref: 23 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.501845:0:85149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954600, rc 0) 00000100:00100000:0.0:1780997085.501876:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126878208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997085.501882:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1780997085.502019:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126878208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997085.502030:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc842e00/0x30fd811c0305a16b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a172 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.502037:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc842e00/0x30fd811c0305a16b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a172 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997085.502090:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc86ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126878336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997085.502126:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997085.502147:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688874ce780 going to sleep for 11 seconds 00000100:00100000:0.0:1780997085.502243:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126878336 00000100:00100000:0.0:1780997085.502248:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126878336 00000100:00100000:0.0:1780997085.502284:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1780997085.502292:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126878336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997085.502366:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126878336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (239us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780997085.502372:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1780997085.503600:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc86ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126878336:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1780997085.503638:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1780997085.503646:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842e00/0x30fd811c0305a16b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a172 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997085.503654:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc842e00/0x30fd811c0305a16b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a172 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997085.927289:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997086.408093:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997086.408194:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110357760 00000100:00100000:0.0:1780997086.408205:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110357760 00000100:00100000:0.0:1780997086.408265:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:0.0:1780997086.408307:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+4:41993:x1867507110357760:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997086.408330:0:85149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997086.408348:0:85149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888955800/0x30fd811c0305a179 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b68 expref: -99 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997086.408377:0:85149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888955800/0x30fd811c0305a179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b68 expref: 5 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997086.408390:0:85149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888955800/0x30fd811c0305a179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b68 expref: 5 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997086.408400:0:85149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955800, rc 0) 00000100:00100000:0.0:1780997086.408454:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110357760:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 149us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997086.408461:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:3.0:1780997086.411171:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997086.412081:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110357888 00000100:00100000:0.0:1780997086.412094:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110357888 00000100:00100000:0.0:1780997086.412168:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:0.0:1780997086.412180:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110357888:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1780997086.412207:0:85143:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1780997086.412230:0:85143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1780997086.412234:0:85143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1780997086.412238:0:85143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1780997086.412241:0:85143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1780997086.412243:0:85143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:2.0:1780997086.416795:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110357888:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 Request processed in 4605us (5617us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997086.416812:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:3.0:1780997086.437183:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997086.437361:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110358016 00000100:00100000:0.0:1780997086.437373:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110358016 00000100:00100000:0.0:1780997086.437470:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:0.0:1780997086.437489:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110358016:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997086.437508:0:85149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997086.437528:0:85149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888955c00/0x30fd811c0305a180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b6f expref: -99 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997086.437559:0:85149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888955c00/0x30fd811c0305a180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b6f expref: 6 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997086.437589:0:85149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888955c00/0x30fd811c0305a180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b6f expref: 6 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997086.437599:0:85149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955c00, rc 0) 00000100:00100000:0.0:1780997086.437657:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+6:41993:x1867507110358016:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 170us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997086.437664:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:1.0:1780997086.442332:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997086.448158:0:85145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110358144 00000100:00100000:2.0:1780997086.448175:0:85145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110358144 00000100:00100000:2.0:1780997086.448326:0:85145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:2.0:1780997086.448337:0:85145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+6:41993:x1867507110358144:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997086.448506:0:85145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110358144:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 171us (6180us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997086.448514:0:85145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:1.0:1780997086.459713:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997086.459787:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110358272 00000100:00100000:2.0:1780997086.459798:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110358272 00000100:00100000:2.0:1780997086.459848:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:2.0:1780997086.459857:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110358272:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997086.459988:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110358272:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 131us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997086.459996:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:3.0:1780997086.464685:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997086.465568:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110358400 00000100:00100000:0.0:1780997086.465580:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110358400 00000100:00100000:0.0:1780997086.465637:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:0.0:1780997086.465647:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110358400:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997086.465663:0:85149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997086.465680:0:85149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888955200/0x30fd811c0305a187 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b76 expref: -99 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997086.465711:0:85149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888955200/0x30fd811c0305a187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b76 expref: 8 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997086.465722:0:85149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888955200/0x30fd811c0305a187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b76 expref: 8 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997086.465743:0:85149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955200, rc 0) 00000100:00100000:0.0:1780997086.465803:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110358400:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 158us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997086.465811:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:1.0:1780997086.480822:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997086.481142:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110358528 00000100:00100000:3.0:1780997086.481154:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110358528 00000100:00100000:3.0:1780997086.481209:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:3.0:1780997086.481220:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110358528:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997086.481376:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110358528:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 158us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997086.481383:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:1.0:1780997086.491632:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997086.493591:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110358656 00000100:00100000:3.0:1780997086.493607:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110358656 00000100:00100000:3.0:1780997086.493660:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:3.0:1780997086.493670:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689872c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110358656:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997086.502014:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689872c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110358656:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 8332us (10379us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997086.502032:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:3.0:1780997086.508160:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997086.508195:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110358784 00000100:00100000:3.0:1780997086.508217:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110358784 00000100:00100000:3.0:1780997086.508263:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:3.0:1780997086.508299:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689872ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110358784:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997086.508317:0:85143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997086.508343:0:85143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb3400/0x30fd811c0305a18e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b7d expref: -99 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997086.508374:0:85143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb3400/0x30fd811c0305a18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b7d expref: 9 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997086.508386:0:85143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb3400/0x30fd811c0305a18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b7d expref: 9 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997086.508509:0:85143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3400, rc 0) 00000100:00100000:3.0:1780997086.508617:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689872ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+9:41993:x1867507110358784:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 345us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997086.508624:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:1.0:1780997086.518166:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997086.518431:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110358912 00000100:00100000:3.0:1780997086.518440:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110358912 00000100:00100000:3.0:1780997086.518485:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:3.0:1780997086.518495:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689872c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:41993:x1867507110358912:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997086.518601:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689872c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:41993:x1867507110358912:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 106us (442us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780997086.518610:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00010000:00010000:0.0:1780997086.952690:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997087.980315:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1780997088.283895:0:85404:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1780997089.000240:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1780997089.199077:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1780997089.199117:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1780997089.199640:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126878464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997089.199721:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997089.199773:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126878464 00000100:00100000:0.0:1780997089.199780:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126878464 00000100:00100000:0.0:1780997089.199835:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947 00000100:00100000:0.0:1780997089.199842:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126878464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780997089.199872:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780997089.199910:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126878464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997089.199917:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00000100:00100000:0.0:1780997089.199959:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc63ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126878464:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1780997089.209735:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1780997089.212579:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126878592:0@lo:400:kworker.0 00000100:00100000:0.0:1780997089.212648:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997089.212734:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126878592 00000100:00100000:2.0:1780997089.212745:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126878592 00000100:00100000:2.0:1780997089.212802:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1780997089.212812:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689872c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126878592:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1780997089.212927:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997089.212932:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997089.212935:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997089.212939:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3611 00000100:00080000:3.0:1780997089.212943:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780997089.212947:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997089.212974:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b0bd8380 x1867507126878720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997089.212998:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b0bd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126878720:0@lo:38:kworker.0 00000100:00100000:3.0:1780997089.213042:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780997089.213101:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997089.213105:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997089.213106:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997089.213110:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3611 00000100:00080000:3.0:1780997089.213112:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780997089.213115:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997089.213129:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc960000 x1867507126878976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997089.213148:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126878976:0@lo:38:kworker.0 00000100:00100000:3.0:1780997089.213171:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997089.213199:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126878720 00000100:00100000:3.0:1780997089.213203:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126878720 00000100:00100000:3.0:1780997089.213222:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126878976 00000100:00100000:3.0:1780997089.213225:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126878976 00000100:00100000:3.0:1780997089.213239:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1780997089.213244:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126878720:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780997089.213265:0:80049:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3616 last 0 00000020:00000080:3.0:1780997089.213317:0:80049:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x30fd811c0305a195 00000004:00100000:3.0:1780997089.213331:0:80049:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780997089.213478:0:80049:0:(import.c:65:import_set_state_nolock()) ffff9689bd36a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780997089.213520:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3495:x1867507126878720:12345-0@lo:38:kworker.0 Request processed in 274us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997089.213533:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1780997089.213549:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1780997089.213553:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126878976:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780997089.213564:0:80049:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3616 last 0 00000020:00000080:3.0:1780997089.213582:0:80049:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x30fd811c0305a19c 00000004:00100000:3.0:1780997089.213588:0:80049:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780997089.213604:0:80049:0:(import.c:65:import_set_state_nolock()) ffff9689b0b69800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780997089.213631:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3495:x1867507126878976:12345-0@lo:38:kworker.0 Request processed in 76us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997089.213637:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00010000:00080000:3.0:1780997089.213670:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689bc960000 x1867507126878976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997089.213683:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000100:00080000:3.0:1780997089.214475:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9689bc960000 x1867507126878976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997114 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997089.214484:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1780997089.214488:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1780997089.214491:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1780997089.214496:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126878976:0@lo:38:kworker.0 00010000:00080000:3.0:1780997089.214517:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689b0bd8380 x1867507126878720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997089.214527:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000100:00080000:3.0:1780997089.216952:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9689b0bd8380 x1867507126878720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997114 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997089.216990:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1780997089.216996:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1780997089.217000:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1780997089.217183:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b0bd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126878720:0@lo:38:kworker.0 00000100:00080000:3.0:1780997089.217251:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997089.217255:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997089.217257:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997089.217262:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3611 00000100:00080000:3.0:1780997089.217265:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780997089.217288:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997089.217312:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bb527100 x1867507126879232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997089.217339:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126879232:0@lo:38:kworker.0 00000100:00100000:3.0:1780997089.217405:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997089.217456:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126879232 00000100:00100000:3.0:1780997089.217464:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126879232 00000100:00100000:3.0:1780997089.217496:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:3.0:1780997089.217503:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126879232:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780997089.217529:0:8242:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff968990f71800, cookie 0x30fd811c03059fff 00010000:00080000:3.0:1780997089.217534:0:8242:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411355 exp ffff968990f71800 cur 3616 last 1780997083 00000004:00100000:3.0:1780997089.217553:0:8242:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780997089.217581:0:8242:0:(import.c:65:import_set_state_nolock()) ffff9689b0b6b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780997089.217635:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126879232:12345-0@lo:38:kworker.0 Request processed in 132us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997089.217650:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00010000:00080000:3.0:1780997089.217674:0:85171:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1780997089.217679:0:85171:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 103079215111 00000020:00080000:3.0:1780997089.217685:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997089.217688:0:85171:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:3.0:1780997089.217692:0:85171:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:3.0:1780997089.217694:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997089.217703:0:85171:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110351488 t103079215111 from 192.168.206.51@tcp req@ffff9688858b1880 x1867507110351488/t0(103079215111) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:415/0 lens 528/0 e 0 to 0 dl 1780997095 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997089.217785:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:3.0:1780997089.217795:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1780997089.217798:0:3495:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1780997089.217801:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:3.0:1780997089.217804:0:3495:0:(recover.c:53:ptlrpc_replay_next()) import ffff9689ae566000 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:3.0:1780997089.217807:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00080000:3.0:1780997089.217842:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997089.217845:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997089.217847:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997089.217850:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3611 00000100:00080000:3.0:1780997089.217852:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780997089.217856:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997089.217866:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9688874f5f80 x1867507126879616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997089.217891:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1780997089.217900:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997089.217902:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ba670800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997089.217906:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9689ba670800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997089.217916:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9688874f5180 x1867507126880000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997089.218139:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689872c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126878592:12345-0@lo:400:kworker.0 Request processed in 5327us (5489us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997089.218147:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1780997089.218194:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888d7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126878848:0@lo:400:kworker.0 00000100:00100000:2.0:1780997089.218225:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997089.218246:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126879744:0@lo:400:kworker.0 00000100:00100000:2.0:1780997089.218286:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997089.218306:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1780997089.218312:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126879104:0@lo:400:kworker.0 00000100:00100000:2.0:1780997089.218333:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997089.218349:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126879872:0@lo:400:kworker.0 00000100:00100000:2.0:1780997089.218369:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997089.218439:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126878848 00000100:00100000:2.0:1780997089.218444:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126878848 00000100:00100000:2.0:1780997089.218476:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126879104 00000100:00100000:2.0:1780997089.218479:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126879104 00000100:00100000:2.0:1780997089.218496:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1780997089.218501:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126878848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997089.218536:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126878848:12345-0@lo:400:kworker.0 Request processed in 35us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997089.218542:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1780997089.218553:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1780997089.218558:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126879104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997089.218581:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126879104:12345-0@lo:400:kworker.0 Request processed in 23us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997089.218597:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1780997089.218617:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126879744 00000100:00100000:2.0:1780997089.218621:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126879744 00000100:00100000:2.0:1780997089.218645:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126879872 00000100:00100000:2.0:1780997089.218648:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126879872 00000100:00100000:2.0:1780997089.218663:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522 00000100:00100000:2.0:1780997089.218669:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126879744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997089.218697:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126879744:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997089.218703:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522 00000100:00100000:2.0:1780997089.218713:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523 00000100:00100000:2.0:1780997089.218718:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126879872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997089.218744:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126879872:12345-0@lo:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997089.218750:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523 00000100:00080000:2.0:1780997089.218764:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997089.218768:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997089.218770:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997089.218795:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126879104:0@lo:400:kworker.0 00000100:00100000:2.0:1780997089.218804:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126879872:0@lo:400:kworker.0 00000100:00100000:2.0:1780997089.218812:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888d7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126878848:0@lo:400:kworker.0 00000100:00100000:2.0:1780997089.218820:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126879744:0@lo:400:kworker.0 00000004:00080000:2.0:1780997089.219537:0:85171:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1785us 00000100:00100000:1.0:1780997089.220267:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126879232:0@lo:38:kworker.0 00000100:00100000:1.0:1780997089.220307:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126879616:0@lo:38:kworker.0 00000100:00100000:1.0:1780997089.220354:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997089.220378:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126880000:0@lo:38:kworker.0 00000100:00100000:1.0:1780997089.220401:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997089.220429:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126879616 00000100:00100000:1.0:1780997089.220435:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126879616 00000100:00100000:1.0:1780997089.220458:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126880000 00000100:00100000:1.0:1780997089.220461:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126880000 00000100:00100000:1.0:1780997089.220483:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:1.0:1780997089.220488:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126879616:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780997089.220511:0:63417:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3616 last 0 00000020:00000080:1.0:1780997089.220546:0:63417:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x30fd811c0305a1a3 00000004:00100000:1.0:1780997089.220559:0:63417:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780997089.220585:0:63417:0:(import.c:65:import_set_state_nolock()) ffff9689bcc17000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997089.220626:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3495:x1867507126879616:12345-0@lo:38:kworker.0 Request processed in 137us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997089.220633:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:1.0:1780997089.220649:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1780997089.220653:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126880000:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780997089.220665:0:63417:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3616 last 0 00000020:00000080:1.0:1780997089.220682:0:63417:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x30fd811c0305a1aa 00000004:00100000:1.0:1780997089.220688:0:63417:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780997089.220700:0:63417:0:(import.c:65:import_set_state_nolock()) ffff9689bcc11800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997089.221209:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1867507126880000:12345-0@lo:38:kworker.0 Request processed in 72us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997089.221218:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00010000:00080000:1.0:1780997089.221265:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9688874f5f80 x1867507126879616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997089.221301:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00000100:00080000:1.0:1780997089.224150:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9688874f5f80 x1867507126879616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997114 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997089.224163:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1780997089.224170:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780997089.224182:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1780997089.224190:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126879616:0@lo:38:kworker.0 00010000:00080000:1.0:1780997089.224223:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9688874f5180 x1867507126880000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997089.224239:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:1.0:1780997089.224247:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1780997089.224251:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1780997089.224253:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ba670800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1780997089.224258:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126880000:0@lo:38:kworker.0 00010000:00080000:1.0:1780997089.224606:0:85456:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1780997089.224611:0:85456:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1780997089.224616:0:85456:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00100000:0.0:1780997089.224748:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126878592:0@lo:400:kworker.0 00000100:00100000:0.0:1780997089.224771:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126879488:0@lo:400:kworker.0 00000100:00100000:0.0:1780997089.224829:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997089.224870:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780997089.224877:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126879360:0@lo:400:kworker.0 00000100:00100000:0.0:1780997089.224902:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997089.224949:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126879488 00000100:00100000:0.0:1780997089.224957:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126879488 00000100:00080000:1.0:1780997089.226562:0:85456:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1780997089.226624:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126880128:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1780997089.226675:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997089.227107:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126879360 00000100:00100000:0.0:1780997089.227114:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126879360 00000100:00100000:0.0:1780997089.227169:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:0.0:1780997089.227179:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126879488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997089.227238:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126879488:12345-0@lo:400:kworker.0 Request processed in 61us (2408us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997089.227245:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00100000:0.0:1780997089.227260:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:0.0:1780997089.227267:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd01a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126879360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997089.227315:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd01a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126879360:12345-0@lo:400:kworker.0 Request processed in 49us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997089.227320:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00080000:0.0:1780997089.227541:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780997089.227546:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997089.227561:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126880128 00000100:00100000:0.0:1780997089.227565:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126880128 00000100:00100000:0.0:1780997089.227592:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949 00000100:00100000:0.0:1780997089.227598:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126880128:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1780997089.227613:0:23042:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff9688858b0a80 x1867507126880128/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:420/0 lens 224/0 e 0 to 0 dl 1780997100 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997089.227624:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126880128:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 28us (950us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997089.227641:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00000100:00100000:0.0:1780997089.227683:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126879360:0@lo:400:kworker.0 00000100:00100000:0.0:1780997089.227696:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126879488:0@lo:400:kworker.0 00010000:00010000:2.0:1780997089.248306:0:85171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248335:0:85171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248350:0:85171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248363:0:85171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843a00/0x30fd811c0305a1b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248370:0:85171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843a00/0x30fd811c0305a1b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248377:0:85171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843a00/0x30fd811c0305a1b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248817:0:85171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248827:0:85171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248834:0:85171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248841:0:85171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997089.248846:0:85171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248854:0:85171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248866:0:85171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898a563500) 00010000:00010000:2.0:1780997089.248874:0:85171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997089.248878:0:85171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248885:0:85171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997089.248902:0:85171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003aa00178 reply state 00000000cbbf7c81 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843a00/0x30fd811c0305a1b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248914:0:85171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843a00/0x30fd811c0305a1b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.248920:0:85171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898a563600) 00010000:00010000:2.0:1780997089.248923:0:85171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997089.248925:0:85171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1780997089.249363:0:85171:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1780997089.249384:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997089.249388:0:85171:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:2.0:1780997089.249392:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997089.249394:0:85171:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00000004:1.0:1780997089.254322:0:85458:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1780997089.254558:0:85458:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1780997089.263875:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997089.264160:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110352000 00000100:00100000:2.0:1780997089.264169:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110352000 00000100:00100000:2.0:1780997089.264233:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1212 00000100:00100000:2.0:1780997089.264243:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2393:x1867507110352000:12345-192.168.206.51@tcp:36:rm.0 00010000:00080000:2.0:1780997089.264263:0:63417:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:2.0:1780997089.264306:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2393:x1867507110352000:12345-192.168.206.51@tcp:36:rm.0 Request processed in 65us (439us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780997089.264314:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1212 00000020:00080000:3.0:1780997089.264373:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997089.264378:0:85171:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:3.0:1780997089.264382:0:85171:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:3.0:1780997089.264385:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997089.264394:0:85171:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110352000 t103079215112 from 192.168.206.51@tcp req@ffff9688858b0700 x1867507110352000/t0(103079215112) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:420/0 lens 512/0 e 0 to 0 dl 1780997100 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1780997089.264482:0:85171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a1bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264499:0:85171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a1bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264514:0:85171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a1bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264525:0:85171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a1c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264534:0:85171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264539:0:85171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264671:0:85171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a1cd lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264679:0:85171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a1cd lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264686:0:85171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a1cd lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264914:0:85171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a1cd lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264922:0:85171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a1cd lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264930:0:85171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a1cd lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264936:0:85171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997089.264940:0:85171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a1cd lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264947:0:85171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a1cd lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264961:0:85171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff96898962cf00) 00010000:00010000:3.0:1780997089.264964:0:85171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1780997089.264969:0:85171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a1cd lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.264975:0:85171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a1cd lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.265007:0:85171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a1bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.276895:0:85171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a1bf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.276907:0:85171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a1bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.276914:0:85171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997089.276918:0:85171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a1bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.276928:0:85171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a1bf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.276944:0:85171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898962c600) 00010000:00010000:3.0:1780997089.276947:0:85171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997089.276952:0:85171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a1bf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.276959:0:85171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a1bf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997089.276981:0:85171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b51d3af reply state 00000000b45f20d7 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.276995:0:85171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a1c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.277002:0:85171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898a563600) 00010000:00010000:3.0:1780997089.277011:0:85171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997089.277089:0:85171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1780997089.277458:0:85171:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1780997089.277477:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997089.277480:0:85171:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:2.0:1780997089.277484:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997089.277486:0:85171:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000100:00100000:2.0:1780997089.283701:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997089.284979:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110353408 00000100:00100000:3.0:1780997089.284995:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110353408 00000100:00100000:3.0:1780997089.285131:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1213 00000100:00100000:3.0:1780997089.285142:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2393:x1867507110353408:12345-192.168.206.51@tcp:36:dd.0 00010000:00080000:3.0:1780997089.285162:0:65272:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215114, replaying 00000100:00100000:3.0:1780997089.285182:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2393:x1867507110353408:12345-192.168.206.51@tcp:36:dd.0 Request processed in 42us (1497us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997089.285189:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1213 00000020:00080000:2.0:1780997089.285237:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997089.285242:0:85171:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215114, next_transno: 103079215113 00010000:00080000:2.0:1780997089.285246:0:85171:0:(ldlm_lib.c:2245:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 103079215113, ql: 1, comp: 1, conn: 2, next: 103079215114, next_update 0 last_committed: 103079215110) 00000020:00080000:2.0:1780997089.285251:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997089.285260:0:85171:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110353408 t103079215114 from 192.168.206.51@tcp req@ffff9689bc86f480 x1867507110353408/t0(103079215114) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:420/0 lens 488/0 e 0 to 0 dl 1780997100 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1780997089.285511:0:85171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1d4 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.285531:0:85171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1d4 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.285544:0:85171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1d4 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997089.285687:0:85171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000069f6bf75 reply state 00000000dade28d8 transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1d4 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.285699:0:85171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1d4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.285706:0:85171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff96898a563500) 00010000:00010000:2.0:1780997089.285724:0:85171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997089.285729:0:85171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1780997089.285833:0:85171:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1780997089.285848:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997089.285850:0:85171:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000020:00080000:2.0:1780997089.285853:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997089.285855:0:85171:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000100:00100000:3.0:1780997089.290491:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997089.290625:0:63431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110353664 00000100:00100000:2.0:1780997089.290635:0:63431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110353664 00000100:00100000:2.0:1780997089.290701:0:63431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:2.0:1780997089.290711:0:63431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2393:x1867507110353664:12345-192.168.206.51@tcp:10:dd.0 00010000:00080000:2.0:1780997089.290728:0:63431:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 103079215115, current: 103079215115, replaying 00000100:00100000:2.0:1780997089.290751:0:63431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2393:x1867507110353664:12345-192.168.206.51@tcp:10:dd.0 Request processed in 42us (271us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780997089.290758:0:63431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000020:00080000:3.0:1780997089.290776:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997089.290781:0:85171:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215115, next_transno: 103079215115 00010000:00080000:3.0:1780997089.290785:0:85171:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215115) 00000020:00080000:3.0:1780997089.290788:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997089.290797:0:85171:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110353664 t103079215115 from 192.168.206.51@tcp req@ffff9688874f4700 x1867507110353664/t0(103079215115) o10->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:420/0 lens 440/0 e 0 to 0 dl 1780997100 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780997089.291665:0:85171:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1780997089.291682:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997089.291686:0:85171:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000020:00080000:2.0:1780997089.291690:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997089.291692:0:85171:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000100:00100000:2.0:1780997089.307619:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997089.307740:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110359040 00000100:00100000:0.0:1780997089.307751:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110359040 00000100:00100000:0.0:1780997089.307800:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1214 00000100:00100000:0.0:1780997089.307811:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:2393:x1867507110359040:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1780997089.307848:0:63419:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689bc86e300 x1867507110359040/t0(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:420/0 lens 328/0 e 0 to 0 dl 1780997100 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997089.307867:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:2393:x1867507110359040:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 59us (259us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997089.307872:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1214 00000020:00080000:2.0:1780997089.310447:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997089.310457:0:85171:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215116 00010000:00080000:2.0:1780997089.310461:0:85171:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1780997089.310464:0:85171:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997089.310471:0:85171:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780997089.310474:0:85171:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780997089.310488:0:85171:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff9689bc86e300 x1867507110359040/t0(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:420/0 lens 328/0 e 0 to 0 dl 1780997100 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1780997089.310525:0:85171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997089.310558:0:85171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843000/0x30fd811c0305a1db lrc: 2/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b5a expref: -99 pid: 85171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.310587:0:85171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843000/0x30fd811c0305a1db lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 14 pid: 85171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.310603:0:85171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843000/0x30fd811c0305a1db lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 14 pid: 85171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.310613:0:85171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc843000, rc 0) 00010000:00080000:2.0:1780997089.310758:0:85171:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1780997089.310771:0:85171:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1780997089.313578:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997089.313682:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110359168 00000100:00100000:2.0:1780997089.313694:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110359168 00000100:00100000:2.0:1780997089.313755:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1195 00000100:00100000:2.0:1780997089.313766:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:2393:x1867507110359168:12345-192.168.206.51@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1780997089.313788:0:80049:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff9688874f5180 x1867507110359168/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:420/0 lens 224/0 e 0 to 0 dl 1780997100 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997089.313815:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:2393:x1867507110359168:12345-192.168.206.51@tcp:400:ptlrpcd_rcv.0 Request processed in 51us (247us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780997089.313822:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1195 00010000:00080000:3.0:1780997089.313892:0:85171:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1780997089.314013:0:85171:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:3.0:1780997089.315495:0:85138:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000001:00100000:3.0:1780997089.315503:0:85138:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1780997089.315522:0:85138:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215115 is committed 00010000:00010000:1.0:1780997089.315597:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843a00/0x30fd811c0305a1b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315611:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843a00/0x30fd811c0305a1b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315619:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843a00/0x30fd811c0305a1b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315643:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc843a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997089.315648:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843a00/0x30fd811c0305a1b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315656:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843a00/0x30fd811c0305a1b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315677:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843a00/0x30fd811c0305a1b8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315684:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843a00/0x30fd811c0305a1b8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315700:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a1c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315706:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a1c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315712:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a1c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315717:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997089.315719:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a1c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315725:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a1c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315733:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a1c6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315745:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a1c6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315766:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1d4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315772:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1d4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315779:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1d4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315784:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997089.315787:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1d4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315792:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1d4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315801:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1d4 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.315805:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842a00/0x30fd811c0305a1d4 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780997089.315871:0:85171:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1780997089.315909:0:85171:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1780997089.315920:0:85171:0:(ldlm_lib.c:2924:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9688858b0a80 x1867507126880128/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:420/0 lens 224/0 e 0 to 0 dl 1780997100 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1780997089.316096:0:85171:0:(ldlm_lib.c:2924:target_recovery_thread()) @@@ processing final ping from 192.168.206.51@tcp: req@ffff9688874f5180 x1867507110359168/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:420/0 lens 224/0 e 0 to 0 dl 1780997100 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780997089.316158:0:85171:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1780997089.324241:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1780997089.324261:0:3495:0:(client.c:3253:ptlrpc_resend_req()) @@@ going to resend req@ffff9688858b2300 x1867507126880128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997105 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997089.324288:0:3495:0:(client.c:3262:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9688858b2300 x1867507126880128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997105 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997089.324317:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780997089.324327:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1780997089.324332:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126880128:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1780997089.324491:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126880256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997089.324547:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997089.324598:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126880256 00000100:00100000:1.0:1780997089.324605:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126880256 00000100:00100000:1.0:1780997089.324651:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950 00000100:00100000:1.0:1780997089.324660:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126880256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780997089.324696:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1445265408 avail 1299025920 00000100:00100000:1.0:1780997089.324739:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126880256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997089.324747:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00000100:00100000:1.0:1780997089.324785:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126880256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997089.333651:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997089.333696:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997089.333729:0:63432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110354816 00000100:00100000:1.0:1780997089.333738:0:63432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110354816 00002000:00100000:1.0:1780997089.333786:0:63432:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9688858b2d80 x1867507110354816/t0(0) o4->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:420/0 lens 496/0 e 0 to 0 dl 1780997100 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997089.333797:0:63432:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9688858b2d80 with x1867507110354816 00002000:00010000:1.0:1780997089.333809:0:63432:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843000/0x30fd811c0305a1db lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 7 pid: 85171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997089.333844:0:63432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1780997089.333864:0:63432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:0:x1867507110354816:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1780997089.334483:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110354944 00000100:00100000:3.0:1780997089.334490:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110354944 00000100:00100000:3.0:1780997089.334537:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1215 00000100:00100000:3.0:1780997089.334546:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:0:x1867507110354944:12345-192.168.206.51@tcp:16:kworker.0 00000100:00100000:1.0:1780997089.335105:0:63432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:0:x1867507110354816:12345-192.168.206.51@tcp:4:dd.0 Request processed in 1241us (1406us total) trans 107374182401 rc 0/0 00000100:00100000:1.0:1780997089.335114:0:63432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00002000:00100000:1.0:1780997089.335123:0:63432:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9688858b2d80 x1867507110354816/t107374182401(0) o4->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:420/0 lens 496/448 e 0 to 0 dl 1780997100 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997089.335132:0:63432:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9688858b2d80 with x1867507110354816 00002000:00010000:1.0:1780997089.335139:0:63432:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843000/0x30fd811c0305a1db lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 10 pid: 85171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780997089.336172:0:85138:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182401 is committed 00000100:00100000:3.0:1780997089.336332:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:0:x1867507110354944:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 1784us (2691us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997089.336340:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1215 00000004:00000080:2.0:1780997089.348210:0:85171:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8c8c7593e10 00100000:10000000:2.0:1780997089.348224:0:85171:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1780997089.349129:0:85159:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x90:0x0] 00000100:00100000:3.0:1780997089.349188:0:85159:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85159:1867507126880384:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1780997089.349301:0:85159:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997089.349334:0:85159:0:(client.c:2692:ptlrpc_set_wait()) set ffff968887499cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997089.349359:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126880384 00000100:00100000:3.0:1780997089.349367:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126880384 00000100:00100000:3.0:1780997089.349416:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5929 00000100:00100000:3.0:1780997089.349425:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:85159:x1867507126880384:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1780997089.349453:0:25172:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -625 00002000:02000040:3.0:1780997089.349458:0:25172:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:145 to 0x2c0000401:769) 00000004:00080000:1.0:1780997089.350125:0:85157:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x282:0x0] 00000100:00100000:1.0:1780997089.350157:0:85157:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85157:1867507126880512:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1780997089.350202:0:85157:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997089.350225:0:85157:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997089.350244:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126880512 00000100:00100000:1.0:1780997089.350249:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126880512 00000100:00100000:1.0:1780997089.350297:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5930 00000100:00100000:1.0:1780997089.350304:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:85157:x1867507126880512:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1780997089.350321:0:25180:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -127 00002000:02000040:1.0:1780997089.350325:0:25180:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:643 to 0x280000400:769) 00002000:00010000:3.0:1780997089.356211:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997089.356227:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305a1e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356244:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997089.356246:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997089.356250:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305a1e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356266:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305a1e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356309:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305a1e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356330:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305a1e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356353:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997089.356370:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997089.356376:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305a1e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356384:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.356389:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305a1e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356399:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305a1e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356415:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305a1e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356424:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003c0264c/0x30fd811c0305a1e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356444:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.356446:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.356448:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997089.356557:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997089.356568:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003148428e/0x30fd811c0305a1e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356576:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997089.356577:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997089.356580:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003148428e/0x30fd811c0305a1e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356589:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003148428e/0x30fd811c0305a1e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356597:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003148428e/0x30fd811c0305a1e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356605:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003148428e/0x30fd811c0305a1e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356621:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997089.356628:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997089.356633:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003148428e/0x30fd811c0305a1e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356640:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.356644:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003148428e/0x30fd811c0305a1e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356652:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003148428e/0x30fd811c0305a1e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356673:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003148428e/0x30fd811c0305a1e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356681:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003148428e/0x30fd811c0305a1e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356693:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.356695:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.356696:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997089.356736:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997089.356742:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021736cf5/0x30fd811c0305a1f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356749:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997089.356751:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997089.356754:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021736cf5/0x30fd811c0305a1f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356763:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021736cf5/0x30fd811c0305a1f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356771:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021736cf5/0x30fd811c0305a1f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356778:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021736cf5/0x30fd811c0305a1f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356805:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997089.356812:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997089.356817:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021736cf5/0x30fd811c0305a1f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356824:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.356828:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021736cf5/0x30fd811c0305a1f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356836:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021736cf5/0x30fd811c0305a1f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356848:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021736cf5/0x30fd811c0305a1f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356856:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021736cf5/0x30fd811c0305a1f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356870:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.356872:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.356874:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997089.356913:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997089.356919:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edfa17d0/0x30fd811c0305a1f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356927:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997089.356933:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997089.356937:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edfa17d0/0x30fd811c0305a1f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356946:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edfa17d0/0x30fd811c0305a1f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356955:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edfa17d0/0x30fd811c0305a1f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356963:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edfa17d0/0x30fd811c0305a1f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356975:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997089.356982:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997089.356986:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edfa17d0/0x30fd811c0305a1f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.356993:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.356996:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edfa17d0/0x30fd811c0305a1f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.357004:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edfa17d0/0x30fd811c0305a1f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.357014:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edfa17d0/0x30fd811c0305a1f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.357031:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edfa17d0/0x30fd811c0305a1f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.357044:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.357046:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.357048:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997089.363136:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.363155:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bae26110/0x30fd811c0305a1fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.363176:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.363178:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.363184:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bae26110/0x30fd811c0305a1fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.363199:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bae26110/0x30fd811c0305a1fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.363211:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bae26110/0x30fd811c0305a1fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.363219:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bae26110/0x30fd811c0305a1fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.363321:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780997089.363439:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.363445:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a85a58/0x30fd811c0305a205 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.363468:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.363470:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.363474:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a85a58/0x30fd811c0305a205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.363484:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019a85a58/0x30fd811c0305a205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.363493:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a85a58/0x30fd811c0305a205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.363501:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019a85a58/0x30fd811c0305a205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.363540:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997089.363548:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bae26110/0x30fd811c0305a1fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.363558:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.363563:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bae26110/0x30fd811c0305a1fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.363572:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bae26110/0x30fd811c0305a1fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.363589:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bae26110/0x30fd811c0305a1fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.363597:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bae26110/0x30fd811c0305a1fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.363632:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997089.363635:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019a85a58/0x30fd811c0305a205 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.363649:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc843a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.363653:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a85a58/0x30fd811c0305a205 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.363660:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a85a58/0x30fd811c0305a205 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.363671:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019a85a58/0x30fd811c0305a205 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.363681:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.363683:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.363685:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780997089.364127:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.364135:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305a20c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364144:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364151:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364154:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305a20c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364168:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305a20c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364177:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305a20c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364184:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305a20c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364206:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997089.364313:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.364319:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305a213 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364326:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364328:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364331:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305a213 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364340:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305a213 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364348:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305a213 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364366:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305a213 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364377:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780997089.364412:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.364416:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c0305a21a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364424:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364425:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364428:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c0305a21a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364437:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c0305a21a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364444:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c0305a21a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364451:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c0305a21a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364463:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1780997089.364502:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.364507:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305a221 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364521:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364523:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364526:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305a221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364536:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305a221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364544:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305a221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364552:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305a221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364564:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1780997089.364601:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.364606:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c0305a228 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364613:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364614:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364617:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c0305a228 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364626:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c0305a228 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364646:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c0305a228 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364654:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c0305a228 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364662:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1780997089.364703:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.364708:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c0305a22f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364715:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364717:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364720:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c0305a22f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364729:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c0305a22f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364736:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c0305a22f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364743:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c0305a22f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364752:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1780997089.364795:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.364800:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305a236 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364808:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364809:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364813:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305a236 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364821:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305a236 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364829:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305a236 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364836:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305a236 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364844:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1780997089.364876:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.364881:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c0305a23d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364888:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364889:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364892:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c0305a23d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364900:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c0305a23d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364913:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c0305a23d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364921:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c0305a23d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364929:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1780997089.364962:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.364966:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c0305a244 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364973:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364975:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.364978:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c0305a244 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364986:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c0305a244 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.364994:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c0305a244 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365001:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c0305a244 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365008:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1780997089.365046:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.365050:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305a24b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365058:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.365059:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.365062:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305a24b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365071:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305a24b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365221:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1780997089.365230:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305a20c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365239:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dbc00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.365244:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305a20c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365253:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305a20c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365284:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305a20c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365300:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000315c80e8/0x30fd811c0305a20c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365318:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780997089.365321:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305a213 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365328:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.365331:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305a213 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365339:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305a213 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365349:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305a213 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365357:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c64905b9/0x30fd811c0305a213 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365366:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1780997089.365369:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c0305a21a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365374:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dae00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.365385:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c0305a21a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365392:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c0305a21a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365400:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c0305a21a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365406:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae0d85c4/0x30fd811c0305a21a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365417:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1780997089.365421:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305a221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365426:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6da200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.365428:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305a221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365434:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305a221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365441:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305a221 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365447:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010e7c46a/0x30fd811c0305a221 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365464:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780997089.365468:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c0305a228 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365472:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.365475:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c0305a228 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365482:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c0305a228 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365490:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c0305a228 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365496:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189f5272/0x30fd811c0305a228 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365506:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780997089.365508:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c0305a22f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365514:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.365516:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c0305a22f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365534:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c0305a22f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365543:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c0305a22f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365550:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026ec4514/0x30fd811c0305a22f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365562:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780997089.365565:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305a236 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365570:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6da400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.365573:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305a236 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365579:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305a236 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365587:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305a236 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365594:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aebfecd7/0x30fd811c0305a236 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365619:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997089.365623:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c0305a23d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365629:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6db000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.365632:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c0305a23d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365639:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c0305a23d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365648:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c0305a23d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365654:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000deb4836d/0x30fd811c0305a23d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365664:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997089.365667:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c0305a244 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365672:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.365675:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c0305a244 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365691:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c0305a244 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365700:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c0305a244 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365707:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d7ecba6/0x30fd811c0305a244 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.365717:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.365719:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.365721:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.365730:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.365735:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.365741:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997089.365792:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305a24b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365802:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305a24b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365823:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997089.365876:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.365881:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305a252 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365888:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.365889:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.365892:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305a252 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365900:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305a252 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365913:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305a252 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365919:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305a252 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365930:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780997089.365965:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.365969:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305a259 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365975:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.365976:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.365979:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305a259 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365986:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305a259 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365993:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305a259 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.365999:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305a259 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.366100:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997089.366104:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305a24b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.366112:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.366115:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305a24b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.366123:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305a24b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.366144:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305a24b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.366151:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305a24b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.366164:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997089.366167:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305a252 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.366174:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.366177:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305a252 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.366184:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305a252 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.366193:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305a252 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.366200:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305a252 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.366209:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.366211:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.366219:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.366224:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997089.366313:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997089.366362:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.366368:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305a260 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366375:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366376:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366379:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305a260 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366387:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305a260 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366393:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305a260 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366399:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305a260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366412:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780997089.366446:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.366450:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305a267 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366457:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366458:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366460:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305a267 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366469:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305a267 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366481:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305a267 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366487:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305a267 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366500:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1780997089.366535:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.366540:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305a26e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366548:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366549:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366552:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305a26e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366560:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305a26e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366568:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305a26e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366574:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305a26e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366585:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1780997089.366626:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.366631:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305a275 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366639:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366640:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366643:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305a275 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366651:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305a275 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366658:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305a275 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366665:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305a275 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366673:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1780997089.366704:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.366709:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305a27c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366718:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366719:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366722:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305a27c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366730:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305a27c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366745:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305a27c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366752:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305a27c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366760:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1780997089.366794:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.366799:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305a283 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366806:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366808:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366811:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305a283 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366819:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305a283 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366826:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305a283 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366834:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305a283 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366841:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1780997089.366885:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.366890:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305a28a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366897:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366898:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366901:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305a28a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366911:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305a28a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366918:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305a28a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366925:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305a28a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366933:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1780997089.366962:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.366966:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305a291 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366973:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366975:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.366978:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305a291 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366986:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305a291 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.366999:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305a291 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367089:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305a291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367099:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1780997089.367138:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.367143:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305a298 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367151:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367152:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367155:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305a298 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367164:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305a298 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367171:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305a298 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367179:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305a298 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367187:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1780997089.367227:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.367232:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305a29f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367240:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367241:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367244:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305a29f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367252:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305a29f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367259:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305a29f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367266:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305a29f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367297:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1780997089.367333:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.367339:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305a2a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367346:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367347:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367350:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305a2a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367359:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305a2a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367374:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305a2a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367381:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305a2a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367390:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1780997089.367424:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.367428:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305a2ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367435:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367437:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367440:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305a2ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367447:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305a2ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367453:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305a2ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367460:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305a2ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367467:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1780997089.367508:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.367513:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305a2b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367521:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367523:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367525:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305a2b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367534:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305a2b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367541:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305a2b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367548:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305a2b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367556:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:1.0:1780997089.367589:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.367593:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a2bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367600:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367601:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367604:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a2bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367611:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a2bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367625:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a2bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367633:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a2bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367642:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:1.0:1780997089.367680:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.367685:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a2c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367692:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367693:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367697:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a2c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367705:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a2c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367713:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a2c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367719:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a2c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367726:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:1.0:1780997089.367768:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.367773:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a2c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367780:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367781:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367784:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a2c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367791:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a2c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367798:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a2c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367805:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a2c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367813:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:1.0:1780997089.367850:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.367855:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a2d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367862:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367863:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367866:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a2d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367874:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a2d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367888:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a2d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367895:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a2d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367903:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:1.0:1780997089.367942:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.367946:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305a2d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367953:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367954:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.367957:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305a2d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367965:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305a2d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367972:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305a2d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367978:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305a2d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.367985:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00010000:00010000:2.0:1780997089.368136:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00010000:00010000:2.0:1780997089.368144:0:25172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019a85a58/0x30fd811c0305a205 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997089.368261:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.368267:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a2de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368288:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368290:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368293:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a2de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368314:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a2de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368323:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a2de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368330:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a2de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368338:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:2.0:1780997089.368374:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.368379:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c0305a2e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368387:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368388:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368390:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c0305a2e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368398:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c0305a2e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368405:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c0305a2e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368411:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c0305a2e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368424:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:2.0:1780997089.368459:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.368464:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c0305a2ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368471:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368472:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368475:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c0305a2ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368483:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c0305a2ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368489:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c0305a2ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368495:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c0305a2ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368503:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:2.0:1780997089.368533:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.368537:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c0305a2f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368544:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368545:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368553:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c0305a2f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368561:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c0305a2f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368568:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c0305a2f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368574:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c0305a2f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368582:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:2.0:1780997089.368618:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.368623:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c0305a2fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368630:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368631:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368634:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c0305a2fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368641:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c0305a2fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368648:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c0305a2fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368666:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c0305a2fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368674:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00002000:00010000:2.0:1780997089.368715:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.368720:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c0305a301 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368727:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368729:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368732:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c0305a301 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368741:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c0305a301 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368749:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c0305a301 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368757:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c0305a301 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368764:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00002000:00010000:2.0:1780997089.368797:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.368801:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c0305a308 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368814:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368815:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368818:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c0305a308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368826:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c0305a308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368834:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c0305a308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368841:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c0305a308 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368849:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/26 locks to regular blp list, 26 blwis in pool 00002000:00010000:2.0:1780997089.368889:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.368893:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305a30f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368900:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368902:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368904:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305a30f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368911:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305a30f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368928:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305a30f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368935:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305a30f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368944:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00002000:00010000:2.0:1780997089.368979:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.368983:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c0305a316 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.368991:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368992:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.368995:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c0305a316 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.369004:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c0305a316 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997089.369148:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.369153:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305a31d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.369161:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.369162:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.369165:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305a31d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.369173:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305a31d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.369181:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305a31d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.369187:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305a31d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.369193:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/28 locks to regular blp list, 28 blwis in pool 00002000:00010000:1.0:1780997089.369222:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997089.369226:0:25180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305a324 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.369233:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.369234:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997089.369237:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305a324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.369245:0:25180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305a324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.369259:0:25180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305a324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.369265:0:25180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305a324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997089.369288:0:25180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/29 locks to regular blp list, 29 blwis in pool 00002000:00080000:1.0:1780997089.369840:0:25180:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:642 00000100:00100000:1.0:1780997089.369935:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:85157:x1867507126880512:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19628us (19728us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997089.369945:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5930 00010000:00010000:2.0:1780997089.370126:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c0305a316 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370134:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c0305a316 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370144:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/30 locks to regular blp list, 30 blwis in pool 00002000:00010000:2.0:1780997089.370212:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.370216:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c0305a32b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370224:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370225:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370229:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c0305a32b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370238:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c0305a32b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370245:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c0305a32b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370252:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c0305a32b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370260:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/31 locks to regular blp list, 31 blwis in pool 00002000:00010000:2.0:1780997089.370311:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.370316:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c0305a332 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370323:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370325:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370328:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c0305a332 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370336:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c0305a332 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370352:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c0305a332 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370359:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c0305a332 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370368:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/32 locks to regular blp list, 32 blwis in pool 00002000:00010000:2.0:1780997089.370404:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.370409:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305a339 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370416:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370418:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370420:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305a339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370429:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305a339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370437:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305a339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370445:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305a339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370454:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/33 locks to regular blp list, 33 blwis in pool 00002000:00010000:2.0:1780997089.370509:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.370514:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305a340 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370522:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370523:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370526:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305a340 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370535:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305a340 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370544:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305a340 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370550:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305a340 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370560:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/34 locks to regular blp list, 34 blwis in pool 00002000:00010000:2.0:1780997089.370598:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.370603:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c0305a347 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370610:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370612:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370615:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c0305a347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370624:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c0305a347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370640:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c0305a347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370647:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c0305a347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370656:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/35 locks to regular blp list, 35 blwis in pool 00002000:00010000:2.0:1780997089.370692:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.370697:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c0305a34e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370705:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370706:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370709:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c0305a34e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370718:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c0305a34e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370725:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c0305a34e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370732:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c0305a34e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370739:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/36 locks to regular blp list, 36 blwis in pool 00002000:00010000:2.0:1780997089.370785:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.370790:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c0305a355 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370798:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370799:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370802:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c0305a355 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370812:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c0305a355 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370819:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c0305a355 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370826:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c0305a355 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370834:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/37 locks to regular blp list, 37 blwis in pool 00002000:00010000:2.0:1780997089.370869:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.370874:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305a35c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370882:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370883:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370886:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305a35c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370895:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305a35c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370909:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305a35c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370916:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305a35c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370925:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/38 locks to regular blp list, 38 blwis in pool 00002000:00010000:2.0:1780997089.370961:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.370966:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c0305a363 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370974:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370976:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.370979:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c0305a363 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370989:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c0305a363 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.370997:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c0305a363 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.371004:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c0305a363 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371130:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 37 total in blp. (37 blwis in pool) 00010000:00010000:3.0:1780997089.371141:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305a259 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371149:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371155:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305a259 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371164:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305a259 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371181:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305a259 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371188:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305a259 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371233:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 36 total in blp. (36 blwis in pool) 00010000:00010000:3.0:1780997089.371238:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305a260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371245:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371248:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305a260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371280:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305a260 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371290:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305a260 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371297:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305a260 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371309:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 35 total in blp. (35 blwis in pool) 00010000:00010000:3.0:1780997089.371312:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305a267 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371317:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371320:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305a267 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371326:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305a267 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371334:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305a267 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371340:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305a267 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371361:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 34 total in blp. (34 blwis in pool) 00010000:00010000:3.0:1780997089.371364:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305a26e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371370:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371373:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305a26e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371381:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305a26e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371390:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305a26e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371395:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305a26e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371407:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 33 total in blp. (33 blwis in pool) 00010000:00010000:3.0:1780997089.371410:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305a275 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371416:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371419:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305a275 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371435:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305a275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371445:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305a275 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371451:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305a275 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371463:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 32 total in blp. (32 blwis in pool) 00010000:00010000:3.0:1780997089.371467:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305a27c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371472:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371475:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305a27c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371482:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305a27c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371490:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305a27c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371497:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305a27c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371519:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 31 total in blp. (31 blwis in pool) 00010000:00010000:3.0:1780997089.371524:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305a283 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371529:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371532:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305a283 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371538:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305a283 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371548:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305a283 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371555:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305a283 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371566:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 30 total in blp. (30 blwis in pool) 00010000:00010000:3.0:1780997089.371569:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305a28a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371576:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371579:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305a28a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371596:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305a28a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371605:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305a28a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371612:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305a28a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371624:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 29 total in blp. (29 blwis in pool) 00010000:00010000:3.0:1780997089.371628:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305a291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371634:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371638:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305a291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371646:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305a291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371655:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305a291 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371662:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305a291 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371683:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 28 total in blp. (28 blwis in pool) 00010000:00010000:3.0:1780997089.371687:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305a298 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371694:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371696:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305a298 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371705:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305a298 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371715:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305a298 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371722:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305a298 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371733:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 27 total in blp. (27 blwis in pool) 00010000:00010000:3.0:1780997089.371736:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305a29f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371743:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371746:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305a29f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371765:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305a29f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371775:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305a29f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371783:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305a29f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371795:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 26 total in blp. (26 blwis in pool) 00010000:00010000:3.0:1780997089.371799:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305a2a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371806:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371809:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305a2a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371816:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305a2a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371825:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305a2a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371831:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305a2a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371853:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 25 total in blp. (25 blwis in pool) 00010000:00010000:3.0:1780997089.371857:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305a2ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371863:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371866:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305a2ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371873:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305a2ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371883:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305a2ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371890:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305a2ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371902:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00010000:00010000:3.0:1780997089.371906:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305a2b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371913:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371916:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305a2b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371933:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305a2b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371944:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305a2b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371951:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305a2b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371964:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:3.0:1780997089.371968:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a2bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371974:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.371977:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a2bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371984:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a2bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371992:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a2bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.371998:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a2bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372125:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00002000:00010000:2.0:1780997089.372199:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.372204:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c0305a36a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372213:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372215:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372218:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c0305a36a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372227:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c0305a36a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372235:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c0305a36a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372243:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c0305a36a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372249:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00002000:00010000:2.0:1780997089.372291:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.372296:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305a371 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372303:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372304:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372307:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305a371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372315:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305a371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372327:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305a371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372334:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305a371 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372340:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/26 locks to regular blp list, 26 blwis in pool 00002000:00010000:2.0:1780997089.372374:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.372379:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305a378 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372386:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372387:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372390:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305a378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372399:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305a378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372406:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305a378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372414:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305a378 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372421:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00002000:00010000:2.0:1780997089.372460:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.372464:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305a37f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372470:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372472:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372475:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305a37f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372484:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305a37f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372491:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305a37f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372497:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305a37f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372504:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/28 locks to regular blp list, 28 blwis in pool 00002000:00010000:2.0:1780997089.372529:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.372533:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c0305a386 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372539:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372540:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372543:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c0305a386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372550:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c0305a386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372561:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c0305a386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372567:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c0305a386 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372573:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/29 locks to regular blp list, 29 blwis in pool 00002000:00010000:2.0:1780997089.372604:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.372607:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c0305a38d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372613:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372614:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372617:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c0305a38d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372625:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c0305a38d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372631:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c0305a38d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372638:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c0305a38d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372646:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/30 locks to regular blp list, 30 blwis in pool 00002000:00010000:2.0:1780997089.372683:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.372688:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c0305a394 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372695:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372696:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372699:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c0305a394 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372707:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c0305a394 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372713:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c0305a394 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372720:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c0305a394 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372727:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/31 locks to regular blp list, 31 blwis in pool 00002000:00010000:2.0:1780997089.372758:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997089.372762:0:25172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c0305a39b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372769:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372770:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997089.372773:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c0305a39b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372780:0:25172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c0305a39b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372793:0:25172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c0305a39b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372800:0:25172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c0305a39b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997089.372808:0:25172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/32 locks to regular blp list, 32 blwis in pool 00000100:00100000:1.0:1780997089.373157:0:85157:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85157:1867507126880512:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1780997089.373182:0:85157:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x301:0x0] from OST, last_created [0x280000400:0x301:0x0]last_used is [0x280000400:0x282:0x0] 00000100:00100000:1.0:1780997089.373280:0:85157:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85157:1867507126880768:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1780997089.373348:0:85157:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997089.373383:0:85157:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997089.373399:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126880640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997089.373424:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997089.373458:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126880640 00000100:00100000:1.0:1780997089.373466:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126880640 00000100:00100000:1.0:1780997089.373506:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1780997089.373515:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126880640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780997089.373548:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997089.373608:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126880640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997089.373615:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1780997089.373668:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126880640:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1780997089.373811:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 31 total in blp. (31 blwis in pool) 00010000:00010000:3.0:1780997089.373817:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a2c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373824:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.373828:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a2c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373837:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a2c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373851:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a2c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373858:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a2c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373869:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 30 total in blp. (30 blwis in pool) 00010000:00010000:3.0:1780997089.373873:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a2c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373879:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980030000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.373882:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a2c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373901:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a2c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373911:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a2c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373919:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a2c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373933:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 29 total in blp. (29 blwis in pool) 00010000:00010000:3.0:1780997089.373936:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a2d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373943:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.373946:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a2d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373954:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a2d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373962:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a2d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373969:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a2d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.373991:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 28 total in blp. (28 blwis in pool) 00010000:00010000:3.0:1780997089.373994:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305a2d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.374001:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956fc00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.374004:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305a2d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997089.374114:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126880768 00000100:00100000:0.0:1780997089.374119:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126880768 00000100:00100000:0.0:1780997089.374150:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5931 00000100:00100000:0.0:1780997089.374157:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:85157:x1867507126880768:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1780997089.374188:0:25177:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 770 00010000:00010000:3.0:1780997089.375137:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305a2d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375153:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305a2d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375160:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305a2d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375177:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 27 total in blp. (27 blwis in pool) 00010000:00010000:3.0:1780997089.375181:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a2de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375189:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.375193:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a2de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375215:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a2de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375228:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a2de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375235:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a2de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375262:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 26 total in blp. (26 blwis in pool) 00010000:00010000:3.0:1780997089.375266:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c0305a2e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375289:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.375292:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c0305a2e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375300:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c0305a2e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375310:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c0305a2e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375317:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009da0cc4d/0x30fd811c0305a2e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375348:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 25 total in blp. (25 blwis in pool) 00010000:00010000:3.0:1780997089.375352:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c0305a2ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375359:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.375362:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c0305a2ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375371:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c0305a2ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375381:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c0305a2ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375388:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001077654e/0x30fd811c0305a2ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375401:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00010000:00010000:3.0:1780997089.375404:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c0305a2f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375411:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.375414:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c0305a2f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375433:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c0305a2f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375445:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c0305a2f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375452:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019c49a87/0x30fd811c0305a2f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375468:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:3.0:1780997089.375472:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c0305a2fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375478:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.375481:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c0305a2fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375489:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c0305a2fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375498:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c0305a2fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375506:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003b87a17/0x30fd811c0305a2fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375531:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:3.0:1780997089.375535:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c0305a301 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375541:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.375544:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c0305a301 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375552:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c0305a301 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375564:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c0305a301 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375571:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2134fa8/0x30fd811c0305a301 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375585:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:3.0:1780997089.375589:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c0305a308 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375595:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.375598:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c0305a308 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375616:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c0305a308 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375627:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c0305a308 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375634:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054aaa812/0x30fd811c0305a308 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375647:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:3.0:1780997089.375651:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305a30f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375657:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.375660:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305a30f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375668:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305a30f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375678:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305a30f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375687:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d4180e4/0x30fd811c0305a30f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375710:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:3.0:1780997089.375714:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305a31d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375721:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.375723:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305a31d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375731:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305a31d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375742:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305a31d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375748:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305a31d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375759:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:3.0:1780997089.375763:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305a324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375770:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.375773:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305a324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375792:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305a324 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375804:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305a324 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375811:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305a324 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375823:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:3.0:1780997089.375827:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c0305a316 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375833:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.375837:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c0305a316 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375844:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c0305a316 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375853:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c0305a316 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375859:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e8e7bac/0x30fd811c0305a316 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375881:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:3.0:1780997089.375885:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c0305a32b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375891:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.375894:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c0305a32b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375902:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c0305a32b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375912:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c0305a32b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375918:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005df4776f/0x30fd811c0305a32b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375930:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:3.0:1780997089.375933:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c0305a332 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375939:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.375942:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c0305a332 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375960:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c0305a332 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375970:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c0305a332 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375977:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da1df64e/0x30fd811c0305a332 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375989:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1780997089.375992:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305a339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.375998:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.376001:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305a339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377138:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305a339 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377156:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305a339 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377164:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000692db9b2/0x30fd811c0305a339 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377198:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1780997089.377202:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305a340 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377209:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377212:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305a340 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377220:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305a340 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377230:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305a340 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377237:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063d98bc3/0x30fd811c0305a340 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377250:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1780997089.377253:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c0305a347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377260:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377263:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c0305a347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377298:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c0305a347 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377309:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c0305a347 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377317:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000411b5788/0x30fd811c0305a347 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377333:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1780997089.377337:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c0305a34e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377344:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377346:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c0305a34e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377354:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c0305a34e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377364:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c0305a34e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377372:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071ef3172/0x30fd811c0305a34e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377397:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1780997089.377402:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c0305a355 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377409:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377413:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c0305a355 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377423:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c0305a355 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377433:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c0305a355 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377440:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8d099cc/0x30fd811c0305a355 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377455:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1780997089.377459:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305a35c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377466:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377469:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305a35c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377489:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305a35c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377500:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305a35c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377509:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dee9ead/0x30fd811c0305a35c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377521:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1780997089.377526:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c0305a363 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377532:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377535:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c0305a363 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377543:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c0305a363 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377553:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c0305a363 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377561:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000545da2dd/0x30fd811c0305a363 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377585:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780997089.377589:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c0305a36a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377596:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377599:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c0305a36a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377607:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c0305a36a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377617:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c0305a36a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377625:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000912e0680/0x30fd811c0305a36a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377637:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1780997089.377641:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305a371 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377648:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377651:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305a371 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377669:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305a371 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377680:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305a371 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377688:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdb539d6/0x30fd811c0305a371 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377702:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1780997089.377706:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305a378 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377712:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377715:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305a378 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377722:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305a378 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377732:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305a378 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377739:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e79716d4/0x30fd811c0305a378 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377767:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780997089.377770:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305a37f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377776:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377779:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305a37f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377787:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305a37f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377797:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305a37f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377805:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc188fae/0x30fd811c0305a37f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377817:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780997089.377820:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c0305a386 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377826:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377829:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c0305a386 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377847:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c0305a386 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377857:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c0305a386 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377863:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036b01289/0x30fd811c0305a386 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377877:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780997089.377880:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c0305a38d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377886:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377889:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c0305a38d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377896:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c0305a38d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377904:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c0305a38d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377911:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051c2606a/0x30fd811c0305a38d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377933:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997089.377937:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c0305a394 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377943:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377947:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c0305a394 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377954:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c0305a394 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377963:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c0305a394 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377970:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4eedb06/0x30fd811c0305a394 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377981:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997089.377984:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c0305a39b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.377991:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997089.377993:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c0305a39b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997089.378559:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:85157:x1867507126880768:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4398us (5206us total) trans 4294969451 rc 0/0 00000100:00100000:0.0:1780997089.378569:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5931 00000100:00100000:1.0:1780997089.379189:0:85157:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85157:1867507126880768:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1780997089.379207:0:85157:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x301:0x0]-[0x280000400:0x321:0x0] 00010000:00010000:3.0:1780997089.384129:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c0305a39b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.384156:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c0305a39b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.384165:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a38a13d/0x30fd811c0305a39b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997089.384191:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.384193:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.384195:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.384218:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.384224:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997089.384229:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1780997089.393680:0:25172:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:144 00000100:00100000:2.0:1780997089.393835:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:85159:x1867507126880384:12345-0@lo:5:osp-pre-1-0.0 Request processed in 44406us (44561us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997089.393847:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5929 00000100:00100000:1.0:1780997089.396127:0:85159:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85159:1867507126880384:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1780997089.396148:0:85159:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x301:0x0] from OST, last_created [0x2c0000401:0x301:0x0]last_used is [0x2c0000401:0x90:0x0] 00000100:00100000:1.0:1780997089.396237:0:85159:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85159:1867507126881024:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1780997089.396322:0:85159:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997089.396348:0:85159:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997089.396368:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126881024 00000100:00100000:1.0:1780997089.396374:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126881024 00000100:00100000:1.0:1780997089.396425:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5932 00000100:00100000:1.0:1780997089.396434:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:85159:x1867507126881024:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1780997089.396476:0:25175:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 770 00000100:00100000:1.0:1780997089.398116:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:85159:x1867507126881024:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1679us (1789us total) trans 4294969451 rc 0/0 00000100:00100000:1.0:1780997089.398127:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5932 00000100:00100000:1.0:1780997089.398196:0:85159:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85159:1867507126881024:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1780997089.398209:0:85159:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x301:0x0]-[0x2c0000401:0x321:0x0] 00000100:00100000:2.0:1780997089.398541:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126880896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997089.398583:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997089.399538:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126880896 00000100:00100000:3.0:1780997089.399549:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126880896 00000100:00100000:3.0:1780997089.399595:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:3.0:1780997089.399605:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126880896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780997089.399635:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997089.399704:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126880896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997089.399711:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00100000:3.0:1780997089.399754:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126880896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780997089.704478:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780997089.704518:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126881152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780997089.704590:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997089.704632:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126881280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780997089.704658:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997089.704691:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126881152 00000100:00100000:3.0:1780997089.704698:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126881152 00000100:00100000:3.0:1780997089.704734:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126881280 00000100:00100000:3.0:1780997089.704737:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126881280 00000100:00100000:3.0:1780997089.704752:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:3.0:1780997089.704761:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126881152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997089.704796:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997089.704838:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126881152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997089.704846:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:3.0:1780997089.704864:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1780997089.704870:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126881280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997089.704880:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997089.704908:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126881280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997089.704914:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1780997089.704966:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126881152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780997089.705139:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126881280:0@lo:13:osp-pre-1-1.0 00000020:00000004:1.0:1780997090.016784:0:85509:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1780997090.017011:0:85509:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1780997090.024547:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997090.061508:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997090.061545:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997090.061573:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997090.061606:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110359552 00000100:00100000:3.0:1780997090.061626:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110359552 00000100:00100000:1.0:1780997090.061738:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110359296 00000100:00100000:1.0:1780997090.061747:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110359296 00000100:00100000:1.0:1780997090.061796:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1780997090.061807:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2397:x1867507110359296:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997090.061880:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2397:x1867507110359296:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 76us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997090.061887:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:3.0:1780997090.062791:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110359424 00000100:00100000:3.0:1780997090.062798:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110359424 00000100:00100000:3.0:1780997090.062824:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1196 00000100:00100000:3.0:1780997090.062832:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110359552:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997090.062879:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110359552:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997090.062885:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1196 00000100:00100000:3.0:1780997090.062900:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1197 00000100:00100000:3.0:1780997090.062906:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2397:x1867507110359424:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997090.062937:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2397:x1867507110359424:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997090.062942:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1197 00000100:00080000:1.0:1780997090.070182:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1780997091.045715:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997092.010093:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997092.010920:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110359680 00000100:00100000:0.0:1780997092.011099:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110359680 00000100:00100000:0.0:1780997092.011429:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1216 00000100:00100000:0.0:1780997092.011440:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:67551:x1867507110359680:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1780997092.011477:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997092.011517:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a3a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b84 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997092.011592:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a3a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997092.011606:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997092.011621:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997092.011693:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780997092.011698:0:63418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997092.011759:0:63418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997092.011786:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a3a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b84 expref: 9 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997092.011809:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b84 expref: 8 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997092.011818:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd900) 00010000:00010000:0.0:1780997092.011821:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780997092.011824:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955e00, rc 0) 00000100:00100000:0.0:1780997092.011905:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67551:x1867507110359680:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 467us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997092.011912:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1216 00000100:00100000:3.0:1780997092.020692:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997092.020880:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110359808 00000100:00100000:0.0:1780997092.020891:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110359808 00000100:00100000:0.0:1780997092.020958:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1217 00000100:00100000:0.0:1780997092.020968:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67551:x1867507110359808:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:0.0:1780997092.021019:0:63419:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445261312 avail 1299021824 00000100:00100000:0.0:1780997092.021099:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67551:x1867507110359808:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 132us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997092.021107:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1217 00000100:00100000:1.0:1780997092.024208:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997092.024297:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110359936 00000100:00100000:3.0:1780997092.024307:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110359936 00000100:00080000:2.0:1780997092.025897:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997092.025905:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780997092.027707:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1218 00000100:00100000:3.0:1780997092.027721:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:67551:x1867507110359936:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:3.0:1780997092.027765:0:63417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1780997092.027846:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:67551:x1867507110359936:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 131us (3650us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997092.027851:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1218 00000100:00100000:1.0:1780997092.039519:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997092.039828:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110360064 00000100:00100000:2.0:1780997092.039839:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110360064 00000100:00100000:2.0:1780997092.039897:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5933 00000100:00100000:2.0:1780997092.039905:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2393:x1867507110360064:12345-192.168.206.51@tcp:8:lfs.0 00010000:00080000:2.0:1780997092.039939:0:25181:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp t0 exp 0000000000000000 cur 3619 last 0 00000020:00000080:2.0:1780997092.039972:0:25181:0:(genops.c:1406:class_connect()) connect: client 285c134c-d3a6-4c01-bb4d-8148c50d5f95, cookie 0x30fd811c0305a3b0 00002000:00100000:2.0:1780997092.039984:0:25181:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 285c134c-d3a6-4c01-bb4d-8148c50d5f95/ffff9688888d7800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1780997092.040149:0:25181:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1780997092.040224:0:25181:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1780997092.040494:0:25181:0:(import.c:65:import_set_state_nolock()) ffff9688888d6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997092.041122:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110360064:12345-192.168.206.51@tcp:8:lfs.0 Request processed in 1215us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997092.041133:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5933 00000100:00100000:0.0:1780997092.044143:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997092.044307:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110360192 00000100:00100000:3.0:1780997092.044318:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110360192 00000100:00100000:3.0:1780997092.044390:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2024 00000100:00100000:3.0:1780997092.044441:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:67551:x1867507110360192:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:3.0:1780997092.044469:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997092.044540:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:67551:x1867507110360192:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 102us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997092.044547:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2024 00000100:00080000:2.0:1780997092.044778:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997092.051421:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997092.051623:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110360320 00000100:00100000:2.0:1780997092.051756:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110360320 00000100:00100000:2.0:1780997092.051814:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5934 00000100:00100000:2.0:1780997092.051823:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2393:x1867507110360320:12345-192.168.206.51@tcp:8:lfs.0 00010000:00080000:2.0:1780997092.051920:0:25179:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp t0 exp 0000000000000000 cur 3619 last 0 00000020:00000080:2.0:1780997092.051953:0:25179:0:(genops.c:1406:class_connect()) connect: client 285c134c-d3a6-4c01-bb4d-8148c50d5f95, cookie 0x30fd811c0305a3b7 00002000:00100000:2.0:1780997092.051966:0:25179:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 285c134c-d3a6-4c01-bb4d-8148c50d5f95/ffff9688888d0800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1780997092.052149:0:25179:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1780997092.052215:0:25179:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1780997092.052245:0:25179:0:(import.c:65:import_set_state_nolock()) ffff9688888d3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997092.052602:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110360320:12345-192.168.206.51@tcp:8:lfs.0 Request processed in 779us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997092.052612:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5934 00000100:00100000:1.0:1780997092.055835:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997092.056053:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110360448 00000100:00100000:2.0:1780997092.056072:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110360448 00000100:00100000:2.0:1780997092.056186:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2025 00000100:00100000:2.0:1780997092.056198:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:67551:x1867507110360448:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1780997092.056223:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997092.056354:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:67551:x1867507110360448:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 159us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997092.056373:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2025 00000100:00080000:0.0:1780997092.058709:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1780997092.069517:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997093.097700:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997094.119593:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997094.309804:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997094.309829:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126881792:0@lo:400:kworker.0 00000100:00100000:3.0:1780997094.309874:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507126881536:0@lo:400:kworker.0 00000100:00100000:1.0:1780997094.309988:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126881664:0@lo:400:kworker.0 00000100:00100000:2.0:1780997094.310072:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126881920:0@lo:400:kworker.0 00000100:00100000:3.0:1780997094.310309:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997094.310366:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126882048:0@lo:400:kworker.0 00000100:00100000:3.0:1780997094.310409:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997094.310429:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126882560:0@lo:400:kworker.0 00000100:00100000:3.0:1780997094.310453:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997094.310475:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126883072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997094.310497:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997094.310534:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126882048 00000100:00100000:3.0:1780997094.310541:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126882048 00000100:00100000:3.0:1780997094.310599:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126882560 00000100:00100000:3.0:1780997094.310602:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126882560 00000100:00100000:3.0:1780997094.310616:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126883072 00000100:00100000:3.0:1780997094.310619:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126883072 00000100:00100000:3.0:1780997094.310632:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951 00000100:00100000:3.0:1780997094.310641:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126882048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997094.310697:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126882048:12345-0@lo:400:kworker.0 Request processed in 56us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997094.310705:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951 00000100:00100000:3.0:1780997094.310737:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952 00000100:00100000:3.0:1780997094.310743:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126882560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997094.310778:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126882560:12345-0@lo:400:kworker.0 Request processed in 35us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997094.310784:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952 00000100:00100000:3.0:1780997094.310796:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953 00000100:00100000:3.0:1780997094.310801:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126883072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780997094.310826:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1780997094.310858:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126883072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997094.310865:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953 00000100:00100000:3.0:1780997094.310914:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126883072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997094.310926:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126882048:0@lo:400:kworker.0 00000100:00100000:3.0:1780997094.310934:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126882560:0@lo:400:kworker.0 00000100:00100000:3.0:1780997094.311122:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126881536 00000100:00100000:3.0:1780997094.311127:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126881536 00000100:00100000:3.0:1780997094.311163:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1780997094.311580:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997094.311613:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126882176:0@lo:400:kworker.0 00000100:00100000:1.0:1780997094.311653:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997094.311674:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126882688:0@lo:400:kworker.0 00000100:00100000:1.0:1780997094.311697:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997094.311747:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126881664 00000100:00100000:1.0:1780997094.311752:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126881664 00000100:00100000:0.0:1780997094.311919:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997094.311947:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126881408:0@lo:400:kworker.0 00000100:00100000:0.0:1780997094.311979:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997094.312011:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126882304:0@lo:400:kworker.0 00000100:00100000:0.0:1780997094.312034:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997094.312062:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126882816:0@lo:400:kworker.0 00000100:00100000:0.0:1780997094.312084:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997094.312113:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780997094.312118:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780997094.312128:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126882176 00000100:00100000:0.0:1780997094.312132:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126882176 00000100:00100000:0.0:1780997094.312162:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126882688 00000100:00100000:0.0:1780997094.312165:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126882688 00000100:00100000:0.0:1780997094.312184:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126882304 00000100:00100000:0.0:1780997094.312199:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126882304 00000100:00100000:0.0:1780997094.312221:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126882816 00000100:00100000:0.0:1780997094.312224:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126882816 00000100:00100000:0.0:1780997094.312246:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:0.0:1780997094.312254:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126882176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997094.312315:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126882176:12345-0@lo:400:kworker.0 Request processed in 62us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997094.312322:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:0.0:1780997094.312338:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:0.0:1780997094.312344:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126882688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997094.312386:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126882688:12345-0@lo:400:kworker.0 Request processed in 42us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997094.312392:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:0.0:1780997094.312655:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:0.0:1780997094.312663:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126882304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997094.312676:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507126881536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997094.312701:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126882304:12345-0@lo:400:kworker.0 Request processed in 41us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997094.312708:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00100000:3.0:1780997094.312710:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507126881536:12345-0@lo:400:kworker.0 Request processed in 37us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997094.312718:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:0.0:1780997094.312730:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126882816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997094.312755:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126882816:12345-0@lo:400:kworker.0 Request processed in 32us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997094.312760:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:0.0:1780997094.312781:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126881792 00000100:00100000:0.0:1780997094.312785:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126881792 00000100:00100000:2.0:1780997094.315599:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997094.315664:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126882432:0@lo:400:kworker.0 00000100:00100000:2.0:1780997094.315709:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997094.315729:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126882944:0@lo:400:kworker.0 00000100:00100000:2.0:1780997094.315757:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997094.315820:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126881408 00000100:00100000:2.0:1780997094.315904:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126881408 00000100:00100000:2.0:1780997094.315955:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1780997094.315965:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126881408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997094.316016:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126881408:12345-0@lo:400:kworker.0 Request processed in 52us (4035us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997094.316023:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1780997094.316069:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126881920 00000100:00100000:2.0:1780997094.316073:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126881920 00000100:00100000:1.0:1780997094.317208:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126882432 00000100:00100000:1.0:1780997094.317216:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126882432 00000100:00100000:1.0:1780997094.317239:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126882944 00000100:00100000:1.0:1780997094.317242:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126882944 00000100:00100000:1.0:1780997094.317257:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1780997094.317265:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126881664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997094.317334:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126881664:12345-0@lo:400:kworker.0 Request processed in 69us (5754us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997094.317354:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1780997094.317383:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1780997094.317389:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126882432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997094.318462:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1780997094.318494:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1780997094.318504:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126882944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997094.318645:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126882944:12345-0@lo:400:kworker.0 Request processed in 144us (2886us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997094.318664:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1780997094.318712:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126882432:12345-0@lo:400:kworker.0 Request processed in 1322us (3001us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997094.318720:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1780997094.318744:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507126881536:0@lo:400:kworker.0 00000100:00100000:1.0:1780997094.318753:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126881664:0@lo:400:kworker.0 00000100:00100000:1.0:1780997094.318765:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126882176:0@lo:400:kworker.0 00000100:00100000:1.0:1780997094.318778:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126882688:0@lo:400:kworker.0 00000100:00080000:1.0:1780997094.318857:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997094.318863:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780997094.318867:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997094.318871:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997094.318936:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126882304:0@lo:400:kworker.0 00000100:00100000:1.0:1780997094.318949:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126882816:0@lo:400:kworker.0 00000100:00100000:1.0:1780997094.318959:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126881408:0@lo:400:kworker.0 00000100:00100000:1.0:1780997094.319017:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126882432:0@lo:400:kworker.0 00000100:00100000:1.0:1780997094.319029:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126882944:0@lo:400:kworker.0 00000100:00100000:0.0:1780997094.331486:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1780997094.331518:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507126881792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997094.331730:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507126881792:12345-0@lo:400:kworker.0 Request processed in 230us (19809us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997094.331741:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1780997094.331948:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126881792:0@lo:400:kworker.0 00000100:00100000:2.0:1780997094.332775:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1780997094.332792:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126881920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997094.332874:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126881920:12345-0@lo:400:kworker.0 Request processed in 91us (17283us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997094.332882:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1780997094.332966:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126881920:0@lo:400:kworker.0 00000100:00100000:3.0:1780997094.821511:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780997094.821535:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126883200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780997094.821600:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997094.821904:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126883328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780997094.821937:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997094.822093:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126883200 00000100:00100000:0.0:1780997094.822102:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126883200 00000100:00100000:0.0:1780997094.822142:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126883328 00000100:00100000:0.0:1780997094.822145:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126883328 00000100:00100000:0.0:1780997094.822161:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:0.0:1780997094.822183:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126883200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997094.822214:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997094.822263:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126883200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997094.822290:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00100000:0.0:1780997094.822306:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:0.0:1780997094.822313:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126883328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997094.822329:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997094.822358:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126883328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997094.822364:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:0.0:1780997094.822424:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126883200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780997094.824037:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126883328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997094.824337:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126883456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997094.824413:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997094.824455:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126883456 00000100:00100000:1.0:1780997094.824461:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126883456 00000100:00100000:1.0:1780997094.824492:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:1.0:1780997094.824501:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126883456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780997094.824520:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997094.824563:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126883456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997094.824570:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:1.0:1780997094.824608:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126883456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780997094.824760:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780997094.824769:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126883584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780997094.824822:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997094.824850:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126883584 00000100:00100000:3.0:1780997094.824854:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126883584 00000100:00100000:3.0:1780997094.824883:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:3.0:1780997094.824890:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126883584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780997094.824914:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445261312 avail 1299021824 00000100:00100000:3.0:1780997094.824949:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126883584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997094.824955:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000100:00100000:3.0:1780997094.824987:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126883584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997094.825288:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997094.825298:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126883712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997094.825325:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997094.825497:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126883712 00000100:00100000:2.0:1780997094.825502:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126883712 00000100:00100000:2.0:1780997094.825538:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:2.0:1780997094.825545:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126883712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780997094.825557:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997094.825597:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126883712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997094.825614:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:2.0:1780997094.825650:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126883712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1780997095.141880:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997095.179493:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997095.179568:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997095.179607:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997095.179648:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997095.179686:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997095.179735:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110360832 00000100:00100000:3.0:1780997095.179749:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110360832 00000100:00100000:3.0:1780997095.179836:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110360704 00000100:00100000:3.0:1780997095.179840:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110360704 00000100:00100000:3.0:1780997095.179876:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1204 00000100:00100000:3.0:1780997095.179890:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110360832:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997095.180640:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110360832:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 748us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997095.180652:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1204 00000100:00100000:3.0:1780997095.180689:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1205 00000100:00100000:3.0:1780997095.180705:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2395:x1867507110360704:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997095.180858:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110360576 00000100:00100000:0.0:1780997095.180864:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110360576 00000100:00100000:0.0:1780997095.180904:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:0.0:1780997095.180911:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110360576:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997095.180968:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886f35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110360576:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 58us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997095.180996:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:3.0:1780997095.181209:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2395:x1867507110360704:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 510us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997095.181217:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1205 00000100:00080000:3.0:1780997095.181241:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780997095.181246:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997095.181445:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110361088 00000100:00100000:0.0:1780997095.181450:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110361088 00000100:00100000:0.0:1780997095.181491:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2530 00000100:00100000:0.0:1780997095.181499:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110361088:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997095.181531:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110361088:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997095.181539:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2530 00000100:00100000:0.0:1780997095.181554:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110360960 00000100:00100000:0.0:1780997095.181558:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110360960 00000100:00100000:0.0:1780997095.181600:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2531 00000100:00100000:0.0:1780997095.181609:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110360960:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997095.181644:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110360960:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997095.181652:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2531 00000100:00080000:2.0:1780997095.181667:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997095.181678:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1780997095.346760:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000001:00080000:0.0:1780997095.346785:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969451 is committed 00000001:00100000:2.0:1780997095.347527:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000001:00080000:2.0:1780997095.347536:0:9294:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969451 is committed 00000001:02000400:0.0:1780997095.918899:0:85606:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:3.0:1780997096.165560:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997097.194749:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1780997097.592905:0:85655:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1780997098.214375:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997099.237553:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997099.429651:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126884096:0@lo:400:kworker.0 00000100:00100000:1.0:1780997099.429744:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997099.429745:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126884352:0@lo:400:kworker.0 00000100:00100000:2.0:1780997099.429785:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997099.429794:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126884608:0@lo:400:kworker.0 00000100:00100000:2.0:1780997099.429808:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126884864:0@lo:400:kworker.0 00000100:00100000:2.0:1780997099.429837:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997099.429848:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997099.429856:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126885376:0@lo:400:kworker.0 00000100:00100000:1.0:1780997099.429876:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126885120:0@lo:400:kworker.0 00000100:00100000:2.0:1780997099.429895:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997099.429914:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997099.429921:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1780997099.429930:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126884224:0@lo:400:kworker.0 00000100:00100000:1.0:1780997099.429942:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [2->3] 00000100:00100000:1.0:1780997099.429950:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126883840:0@lo:400:kworker.0 00000100:00100000:2.0:1780997099.429974:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997099.429989:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997099.429997:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126884736:0@lo:400:kworker.0 00000100:00100000:2.0:1780997099.430037:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997099.430037:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126883968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997099.430061:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888961b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126885248:0@lo:400:kworker.0 00000100:00100000:1.0:1780997099.430079:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997099.430098:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126884480:0@lo:400:kworker.0 00000100:00100000:1.0:1780997099.430133:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997099.430151:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126884992:0@lo:400:kworker.0 00000100:00100000:2.0:1780997099.430172:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997099.430177:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997099.430204:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126885504:0@lo:400:kworker.0 00000100:00100000:2.0:1780997099.430215:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126884096 00000100:00100000:1.0:1780997099.430226:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997099.430239:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126884096 00000100:00100000:1.0:1780997099.430256:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126884864 00000100:00100000:1.0:1780997099.430261:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126884864 00000100:00100000:2.0:1780997099.430329:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126884352 00000100:00100000:2.0:1780997099.430334:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126884352 00000100:00100000:1.0:1780997099.430334:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126885376 00000100:00100000:1.0:1780997099.430340:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126885376 00000100:00100000:2.0:1780997099.430359:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126884224 00000100:00100000:1.0:1780997099.430368:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126884736 00000100:00100000:2.0:1780997099.430370:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126884224 00000100:00100000:1.0:1780997099.430373:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126884736 00000100:00100000:2.0:1780997099.430398:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126884480 00000100:00100000:2.0:1780997099.430403:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126884480 00000100:00100000:1.0:1780997099.430406:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126885248 00000100:00100000:1.0:1780997099.430412:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126885248 00000100:00100000:2.0:1780997099.430427:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126884992 00000100:00100000:0.0:1780997099.430431:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:2.0:1780997099.430432:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126884992 00000100:00100000:0.0:1780997099.430446:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126884864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997099.430453:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126885504 00000100:00100000:2.0:1780997099.430457:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126885504 00000100:00100000:2.0:1780997099.430473:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:2.0:1780997099.430481:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126884096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997099.430513:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126884864:12345-0@lo:400:kworker.0 Request processed in 71us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997099.430535:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126884096:12345-0@lo:400:kworker.0 Request processed in 54us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997099.430542:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:2.0:1780997099.430560:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1780997099.430566:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126884352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997099.430573:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:1.0:1780997099.430591:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:2.0:1780997099.430606:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126884352:12345-0@lo:400:kworker.0 Request processed in 36us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997099.430607:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126885376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997099.430607:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534 00000100:00100000:0.0:1780997099.430621:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126884736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997099.430622:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1780997099.430642:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1780997099.430652:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126884224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997099.430661:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126885376:12345-0@lo:400:kworker.0 Request processed in 61us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997099.430671:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126884736:12345-0@lo:400:kworker.0 Request processed in 53us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997099.430675:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:0.0:1780997099.430685:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534 00000100:00100000:2.0:1780997099.430697:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126884224:12345-0@lo:400:kworker.0 Request processed in 45us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997099.430702:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535 00000100:00100000:2.0:1780997099.430708:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:1.0:1780997099.430714:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126885248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997099.430730:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1780997099.430740:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126884480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997099.430744:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126884224:0@lo:400:kworker.0 00000100:00100000:1.0:1780997099.430755:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126885248:12345-0@lo:400:kworker.0 Request processed in 44us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997099.430762:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126884736:0@lo:400:kworker.0 00000100:00100000:1.0:1780997099.430766:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535 00000100:00100000:0.0:1780997099.430783:0:3497:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 2 00000100:00100000:2.0:1780997099.430785:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126884480:12345-0@lo:400:kworker.0 Request processed in 46us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997099.430795:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:1.0:1780997099.430796:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126884608 00000100:00100000:0.0:1780997099.430801:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888961b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126885248:0@lo:400:kworker.0 00000100:00100000:1.0:1780997099.430802:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126884608 00000100:00100000:0.0:1780997099.430822:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126884352:0@lo:400:kworker.0 00000100:00100000:2.0:1780997099.430827:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:0.0:1780997099.430836:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126884864:0@lo:400:kworker.0 00000100:00100000:2.0:1780997099.430837:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126884992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997099.430851:0:3497:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 2 00000100:00100000:0.0:1780997099.430862:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126885376:0@lo:400:kworker.0 00000100:00100000:1.0:1780997099.430879:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126885120 00000100:00100000:2.0:1780997099.430882:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126884992:12345-0@lo:400:kworker.0 Request processed in 44us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997099.430884:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126885120 00000100:00100000:2.0:1780997099.430893:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:1.0:1780997099.430907:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126883968 00000100:00100000:2.0:1780997099.430913:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1780997099.430919:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126883968 00000100:00100000:2.0:1780997099.430924:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126885504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997099.430945:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:1.0:1780997099.430956:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126884608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997099.430962:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126883840 00000100:00100000:2.0:1780997099.430963:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126885504:12345-0@lo:400:kworker.0 Request processed in 38us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997099.430969:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126883840 00000100:00100000:2.0:1780997099.430973:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1780997099.431006:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126884608:12345-0@lo:400:kworker.0 Request processed in 52us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997099.431012:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1780997099.431014:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997099.431019:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00000100:00100000:0.0:1780997099.431037:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126883840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997099.431049:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956 00000100:00100000:0.0:1780997099.431078:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886f34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126883840:12345-0@lo:400:kworker.0 Request processed in 57us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997099.431084:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1780997099.431120:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126885120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997099.431166:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126883840:0@lo:400:kworker.0 00000100:00080000:2.0:1780997099.431531:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997099.431536:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997099.431574:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780997099.431635:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:2.0:1780997099.431645:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126883968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780997099.431672:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1780997099.434646:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126885120:12345-0@lo:400:kworker.0 Request processed in 3520us (4723us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997099.434661:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956 00000100:00100000:2.0:1780997099.434695:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126883968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3050us (4614us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997099.434705:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00000100:00100000:0.0:1780997099.435467:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126884480:0@lo:400:kworker.0 00000100:00100000:0.0:1780997099.435507:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126884992:0@lo:400:kworker.0 00000100:00100000:0.0:1780997099.435525:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126885504:0@lo:400:kworker.0 00000100:00100000:0.0:1780997099.435537:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126884608:0@lo:400:kworker.0 00000100:00100000:0.0:1780997099.435548:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126885120:0@lo:400:kworker.0 00000100:00100000:0.0:1780997099.435563:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126884096:0@lo:400:kworker.0 00000100:00100000:0.0:1780997099.435677:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126883968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780997099.448410:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997099.448496:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110361216 00000100:00100000:0.0:1780997099.448505:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110361216 00000100:00100000:0.0:1780997099.448691:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1219 00000100:00100000:0.0:1780997099.448703:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67997:x1867507110361216:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:0.0:1780997099.448746:0:63419:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445261312 avail 1299021824 00000100:00100000:0.0:1780997099.448830:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:67997:x1867507110361216:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 129us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997099.448837:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1219 00000100:00080000:2.0:1780997099.449498:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780997099.453063:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997099.453455:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110361344 00000100:00100000:2.0:1780997099.453466:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110361344 00000100:00100000:2.0:1780997099.453614:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1220 00000100:00100000:2.0:1780997099.453625:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:67997:x1867507110361344:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:2.0:1780997099.453659:0:63418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1780997099.453735:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:67997:x1867507110361344:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 112us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997099.453757:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1220 00000100:00080000:0.0:1780997099.457632:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997099.458767:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997099.458906:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110361472 00000100:00100000:0.0:1780997099.458915:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110361472 00000100:00100000:0.0:1780997099.459005:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2030 00000100:00100000:0.0:1780997099.459016:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:67997:x1867507110361472:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1780997099.459060:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997099.459233:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:67997:x1867507110361472:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 218us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997099.459242:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2030 00000100:00080000:2.0:1780997099.460332:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997099.464379:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997099.464475:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110361600 00000100:00100000:1.0:1780997099.464486:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110361600 00000100:00100000:1.0:1780997099.464633:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2031 00000100:00100000:1.0:1780997099.464644:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:67997:x1867507110361600:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:1.0:1780997099.464678:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997099.464762:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:67997:x1867507110361600:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 119us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997099.464771:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2031 00000100:00080000:2.0:1780997099.465453:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997099.494979:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997099.495241:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110361856 00000100:00100000:2.0:1780997099.495254:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110361856 00000100:00100000:2.0:1780997099.495364:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1221 00000100:00100000:2.0:1780997099.495376:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:68013:x1867507110361856:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:2.0:1780997099.495400:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997099.495423:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a3be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b8b expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495540:0:63417:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843000/0x30fd811c0305a1db lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 9 pid: 85171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495559:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3c5 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495574:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3c5 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495585:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3c5 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495697:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3c5 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495705:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3c5 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495712:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3c5 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495732:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997099.495736:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3c5 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495744:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3c5 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495758:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff96898a563500) 00010000:00010000:2.0:1780997099.495761:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997099.495765:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3c5 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495772:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3c5 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495828:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a3be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b8b expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495840:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd900) 00010000:00010000:2.0:1780997099.495842:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780997099.495846:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a3be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b8b expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.495856:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455e00, rc 0) 00000100:00100000:2.0:1780997099.496254:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:68013:x1867507110361856:12345-192.168.206.51@tcp:101:cat.0 Request processed in 879us (1283us total) trans 107374182402 rc 301/301 00000100:00100000:2.0:1780997099.496262:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1221 00000100:00100000:0.0:1780997099.501748:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997099.501849:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110361984 00000100:00100000:2.0:1780997099.501873:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110361984 00000100:00100000:2.0:1780997099.501950:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1222 00000100:00100000:2.0:1780997099.501972:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:68013:x1867507110361984:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:2.0:1780997099.501997:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997099.502019:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a3d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b92 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.502101:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3da lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.502116:0:63419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843000/0x30fd811c0305a1db lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 10 pid: 85171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.502130:0:63419:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3da lrc: 4/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.502168:0:63419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843000/0x30fd811c0305a1db lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 10 pid: 85171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.502182:0:63419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843000/0x30fd811c0305a1db lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 10 pid: 85171 timeout: 3727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997099.502195:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63419:1867507126885632:192.168.206.51@tcp:104: 00000100:00100000:2.0:1780997099.502310:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898363b180 going to sleep for 11 seconds 00000100:00100000:3.0:1780997099.506871:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997099.507111:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110362112 00000100:00100000:1.0:1780997099.507121:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110362112 00010000:00010000:1.0:1780997099.507158:0:18812:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843000/0x30fd811c0305a1db lrc: 5/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 11 pid: 85171 timeout: 3727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997099.507202:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2557 00000100:00100000:1.0:1780997099.507226:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b620c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:2396:x1867507110362112:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780997099.507241:0:18812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:1.0:1780997099.507261:0:18812:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:1.0:1780997099.507264:0:18812:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1780997055 00000004:00010000:1.0:1780997099.507267:0:18812:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1780997048 00000004:00010000:1.0:1780997099.507303:0:18812:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1780997055 00010000:00010000:1.0:1780997099.507310:0:18812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843000/0x30fd811c0305a1db lrc: 5/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 11 pid: 85171 timeout: 3727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997099.507335:0:18812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843000/0x30fd811c0305a1db lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 11 pid: 85171 timeout: 3727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997099.507360:0:18812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff96898a563500) 00010000:00010000:1.0:1780997099.507365:0:18812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3da lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997099.507377:0:18812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3da lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997099.507384:0:18812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3da lrc: 4/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997099.507405:0:18812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997099.507468:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b620c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:2396:x1867507110362112:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 244us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997099.507475:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2557 00010000:00010000:2.0:1780997099.508480:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843000/0x30fd811c0305a1db lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b5a expref: 10 pid: 85171 timeout: 3727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997099.508503:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63419:1867507126885632:192.168.206.51@tcp:104: 00010000:00010000:2.0:1780997099.508537:0:63419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3da lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.508545:0:63419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3da lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.508550:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3da lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997099.508599:0:63419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780997099.508617:0:63419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3da lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.508646:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a3d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b92 expref: 10 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.508660:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3da lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b92 expref: 9 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.508667:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff96898a563500) 00010000:00010000:2.0:1780997099.508670:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780997099.508673:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455200, rc 0) 00000100:00100000:2.0:1780997099.508769:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:68013:x1867507110361984:12345-192.168.206.51@tcp:101:cat.0 Request processed in 6800us (7036us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997099.508777:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1222 00000100:00100000:3.0:1780997099.517721:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997099.517934:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110362240 00000100:00100000:2.0:1780997099.517945:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110362240 00000100:00100000:2.0:1780997099.518029:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1223 00000100:00100000:2.0:1780997099.518040:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:68013:x1867507110362240:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:2.0:1780997099.518080:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997099.518102:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455400/0x30fd811c0305a3e1 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8b99 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.518161:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455400/0x30fd811c0305a3e1 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b99 expref: 10 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.518175:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455400/0x30fd811c0305a3e1 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b99 expref: 10 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997099.518191:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff96898a563500) 00010000:00010000:2.0:1780997099.518194:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1780997099.518198:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455400, rc 0) 00000100:00100000:2.0:1780997099.518255:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:68013:x1867507110362240:12345-192.168.206.51@tcp:101:cat.0 Request processed in 217us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997099.518262:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1223 00000100:00100000:3.0:1780997099.524408:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997099.524558:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110362368 00000100:00100000:0.0:1780997099.524574:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110362368 00000100:00100000:0.0:1780997099.524645:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1224 00000100:00100000:0.0:1780997099.524658:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2397:x1867507110362368:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:0.0:1780997099.524683:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997099.524705:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c0305a3e8 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ba0 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997099.524748:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c0305a3e8 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ba0 expref: 11 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997099.524781:0:65272:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:0.0:1780997099.524784:0:65272:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1780997055 -> 1780997055 00000004:00010000:0.0:1780997099.524787:0:65272:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1780997048 -> 1780997048 00000004:00010000:0.0:1780997099.524789:0:65272:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1780997055 -> 1780997055 00000004:00010000:0.0:1780997099.524792:0:65272:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:0.0:1780997099.524798:0:65272:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:0.0:1780997099.524807:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c0305a3e8 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ba0 expref: 11 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997099.524821:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff96898a563500) 00010000:00010000:0.0:1780997099.524824:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1780997099.524827:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954a00, rc 0) 00000100:00100000:0.0:1780997099.524889:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:2397:x1867507110362368:12345-192.168.206.51@tcp:101:cat.0 Request processed in 235us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997099.524897:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1224 00000100:00100000:3.0:1780997099.533091:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997099.533333:0:63430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110362496 00000100:00100000:1.0:1780997099.533346:0:63430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110362496 00002000:00100000:1.0:1780997099.533410:0:63430:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9689b11ab100 x1867507110362496/t0(0) o3->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:430/0 lens 488/0 e 0 to 0 dl 1780997110 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997099.533421:0:63430:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9689b11ab100 with x1867507110362496 00000100:00100000:1.0:1780997099.533467:0:63430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:1.0:1780997099.533477:0:63430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:2396:x1867507110362496:12345-192.168.206.51@tcp:3:cat.0 00000100:00100000:1.0:1780997099.533693:0:63430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:2396:x1867507110362496:12345-192.168.206.51@tcp:3:cat.0 Request processed in 216us (612us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1780997099.533702:0:63430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00002000:00100000:1.0:1780997099.533709:0:63430:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9689b11ab100 x1867507110362496/t0(0) o3->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:430/0 lens 488/4536 e 0 to 0 dl 1780997110 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997099.533717:0:63430:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9689b11ab100 with x1867507110362496 00000100:00100000:3.0:1780997099.542099:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997099.542332:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110362752 00000100:00100000:0.0:1780997099.542345:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110362752 00000100:00100000:0.0:1780997099.542401:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:0.0:1780997099.542411:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:68013:x1867507110362752:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:0.0:1780997099.542677:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:68013:x1867507110362752:12345-192.168.206.51@tcp:35:cat.0 Request processed in 267us (587us total) trans 107374182403 rc 0/0 00000100:00100000:0.0:1780997099.542684:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:0.0:1780997099.941799:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997099.941825:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126885760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997099.941911:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997099.942008:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126885760 00000100:00100000:0.0:1780997099.942027:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126885760 00000100:00100000:0.0:1780997099.942075:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:0.0:1780997099.942085:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126885760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997099.942112:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997099.942158:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126885760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997099.942165:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00100000:0.0:1780997099.942214:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126885760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997099.942234:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997099.942240:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b0bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126885888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997099.942265:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997099.942426:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126885888 00000100:00100000:3.0:1780997099.942431:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126885888 00000100:00100000:3.0:1780997099.942468:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:3.0:1780997099.942476:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126885888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997099.942487:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997099.942526:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126885888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997099.942532:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:3.0:1780997099.942563:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b0bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126885888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997099.943562:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126886016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780997099.943607:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997099.943731:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126886016 00000100:00100000:3.0:1780997099.943737:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126886016 00000100:00100000:3.0:1780997099.943785:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:3.0:1780997099.943792:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126886016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780997099.943806:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997099.943850:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126886016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997099.943855:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:2.0:1780997099.943967:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126886016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780997099.945073:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126886144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997099.945142:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997099.945324:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126886144 00000100:00100000:1.0:1780997099.945332:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126886144 00000100:00100000:0.0:1780997099.945372:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997099.945382:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126886272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997099.945389:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:1.0:1780997099.945401:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126886144:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997099.945418:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1780997099.945430:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445261312 avail 1299021824 00000100:00100000:1.0:1780997099.945483:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126886144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997099.945491:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00000100:00100000:3.0:1780997099.945499:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126886272 00000100:00100000:3.0:1780997099.945505:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126886272 00000100:00100000:3.0:1780997099.945539:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:3.0:1780997099.945547:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126886272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780997099.945562:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997099.945593:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126886272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997099.945599:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:0.0:1780997099.945692:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126886272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780997099.945708:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126886144:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1780997100.274470:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997100.296366:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997100.296409:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997100.296443:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110363008 00000100:00100000:3.0:1780997100.296452:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110363008 00000100:00100000:3.0:1780997100.296511:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1212 00000100:00100000:3.0:1780997100.296523:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2397:x1867507110363008:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997100.296600:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2397:x1867507110363008:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997100.296607:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1212 00000100:00100000:0.0:1780997100.296655:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110362880 00000100:00100000:0.0:1780997100.296660:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110362880 00000100:00100000:0.0:1780997100.296704:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:0.0:1780997100.296711:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2397:x1867507110362880:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997100.296968:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886f35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2397:x1867507110362880:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 256us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997100.296975:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:0.0:1780997100.304155:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997100.304241:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997100.304330:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997100.304365:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110363264 00000100:00100000:0.0:1780997100.304375:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110363264 00000100:00100000:0.0:1780997100.304418:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110363392 00000100:00100000:0.0:1780997100.304421:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110363392 00000100:00100000:0.0:1780997100.304439:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2536 00000100:00100000:0.0:1780997100.304448:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110363264:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997100.304514:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110363264:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 66us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997100.304521:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2536 00000100:00100000:0.0:1780997100.304543:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2537 00000100:00100000:0.0:1780997100.304548:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110363392:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997100.304571:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110363392:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 22us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997100.304576:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2537 00000100:00100000:1.0:1780997100.309562:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110363136 00000100:00100000:1.0:1780997100.309576:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110363136 00000100:00100000:2.0:1780997100.309698:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1213 00000100:00100000:2.0:1780997100.309709:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110363136:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997100.309796:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110363136:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 89us (5652us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997100.309804:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1213 00010000:00010000:2.0:1780997101.290839:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997102.322522:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997103.335588:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997104.358841:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997104.550127:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126886784:0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.550224:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997104.550263:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888961b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126887296:0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.550316:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997104.550346:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126887808:0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.550368:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997104.550392:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1780997104.550398:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126886656:0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.550419:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997104.550434:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126887168:0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.550454:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997104.550469:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126887680:0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.550487:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997104.550515:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126886784 00000100:00100000:2.0:1780997104.550521:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126886784 00000100:00100000:2.0:1780997104.550586:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126886656 00000100:00100000:2.0:1780997104.550589:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126886656 00000100:00100000:2.0:1780997104.550609:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:2.0:1780997104.550629:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126886784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.550678:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126886784:12345-0@lo:400:kworker.0 Request processed in 52us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997104.550686:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:2.0:1780997104.550701:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1780997104.550707:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126886656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.550734:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126886656:12345-0@lo:400:kworker.0 Request processed in 26us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997104.550739:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1780997104.550779:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126887296 00000100:00100000:2.0:1780997104.550784:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126887296 00000100:00100000:2.0:1780997104.550813:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126887808 00000100:00100000:2.0:1780997104.550816:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126887808 00000100:00100000:2.0:1780997104.550834:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126887168 00000100:00100000:2.0:1780997104.550836:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126887168 00000100:00100000:0.0:1780997104.550846:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126886528:0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.550855:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126887680 00000100:00100000:2.0:1780997104.550858:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126887680 00000100:00100000:2.0:1780997104.550876:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:2.0:1780997104.550885:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126887296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997104.550895:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997104.551157:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126886400:0@lo:400:kworker.0 00000100:00100000:0.0:1780997104.551473:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126887040:0@lo:400:kworker.0 00000100:00100000:1.0:1780997104.551950:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:1.0:1780997104.551963:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126887808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.552062:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126887296:12345-0@lo:400:kworker.0 Request processed in 1177us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997104.552071:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:2.0:1780997104.552093:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:2.0:1780997104.552100:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126887168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.552139:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126887168:12345-0@lo:400:kworker.0 Request processed in 40us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997104.552145:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00100000:2.0:1780997104.552156:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:2.0:1780997104.552163:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126887680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.552212:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126887680:12345-0@lo:400:kworker.0 Request processed in 50us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997104.552217:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:2.0:1780997104.552243:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126886528 00000100:00100000:2.0:1780997104.552249:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126886528 00000100:00100000:2.0:1780997104.552306:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1780997104.552313:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126886528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.552477:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126886528:12345-0@lo:400:kworker.0 Request processed in 164us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997104.552497:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00080000:2.0:1780997104.552523:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997104.552527:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997104.552593:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997104.552596:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780997104.552650:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126886656:0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.552666:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126887168:0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.552677:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126887680:0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.552689:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126886784:0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.552699:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888961b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126887296:0@lo:400:kworker.0 00000100:00100000:3.0:1780997104.553180:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997104.553631:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126886400 00000100:00100000:2.0:1780997104.553638:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126886400 00000100:00100000:2.0:1780997104.553679:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1780997104.553687:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126886400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.553737:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886f36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126886400:12345-0@lo:400:kworker.0 Request processed in 50us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997104.553743:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1780997104.553762:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997104.553796:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126887552:0@lo:400:kworker.0 00000100:00100000:0.0:1780997104.553826:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997104.553857:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126888064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997104.553880:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997104.553933:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126887040 00000100:00100000:2.0:1780997104.553938:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126887040 00000100:00100000:2.0:1780997104.553965:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126887552 00000100:00100000:2.0:1780997104.553969:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126887552 00000100:00100000:2.0:1780997104.553981:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126888064 00000100:00100000:2.0:1780997104.553983:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126888064 00000100:00100000:2.0:1780997104.554003:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:2.0:1780997104.554009:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126887040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997104.554023:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126886528:0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.554069:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126887040:12345-0@lo:400:kworker.0 Request processed in 59us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997104.554077:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00000100:00100000:2.0:1780997104.554094:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:2.0:1780997104.554100:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126887552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997104.554127:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126887552:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997104.554133:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00000100:00100000:2.0:1780997104.554143:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:2.0:1780997104.554148:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126888064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780997104.554172:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1780997104.554210:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126888064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997104.554216:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00000100:00100000:0.0:1780997104.554399:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126888064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997104.554416:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126887040:0@lo:400:kworker.0 00000100:00100000:0.0:1780997104.554430:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126887552:0@lo:400:kworker.0 00000100:00100000:3.0:1780997104.554663:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126886400:0@lo:400:kworker.0 00000100:00100000:3.0:1780997104.554671:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126886912:0@lo:400:kworker.0 00000100:00100000:3.0:1780997104.554703:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997104.554722:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126887424:0@lo:400:kworker.0 00000100:00100000:3.0:1780997104.554744:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997104.554776:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126887936:0@lo:400:kworker.0 00000100:00100000:3.0:1780997104.554807:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997104.554861:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126886912 00000100:00100000:3.0:1780997104.554866:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126886912 00000100:00100000:3.0:1780997104.554913:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126887424 00000100:00100000:3.0:1780997104.554916:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126887424 00000100:00100000:3.0:1780997104.554931:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126887936 00000100:00100000:3.0:1780997104.554933:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126887936 00000100:00100000:3.0:1780997104.554950:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1780997104.554966:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126886912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997104.555022:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126886912:12345-0@lo:400:kworker.0 Request processed in 58us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997104.555029:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1780997104.555043:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1780997104.555049:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126887424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997104.555074:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126887424:12345-0@lo:400:kworker.0 Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997104.555080:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1780997104.555091:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1780997104.555096:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126887936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997104.555121:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507126887936:12345-0@lo:400:kworker.0 Request processed in 25us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997104.555126:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00080000:3.0:1780997104.555148:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997104.555165:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126886912:0@lo:400:kworker.0 00000100:00100000:3.0:1780997104.555175:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126887424:0@lo:400:kworker.0 00000100:00100000:3.0:1780997104.555183:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507126887936:0@lo:400:kworker.0 00000100:00100000:1.0:1780997104.558871:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126887808:12345-0@lo:400:kworker.0 Request processed in 6901us (8490us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997104.558901:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:3.0:1780997104.559102:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126887808:0@lo:400:kworker.0 00000100:00100000:1.0:1780997105.061987:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126888192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997105.062090:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997105.062163:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126888192 00000100:00100000:1.0:1780997105.062172:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126888192 00000100:00100000:0.0:1780997105.062223:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997105.062248:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:0.0:1780997105.062248:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126888320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997105.062298:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126888192:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780997105.062356:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997105.062424:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126888320 00000100:00100000:0.0:1780997105.062432:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126888320 00000100:00100000:3.0:1780997105.062499:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00002000:00000024:1.0:1780997105.062538:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997105.062592:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126888192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 329us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997105.062691:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126888320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997105.062705:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997105.062736:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126888320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 229us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997105.062810:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126888576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997105.062816:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997105.062833:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126888704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780997105.062863:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997105.062893:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997105.062903:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997105.062918:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126888448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997105.062975:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997105.063029:0:14235:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 3 min 2 max 16 00000100:00100000:0.0:1780997105.063039:0:14235:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_003' 00000100:00100000:1.0:1780997105.063439:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:1.0:1780997105.063469:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126888576 00000100:00100000:1.0:1780997105.063475:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126888576 00000100:00100000:1.0:1780997105.063495:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126888704 00000100:00100000:1.0:1780997105.063498:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126888704 00000100:00100000:1.0:1780997105.063511:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:1.0:1780997105.063518:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126888576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997105.063538:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997105.063590:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126888576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997105.063596:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00100000:1.0:1780997105.063608:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:1.0:1780997105.063614:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126888704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780997105.063702:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997105.063706:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126888448 00000100:00100000:2.0:1780997105.063716:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126888448 00000100:00100000:1.0:1780997105.063743:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126888704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997105.063765:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:2.0:1780997105.063776:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:2.0:1780997105.063788:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126888448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780997105.063831:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445261312 avail 1299021824 00000100:00100000:1.0:1780997105.063835:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126888576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997105.063885:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126888320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997105.063919:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126888192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780997105.063932:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126888448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997105.064013:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00000100:00100000:2.0:1780997105.064092:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126888448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997105.064134:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126888704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780997105.066386:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00010000:00010000:2.0:1780997105.381515:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997105.420651:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997105.420701:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997105.420719:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110363520 00000100:00100000:1.0:1780997105.420732:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110363520 00000100:00100000:0.0:1780997105.420743:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997105.420771:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997105.420792:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997105.420798:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:1.0:1780997105.420809:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2396:x1867507110363520:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997105.420815:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110364032 00000100:00100000:0.0:1780997105.420818:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110364032 00000100:00100000:0.0:1780997105.420853:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110363904 00000100:00100000:0.0:1780997105.420856:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110363904 00000100:00100000:0.0:1780997105.420879:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2542 00000100:00100000:1.0:1780997105.420883:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886f37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2396:x1867507110363520:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 76us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997105.420887:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110364032:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997105.420891:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:0.0:1780997105.420927:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110364032:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997105.420931:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2543 00000100:00100000:0.0:1780997105.420935:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2542 00000100:00100000:1.0:1780997105.420938:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110363904:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997105.420963:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2396:x1867507110363904:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997105.420969:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2543 00000100:00100000:3.0:1780997105.421344:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110363776 00000100:00100000:3.0:1780997105.421350:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110363776 00000100:00100000:3.0:1780997105.421381:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110363648 00000100:00100000:3.0:1780997105.421385:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110363648 00000100:00100000:3.0:1780997105.421418:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1220 00000100:00100000:3.0:1780997105.421427:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110363776:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997105.421466:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110363776:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 42us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997105.421473:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1220 00000100:00100000:3.0:1780997105.421488:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1221 00000100:00100000:3.0:1780997105.421494:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2396:x1867507110363648:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997105.421519:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2396:x1867507110363648:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997105.421526:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1221 00000100:00080000:3.0:1780997105.421545:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780997105.421548:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997105.421550:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780997105.421552:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1780997105.583761:0:85138:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182403 is committed 00000001:02000400:1.0:1780997106.077866:0:85852:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00010000:00010000:0.0:1780997106.405581:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997107.429618:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1780997107.717582:0:85900:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 05:25:06 (1780997106) 00000100:00100000:3.0:1780997107.794444:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997107.794532:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110364160 00000100:00100000:0.0:1780997107.794544:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110364160 00000100:00080000:3.0:1780997107.794604:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780997107.794665:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1225 00000100:00100000:0.0:1780997107.794677:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:68744:x1867507110364160:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1780997107.794703:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997107.794730:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a3ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ba7 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.794800:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a3f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.794815:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a3f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.794830:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a3f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.794847:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a3fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.794854:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a3fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.794862:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a3fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.794911:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a3f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.794919:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a3f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.794926:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a3f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.794933:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a3f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.794951:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997107.794961:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a3f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.794969:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a3f6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.794991:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd900) 00010000:00010000:0.0:1780997107.794994:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997107.794999:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a3f6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.795005:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a3f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.795084:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a3fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.795091:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a3fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.795097:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a3fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.795102:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997107.795105:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a3fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.795111:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a3fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.795119:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff968983653300) 00010000:00010000:0.0:1780997107.795122:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997107.795130:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a3fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.795136:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a3fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.795182:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a3ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ba7 expref: 11 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.795193:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd900) 00010000:00010000:0.0:1780997107.795196:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997107.795200:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a3ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ba7 expref: 11 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.795208:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955600, rc 0) 00000100:00100000:0.0:1780997107.795309:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:68744:x1867507110364160:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 634us (875us total) trans 0 rc 301/301 00000100:00100000:0.0:1780997107.795317:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1225 00000100:00100000:1.0:1780997107.801395:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997107.801478:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110364416 00000100:00100000:2.0:1780997107.801488:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110364416 00000100:00100000:2.0:1780997107.801550:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1226 00000100:00100000:2.0:1780997107.801561:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:68744:x1867507110364416:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780997107.801582:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997107.801585:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1780997107.801610:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a3a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b84 expref: 10 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.801630:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd900) 00010000:00010000:2.0:1780997107.801641:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997107.801656:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305a404 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8bae expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.801769:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a40b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.801784:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a40b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.801794:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a40b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.801808:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305a412 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.801831:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305a412 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.801838:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305a412 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804061:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305a419 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804095:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305a419 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804107:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305a419 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997107.804119:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:2.0:1780997107.804156:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a40b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804163:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a40b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804170:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a40b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804178:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a40b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804185:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997107.804191:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a40b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804210:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a40b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804222:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689896ff000) 00010000:00010000:2.0:1780997107.804225:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997107.804230:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a40b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804238:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a40b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997107.804250:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000015d88bd7 reply state 00000000e1bef582 transno 107374182404 ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305a412 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804291:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305a412 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804300:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9689a5f8ff00) 00010000:00010000:2.0:1780997107.804303:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997107.804307:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780997107.804340:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305a404 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bae expref: 12 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804364:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305a419 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bae expref: 11 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997107.804372:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689a5f8fc00) 00010000:00010000:2.0:1780997107.804374:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997107.804377:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455800, rc 0) 00000100:00100000:2.0:1780997107.804456:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:68744:x1867507110364416:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2897us (3069us total) trans 107374182404 rc 0/0 00000100:00100000:2.0:1780997107.804466:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1226 00000100:00100000:3.0:1780997107.811295:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997107.811359:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110364672 00000100:00100000:0.0:1780997107.811369:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110364672 00000100:00100000:0.0:1780997107.811429:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1227 00000100:00100000:0.0:1780997107.811440:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:68744:x1867507110364672:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1780997107.811465:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997107.811485:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a427 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8bb5 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.811726:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.811754:0:63419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305a419 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bae expref: 13 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.811763:0:63419:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.811860:0:63419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305a419 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bae expref: 13 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997107.811879:0:63419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305a419 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bae expref: 13 pid: 63418 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997107.811903:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f12300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63419:1867507126888832:192.168.206.51@tcp:104: 00000100:00100000:0.0:1780997107.812081:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc67840 going to sleep for 11 seconds 00000100:00100000:3.0:1780997107.819959:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997107.819970:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f12300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63419:1867507126888832:192.168.206.51@tcp:104: 00010000:00010000:0.0:1780997107.820011:0:63419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997107.820131:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110364800 00000100:00100000:1.0:1780997107.820138:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110364800 00010000:00010000:1.0:1780997107.820172:0:8261:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305a419 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bae expref: 14 pid: 63418 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997107.820206:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2558 00000100:00100000:1.0:1780997107.820223:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:2395:x1867507110364800:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780997107.820237:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997107.820244:0:8261:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305a419 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bae expref: 14 pid: 63418 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997107.820257:0:8261:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305a419 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bae expref: 14 pid: 63418 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997107.820303:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305a419 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bae expref: 14 pid: 63418 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997107.820317:0:8261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689a5f8fc00) 00010000:00010000:1.0:1780997107.820322:0:8261:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997107.820332:0:8261:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997107.820340:0:8261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997107.820367:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997107.820401:0:63419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997107.820417:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:2395:x1867507110364800:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 194us (468us total) trans 0 rc 0/0 00010000:00010000:3.0:1780997107.820418:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997107.820429:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2558 00000004:00200000:3.0:1780997107.820443:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00000004:00080000:3.0:1780997107.820594:0:63419:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x91:0x0], count =625 00000004:00080000:3.0:1780997107.820676:0:63419:0:(osp_object.c:1640:osp_create()) Writing gap [0x2c0000401:0x91:0x0]+625 in llog 00000004:00080000:3.0:1780997107.820714:0:63419:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x302:0x0], index 1: 0 00010000:00010000:3.0:1780997107.820821:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997107.820830:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997107.820836:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997107.820843:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997107.820847:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997107.820855:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997107.820865:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689a5f8fc00) 00010000:00010000:3.0:1780997107.820868:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780997107.820872:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997107.820878:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a42e lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997107.821011:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a427 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bb5 expref: 13 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997107.821023:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983653300) 00010000:00010000:3.0:1780997107.821026:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1780997107.821030:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a427 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bb5 expref: 13 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997107.821045:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955600, rc 0) 00000100:00100000:3.0:1780997107.821077:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:68744:x1867507110364672:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 9640us (9808us total) trans 107374182405 rc 301/301 00000100:00100000:3.0:1780997107.821085:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1227 00000100:00100000:3.0:1780997107.823802:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997107.823863:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110365056 00000100:00100000:2.0:1780997107.823874:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110365056 00000100:00100000:2.0:1780997107.823933:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 224 00000100:00100000:2.0:1780997107.823951:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:68744:x1867507110365056:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1780997107.824241:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:68744:x1867507110365056:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 291us (444us total) trans 107374182406 rc 0/0 00000100:00100000:2.0:1780997107.824250:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 224 00000100:00100000:3.0:1780997107.825848:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997107.826001:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110365312 00000100:00100000:1.0:1780997107.826009:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110365312 00000100:00100000:1.0:1780997107.826092:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:1.0:1780997107.826107:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:68744:x1867507110365312:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1780997107.826333:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:68744:x1867507110365312:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 232us (494us total) trans 107374182407 rc 0/0 00000100:00100000:1.0:1780997107.826340:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 225 00010000:00010000:3.0:1780997108.454637:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1780997108.491880:0:85138:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00010000:00010000:2.0:1780997108.497317:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305a412 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997108.497336:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305a412 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997108.497344:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305a412 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997108.497351:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997108.497356:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305a412 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997108.497364:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305a412 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997108.497382:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9689a5f8ff00) 00010000:00010000:2.0:1780997108.497385:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997108.497389:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305a412 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997108.497403:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454000/0x30fd811c0305a412 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997108.533687:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997108.533729:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110365440 00000100:00100000:3.0:1780997108.533739:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110365440 00000100:00100000:3.0:1780997108.533796:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1228 00000100:00100000:3.0:1780997108.533808:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:68754:x1867507110365440:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1780997108.533831:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997108.533854:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a43c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8bbc expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.534067:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a443 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.534093:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.534104:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997108.534149:0:65272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1780997108.534153:0:65272:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780997108.534169:0:65272:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.534194:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a43c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bbc expref: 11 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.534212:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a443 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bbc expref: 10 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.534221:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ba6a0100) 00010000:00010000:3.0:1780997108.534225:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780997108.534228:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2800, rc 0) 00000100:00100000:3.0:1780997108.534304:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:68754:x1867507110365440:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 499us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997108.534312:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1228 00000100:00100000:1.0:1780997108.540256:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997108.540354:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110365568 00000100:00100000:0.0:1780997108.540364:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110365568 00000100:00100000:0.0:1780997108.540418:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1229 00000100:00100000:0.0:1780997108.540428:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:68754:x1867507110365568:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:0.0:1780997108.540472:0:63418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445261312 avail 1299021824 00000100:00100000:0.0:1780997108.540540:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:68754:x1867507110365568:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 113us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997108.540548:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1229 00000100:00100000:3.0:1780997108.542741:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997108.542987:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110365696 00000100:00100000:0.0:1780997108.542996:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110365696 00000100:00100000:0.0:1780997108.543061:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1230 00000100:00100000:0.0:1780997108.543081:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:68754:x1867507110365696:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:0.0:1780997108.543118:0:80049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780997108.543370:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:68754:x1867507110365696:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 261us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997108.543380:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1230 00000100:00080000:0.0:1780997108.543512:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997108.546612:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997108.547065:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110365824 00000100:00100000:1.0:1780997108.547076:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110365824 00000100:00100000:1.0:1780997108.547180:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2040 00000100:00100000:1.0:1780997108.547190:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:68754:x1867507110365824:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:1.0:1780997108.547224:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997108.547309:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:68754:x1867507110365824:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 121us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997108.547318:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2040 00000100:00080000:0.0:1780997108.550413:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997108.557581:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997108.557999:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110365952 00000100:00100000:0.0:1780997108.558010:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110365952 00000100:00080000:3.0:1780997108.558062:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997108.558095:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2041 00000100:00100000:0.0:1780997108.558107:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:68754:x1867507110365952:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1780997108.558156:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997108.558227:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:68754:x1867507110365952:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 123us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997108.558234:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2041 00000100:00100000:3.0:1780997108.615325:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997108.615423:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110366208 00000100:00100000:0.0:1780997108.615434:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110366208 00000100:00100000:0.0:1780997108.615492:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1231 00000100:00100000:0.0:1780997108.615502:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:68761:x1867507110366208:12345-192.168.206.51@tcp:36:mcreate.0 00010000:00010000:0.0:1780997108.615566:0:65272:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997108.615592:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a443 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bbc expref: 10 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.615617:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ba6a0100) 00010000:00010000:0.0:1780997108.615628:0:65272:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997108.615684:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a44a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.615807:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a44a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.615819:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a44a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.615831:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a451 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.615838:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a451 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.615845:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a451 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.616418:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a44a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.616429:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a44a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.616435:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a44a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.616441:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a44a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.616454:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997108.616458:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a44a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.616466:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a44a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.616475:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983653c00) 00010000:00010000:0.0:1780997108.616478:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997108.616482:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a44a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.616489:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a44a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997108.616502:0:65272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d63e791 reply state 0000000043fcb6f5 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a451 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.616512:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a451 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.616518:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff968983653e00) 00010000:00010000:0.0:1780997108.616520:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997108.616522:0:65272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997108.616661:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:68761:x1867507110366208:12345-192.168.206.51@tcp:36:mcreate.0 Request processed in 1158us (1341us total) trans 107374182408 rc 0/0 00000100:00100000:0.0:1780997108.616669:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1231 00000100:00100000:2.0:1780997108.658425:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997108.658659:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110366336 00000100:00100000:0.0:1780997108.658670:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110366336 00000100:00100000:0.0:1780997108.658747:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1232 00000100:00100000:0.0:1780997108.658768:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:68764:x1867507110366336:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1780997108.658797:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997108.658819:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8bc3 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.659155:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a45f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.659172:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a45f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.659184:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a45f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997108.659236:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780997108.659239:0:63418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997108.659361:0:63418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a45f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.659391:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bc3 expref: 13 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.659408:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a45f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bc3 expref: 12 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.659417:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983653c00) 00010000:00010000:0.0:1780997108.659420:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780997108.659423:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954800, rc 0) 00000100:00100000:0.0:1780997108.659491:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:68764:x1867507110366336:12345-192.168.206.51@tcp:101:rm.0 Request processed in 725us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997108.659506:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1232 00000100:00100000:1.0:1780997108.670070:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997108.670146:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110366464 00000100:00100000:3.0:1780997108.670155:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110366464 00000100:00100000:3.0:1780997108.670215:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1233 00000100:00100000:3.0:1780997108.670223:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:68764:x1867507110366464:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:3.0:1780997108.670243:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997108.670261:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a466 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8bca expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670337:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a46d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670350:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a46d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670360:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a46d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670368:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a474 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670375:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670382:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670454:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a47b lrc: 3/1,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670461:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a47b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670468:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a47b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997108.670777:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0xa:0x0]: returning size 0 00000004:00200000:3.0:1780997108.670781:0:80049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780997108.670801:0:80049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a47b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670814:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a47b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670822:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a46d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670828:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a46d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670836:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a46d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670842:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997108.670846:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a46d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670853:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a46d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670865:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983653c00) 00010000:00010000:3.0:1780997108.670867:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997108.670872:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a46d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670879:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a46d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670897:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670903:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a474 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670909:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a474 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670913:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997108.670916:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a474 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670922:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a474 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670928:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff968983653e00) 00010000:00010000:3.0:1780997108.670930:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997108.670933:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a474 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670938:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a474 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670960:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a466 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bca expref: 14 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670981:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a47b lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bca expref: 13 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997108.670997:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9689ba6a0000) 00010000:00010000:3.0:1780997108.670999:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780997108.671002:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2800, rc 0) 00000100:00100000:3.0:1780997108.671102:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:68764:x1867507110366464:12345-192.168.206.51@tcp:101:rm.0 Request processed in 879us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997108.671109:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1233 00000100:00100000:0.0:1780997108.697885:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997108.697921:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110366720 00000100:00100000:0.0:1780997108.697931:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110366720 00000100:00100000:0.0:1780997108.697998:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1234 00000100:00100000:0.0:1780997108.698009:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:68764:x1867507110366720:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:0.0:1780997108.698062:0:65272:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1780997108.698092:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a47b lrc: 0/0,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bca expref: 13 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698110:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9689ba6a0000) 00010000:00010000:0.0:1780997108.698130:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954800/0x30fd811c0305a45f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bc3 expref: 12 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698141:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983653c00) 00010000:00010000:0.0:1780997108.698148:0:65272:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997108.698170:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a482 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698185:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a482 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698196:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a482 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698209:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a489 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698234:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a489 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698243:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a489 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698354:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c0305a490 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698363:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c0305a490 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698371:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c0305a490 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698564:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a497 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698573:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a497 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698582:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a497 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698590:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a497 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698598:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a497 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698605:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a497 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698635:0:65272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997108.698656:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c0305a490 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698664:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c0305a490 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698670:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c0305a490 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698677:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997108.698683:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c0305a490 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698691:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c0305a490 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698702:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff968983653d00) 00010000:00010000:0.0:1780997108.698705:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1780997108.698709:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c0305a490 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698715:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c0305a490 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698732:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a482 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698739:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a482 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698744:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a482 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698756:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a482 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698761:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997108.698764:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a482 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698770:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a482 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698779:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968983653600) 00010000:00010000:0.0:1780997108.698781:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997108.698784:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a482 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698791:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955600/0x30fd811c0305a482 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997108.698803:0:65272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ee8a4a5 reply state 0000000031c11846 transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a489 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698815:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a489 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698821:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff968983653e00) 00010000:00010000:0.0:1780997108.698824:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997108.698826:0:65272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997108.698907:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:68764:x1867507110366720:12345-192.168.206.51@tcp:36:rm.0 Request processed in 899us (1030us total) trans 107374182409 rc 0/0 00000100:00100000:0.0:1780997108.698916:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1234 00010000:00010000:0.0:1780997108.698950:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997108.698956:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a497 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698961:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997108.698964:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a497 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698987:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a497 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.698995:0:14480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff968983653d00) 00010000:00010000:0.0:1780997108.698997:0:14480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1780997108.698999:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a497 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.699005:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a497 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997108.699015:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997108.699017:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997108.699019:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997109.479231:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997109.670224:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126888960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997109.670312:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997109.670364:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126888960 00000100:00100000:2.0:1780997109.670371:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126888960 00000100:00100000:2.0:1780997109.670417:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963 00000100:00100000:2.0:1780997109.670428:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bf8c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126888960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780997109.670461:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1780997109.670487:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126889344:0@lo:400:kworker.0 00000100:00100000:2.0:1780997109.670499:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bf8c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126888960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997109.670508:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963 00000100:00100000:1.0:1780997109.670533:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997109.670562:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126889856:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.670591:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997109.670616:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126890368:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.670643:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997109.670670:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1780997109.670678:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126889472:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.670705:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997109.670725:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126889984:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.670759:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997109.670780:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126890496:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.670801:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997109.670838:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126889088:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.670865:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997109.670901:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126889600:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.670924:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997109.670943:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126890112:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.670974:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997109.670994:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1780997109.670999:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507126889216:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.671019:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997109.671035:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126889728:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.671057:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997109.671074:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126890240:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.671092:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997109.671121:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126889344 00000100:00100000:1.0:1780997109.671125:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126889344 00000100:00100000:1.0:1780997109.671157:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126889472 00000100:00100000:1.0:1780997109.671160:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126889472 00000100:00100000:1.0:1780997109.671176:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126890496 00000100:00100000:1.0:1780997109.671178:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126890496 00000100:00100000:1.0:1780997109.671190:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126889600 00000100:00100000:1.0:1780997109.671192:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126889600 00000100:00100000:1.0:1780997109.671204:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126890112 00000100:00100000:1.0:1780997109.671206:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126890112 00000100:00100000:1.0:1780997109.671216:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126889216 00000100:00100000:1.0:1780997109.671224:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126889216 00000100:00100000:2.0:1780997109.671243:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1780997109.671251:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:2.0:1780997109.671256:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126889344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.671264:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507126889472:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780997109.671302:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a5689180 x1867507126889472/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:440/0 lens 224/224 e 0 to 0 dl 1780997120 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997109.671319:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126889344:12345-0@lo:400:kworker.0 Request processed in 67us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997109.671327:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1780997109.671343:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507126889472:12345-0@lo:400:kworker.0 Request processed in 82us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997109.671349:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1780997109.671356:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:2.0:1780997109.671361:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126890496:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780997109.671373:0:63419:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a568ad80 x1867507126890496/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:440/0 lens 224/224 e 0 to 0 dl 1780997120 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997109.671381:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:1.0:1780997109.671394:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126889600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997109.671410:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126890496:12345-0@lo:400:kworker.0 Request processed in 52us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997109.671426:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1780997109.671440:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126889600:12345-0@lo:400:kworker.0 Request processed in 48us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997109.671578:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:2.0:1780997109.671589:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126890112:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780997109.671600:0:63419:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a5689500 x1867507126890112/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:440/0 lens 224/224 e 0 to 0 dl 1780997120 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997109.671631:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126890112:12345-0@lo:400:kworker.0 Request processed in 44us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997109.671953:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:1.0:1780997109.671985:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:1.0:1780997109.671993:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507126889216:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780997109.672006:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a568aa00 x1867507126889216/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:440/0 lens 224/224 e 0 to 0 dl 1780997120 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997109.672035:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507126889216:12345-0@lo:400:kworker.0 Request processed in 43us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997109.672041:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:1.0:1780997109.672062:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126889856 00000100:00100000:1.0:1780997109.672067:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126889856 00000100:00100000:1.0:1780997109.672094:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126890368 00000100:00100000:1.0:1780997109.672098:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126890368 00000100:00100000:1.0:1780997109.672112:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126889984 00000100:00100000:1.0:1780997109.672114:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126889984 00000100:00100000:1.0:1780997109.672128:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126890240 00000100:00100000:1.0:1780997109.672135:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126890240 00000100:00100000:1.0:1780997109.672153:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:1.0:1780997109.672158:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126889856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672186:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126889856:12345-0@lo:400:kworker.0 Request processed in 28us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997109.672192:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:1.0:1780997109.672201:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:1.0:1780997109.672205:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126890368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672226:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126890368:12345-0@lo:400:kworker.0 Request processed in 21us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997109.672231:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00100000:1.0:1780997109.672239:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:1.0:1780997109.672244:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126889984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672262:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126889984:12345-0@lo:400:kworker.0 Request processed in 19us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997109.672267:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:1.0:1780997109.672368:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547 00000100:00100000:1.0:1780997109.672375:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126890240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672400:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126890240:12345-0@lo:400:kworker.0 Request processed in 27us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997109.672405:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547 00000100:00100000:1.0:1780997109.672432:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126889088 00000100:00100000:1.0:1780997109.672435:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126889088 00000100:00100000:1.0:1780997109.672457:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1780997109.672462:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126889088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672486:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126889088:12345-0@lo:400:kworker.0 Request processed in 24us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997109.672497:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1780997109.672531:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126889728 00000100:00100000:1.0:1780997109.672534:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126889728 00000100:00100000:1.0:1780997109.672552:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964 00000100:00100000:1.0:1780997109.672558:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126889728:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780997109.672569:0:8241:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a5688000 x1867507126889728/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:440/0 lens 224/224 e 0 to 0 dl 1780997120 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997109.672592:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126889728:12345-0@lo:400:kworker.0 Request processed in 34us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997109.672597:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964 00000100:00080000:1.0:1780997109.672613:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997109.672616:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997109.672618:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780997109.672621:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997109.672668:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126888960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780997109.672695:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507126889216:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672703:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126889728:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672712:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126890240:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672719:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126889088:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672727:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126889600:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672735:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126890112:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672764:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126889472:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672781:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126889984:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672790:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126890496:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672799:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126889344:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672808:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126889856:0@lo:400:kworker.0 00000100:00100000:1.0:1780997109.672816:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126890368:0@lo:400:kworker.0 00000100:00100000:2.0:1780997109.673130:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:1.0:1780997110.184057:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126890624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997110.184144:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997110.184181:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997110.184189:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126890752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997110.184213:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997110.184339:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126890624 00000100:00100000:1.0:1780997110.184345:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126890624 00000100:00100000:1.0:1780997110.184393:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:1.0:1780997110.184403:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126890624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780997110.184426:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997110.184480:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126890624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997110.184488:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00100000:1.0:1780997110.184517:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126890752 00000100:00100000:1.0:1780997110.184520:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126890752 00000100:00100000:1.0:1780997110.184552:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965 00000100:00100000:1.0:1780997110.184559:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126890752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780997110.184598:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445261312 avail 1299021824 00010000:00000080:1.0:1780997110.184621:0:23042:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a568b800 x1867507126890752/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:441/0 lens 224/368 e 0 to 0 dl 1780997121 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997110.184652:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126890752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997110.184658:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965 00000100:00100000:1.0:1780997110.184679:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126890880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997110.184707:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997110.184737:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126890880 00000100:00100000:1.0:1780997110.184741:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126890880 00000100:00100000:1.0:1780997110.184766:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:1.0:1780997110.184773:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126890880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997110.184783:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997110.184815:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126890880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997110.184822:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:1.0:1780997110.184867:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126890752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997110.184883:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126890624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997110.184936:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126890880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997110.185211:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126891008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997110.185238:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997110.185859:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126891008 00000100:00100000:3.0:1780997110.185865:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126891008 00000100:00100000:1.0:1780997110.185913:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126891136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997110.185943:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997110.185954:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126891136 00000100:00100000:3.0:1780997110.185957:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126891136 00000100:00100000:3.0:1780997110.185989:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:3.0:1780997110.185996:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126891008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780997110.186011:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997110.186051:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126891008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997110.186057:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:3.0:1780997110.186070:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:3.0:1780997110.186075:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126891136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997110.186084:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997110.186119:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126891136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997110.186125:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00100000:1.0:1780997110.186126:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126891008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780997110.186181:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126891136:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1780997110.501596:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997110.535251:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997110.535381:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997110.535394:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110366976 00000100:00100000:0.0:1780997110.535457:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997110.535493:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110366976 00000100:00100000:0.0:1780997110.535494:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997110.535526:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997110.535560:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110367104 00000100:00100000:1.0:1780997110.535565:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110367104 00000100:00100000:3.0:1780997110.535575:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110366848 00000100:00100000:3.0:1780997110.535581:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110366848 00000100:00100000:3.0:1780997110.535613:0:85149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:3.0:1780997110.535621:0:85149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110366848:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997110.535849:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1228 00000100:00100000:1.0:1780997110.535858:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:2394:x1867507110366976:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997110.535866:0:85149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110366848:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 242us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997110.535876:0:85149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00010000:00000080:1.0:1780997110.535893:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b7f10700 x1867507110366976/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:441/0 lens 224/224 e 0 to 0 dl 1780997121 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997110.535925:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:2394:x1867507110366976:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997110.535933:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1228 00000100:00100000:1.0:1780997110.535951:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1229 00000100:00100000:1.0:1780997110.535971:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110367104:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997110.536000:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110367104:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 42us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997110.536006:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1229 00000100:00080000:1.0:1780997110.536030:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997110.536034:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780997110.543087:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110367232 00000100:00100000:3.0:1780997110.543101:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110367232 00000100:00100000:3.0:1780997110.543283:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110367360 00000100:00100000:3.0:1780997110.543289:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110367360 00000100:00100000:0.0:1780997110.543402:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2548 00000100:00100000:0.0:1780997110.543416:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110367232:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:1.0:1780997110.543502:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997110.543507:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997110.543667:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2549 00000100:00100000:3.0:1780997110.543676:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110367360:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997110.543747:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110367232:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 335us (8377us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997110.543755:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2548 00000100:00100000:3.0:1780997110.543822:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2394:x1867507110367360:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 146us (8293us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997110.543829:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2549 00010000:00010000:3.0:1780997111.527016:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997112.555200:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997113.573538:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1780997114.277668:0:85138:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182409 is committed 00010000:00010000:0.0:1780997114.278570:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a451 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.278584:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a451 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.278592:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a451 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.278598:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997114.278603:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a451 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.278610:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a451 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.278624:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff968983653e00) 00010000:00010000:0.0:1780997114.278627:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997114.278631:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a451 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.278636:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305a451 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.278651:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a489 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.278670:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a489 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.278676:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a489 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.278681:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997114.278684:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a489 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.278690:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a489 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.278697:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff968983653e00) 00010000:00010000:0.0:1780997114.278699:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997114.278702:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a489 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.278707:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305a489 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.599326:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1780997114.670948:0:86295:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1780997114.765704:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997114.768129:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110367488 00000100:00100000:1.0:1780997114.768144:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110367488 00000100:00100000:1.0:1780997114.768230:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1235 00000100:00100000:1.0:1780997114.768240:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:68831:x1867507110367488:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1780997114.768259:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997114.768300:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a49e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8bd1 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997114.768374:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f400/0x30fd811c0305a4a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997114.768387:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f400/0x30fd811c0305a4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997114.768397:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f400/0x30fd811c0305a4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997114.768517:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780997114.768521:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780997114.768540:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f400/0x30fd811c0305a4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997114.768563:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a49e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bd1 expref: 11 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997114.768578:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f400/0x30fd811c0305a4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bd1 expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997114.768588:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968990709900) 00010000:00010000:1.0:1780997114.768591:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780997114.768595:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956f400, rc 0) 00010000:00000080:1.0:1780997114.768602:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b7f12d80 x1867507110367488/t0(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:445/0 lens 576/688 e 0 to 0 dl 1780997125 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997114.768671:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:68831:x1867507110367488:12345-192.168.206.51@tcp:101:dd.0 Request processed in 433us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997114.768679:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1235 00000100:00080000:2.0:1780997114.768869:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997114.774818:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997114.774889:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110367744 00000100:00100000:3.0:1780997114.774898:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110367744 00000100:00100000:3.0:1780997114.774954:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1236 00000100:00100000:3.0:1780997114.774963:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:68831:x1867507110367744:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997114.774984:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997114.774987:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1780997114.775013:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f400/0x30fd811c0305a4a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bd1 expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775028:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff968990709900) 00010000:00010000:3.0:1780997114.775038:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997114.775051:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a4ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8bd8 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775173:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a4b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775186:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775196:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775207:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a4ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775213:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a4ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775220:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a4ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775529:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a4c1 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775538:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a4c1 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775545:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a4c1 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997114.775553:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:3.0:1780997114.775635:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a4b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775642:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a4b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775653:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a4b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775660:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a4b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775666:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997114.775670:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a4b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775677:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a4b3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775685:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ba6a0800) 00010000:00010000:3.0:1780997114.775687:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997114.775692:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a4b3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775698:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a4b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775707:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a4ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775713:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a4ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775718:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a4ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775723:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997114.775729:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a4ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775736:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a4ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775742:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9689ba6a0400) 00010000:00010000:3.0:1780997114.775744:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997114.775747:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a4ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775752:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a4ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775786:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a4ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bd8 expref: 12 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775798:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a4c1 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bd8 expref: 11 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.775805:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689ba6a0c00) 00010000:00010000:3.0:1780997114.775806:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780997114.775809:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2400, rc 0) 00010000:00000080:3.0:1780997114.775815:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a5689f80 x1867507110367744/t107374182410(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:445/0 lens 776/848 e 0 to 0 dl 1780997125 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997114.776016:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:68831:x1867507110367744:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1052us (1206us total) trans 107374182410 rc 0/0 00000100:00100000:3.0:1780997114.776025:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1236 00000100:00100000:1.0:1780997114.785330:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997114.785644:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110367872 00000100:00100000:2.0:1780997114.785655:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110367872 00000100:00100000:2.0:1780997114.785710:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1237 00000100:00100000:2.0:1780997114.785722:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:68831:x1867507110367872:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997114.785745:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997114.785766:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305a4cf lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8bdf expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.785802:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305a4d6 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.785817:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305a4d6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.785830:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305a4d6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.786093:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305a4cf lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bdf expref: 13 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.786110:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305a4d6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bdf expref: 12 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.786120:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689ba6a0c00) 00010000:00010000:2.0:1780997114.786122:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780997114.786126:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455a00, rc 0) 00010000:00000080:2.0:1780997114.786134:0:80049:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a568b480 x1867507110367872/t0(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:445/0 lens 568/1344 e 0 to 0 dl 1780997125 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997114.786209:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:68831:x1867507110367872:12345-192.168.206.51@tcp:101:dd.0 Request processed in 490us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997114.786217:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1237 00000100:00100000:1.0:1780997114.789740:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126891264:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.789818:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997114.789875:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126891776:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.789913:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997114.789931:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507126892288:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.789967:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997114.789986:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507126892800:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.790005:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997114.790030:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1780997114.790036:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126891648:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.790058:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997114.790074:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126892160:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.790096:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997114.790114:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126892672:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.790142:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997114.790180:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126891392:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.790208:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997114.790230:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126891904:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.790256:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997114.790296:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126892416:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.790318:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997114.790340:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1780997114.790365:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126891520:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.790394:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997114.790417:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126892032:0@lo:400:kworker.0 00000100:00100000:0.0:1780997114.790433:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126891776 00000100:00100000:0.0:1780997114.790442:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126891776 00000100:00100000:0.0:1780997114.790488:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126892288 00000100:00100000:0.0:1780997114.790492:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126892288 00000100:00100000:0.0:1780997114.790503:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126892800 00000100:00100000:0.0:1780997114.790506:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126892800 00000100:00100000:0.0:1780997114.790515:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126891648 00000100:00100000:0.0:1780997114.790523:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126891648 00000100:00100000:0.0:1780997114.790539:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126891392 00000100:00100000:0.0:1780997114.790542:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126891392 00000100:00100000:0.0:1780997114.790553:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126891520 00000100:00100000:0.0:1780997114.790555:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126891520 00000100:00100000:0.0:1780997114.790570:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:0.0:1780997114.790579:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126891776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997114.790640:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126891776:12345-0@lo:400:kworker.0 Request processed in 61us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997114.790649:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:0.0:1780997114.790669:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1780997114.790677:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3497:x1867507126892288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.790684:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:0.0:1780997114.790696:0:65272:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc115180 x1867507126892288/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:445/0 lens 224/224 e 0 to 0 dl 1780997125 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997114.790707:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126892544:0@lo:400:kworker.0 00000100:00100000:0.0:1780997114.790732:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3497:x1867507126892288:12345-0@lo:400:kworker.0 Request processed in 56us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997114.790739:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997114.790741:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1780997114.790758:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1780997114.790765:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507126892800:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780997114.790776:0:65272:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc114e00 x1867507126892800/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:445/0 lens 224/224 e 0 to 0 dl 1780997125 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997114.790778:0:85143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126891264 00000100:00100000:1.0:1780997114.790783:0:85143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126891264 00000100:00100000:0.0:1780997114.790811:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507126892800:12345-0@lo:400:kworker.0 Request processed in 47us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997114.790818:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1780997114.790827:0:85143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1780997114.790839:0:85143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96899673b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126891264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997114.790839:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1780997114.790850:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126891648:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780997114.790874:0:65272:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc115500 x1867507126891648/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:445/0 lens 224/224 e 0 to 0 dl 1780997125 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997114.791369:0:85143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96899673b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126891264:12345-0@lo:400:kworker.0 Request processed in 533us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997114.791376:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126891648:12345-0@lo:400:kworker.0 Request processed in 527us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997114.791381:0:85143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1780997114.791389:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1780997114.791408:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1780997114.791416:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507126891392:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780997114.791428:0:65272:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b11e7100 x1867507126891392/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:445/0 lens 224/224 e 0 to 0 dl 1780997125 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997114.791456:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507126891392:12345-0@lo:400:kworker.0 Request processed in 42us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997114.791462:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1780997114.791473:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1780997114.791479:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126891520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997114.791506:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126891520:12345-0@lo:400:kworker.0 Request processed in 27us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997114.791511:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00080000:0.0:1780997114.791527:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780997114.791531:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997114.791540:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126892160 00000100:00100000:0.0:1780997114.791545:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126892160 00000100:00100000:1.0:1780997114.791585:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126892672 00000100:00100000:0.0:1780997114.791586:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126892032 00000100:00100000:1.0:1780997114.791591:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126892672 00000100:00100000:0.0:1780997114.791592:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126892032 00000100:00100000:1.0:1780997114.791628:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126892544 00000100:00100000:1.0:1780997114.791633:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126892544 00000100:00100000:0.0:1780997114.791639:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:0.0:1780997114.791649:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126892160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.791661:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:1.0:1780997114.791670:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126892672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997114.791686:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126892160:12345-0@lo:400:kworker.0 Request processed in 39us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997114.791702:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:1.0:1780997114.791710:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126892672:12345-0@lo:400:kworker.0 Request processed in 41us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997114.791717:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:0.0:1780997114.791722:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:0.0:1780997114.791731:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126892032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.791735:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:1.0:1780997114.791746:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126892544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997114.791776:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126892032:12345-0@lo:400:kworker.0 Request processed in 46us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997114.791784:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126892544:12345-0@lo:400:kworker.0 Request processed in 39us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997114.791785:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00100000:1.0:1780997114.791804:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:1.0:1780997114.791833:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126891904 00000100:00100000:1.0:1780997114.791837:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126891904 00000100:00100000:1.0:1780997114.791986:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126892416 00000100:00100000:1.0:1780997114.791990:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126892416 00000100:00100000:1.0:1780997114.792009:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966 00000100:00100000:1.0:1780997114.792015:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126891904:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780997114.792029:0:8241:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b11e6680 x1867507126891904/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:445/0 lens 224/224 e 0 to 0 dl 1780997125 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997114.792055:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126891904:12345-0@lo:400:kworker.0 Request processed in 41us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997114.792061:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00000100:00100000:1.0:1780997114.792072:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967 00000100:00100000:1.0:1780997114.792077:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126892416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.792099:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126892416:12345-0@lo:400:kworker.0 Request processed in 23us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997114.792104:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967 00000100:00100000:1.0:1780997114.792126:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780997114.792136:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126892928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780997114.792164:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997114.792201:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126892928 00000100:00100000:1.0:1780997114.792204:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126892928 00000100:00100000:1.0:1780997114.792224:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968 00000100:00100000:1.0:1780997114.792244:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126892928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780997114.792288:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1780997114.792323:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126892928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997114.792337:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968 00000100:00100000:1.0:1780997114.792391:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126892928:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1780997114.792525:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780997114.792535:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997114.792619:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126891520:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.792635:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126892032:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.792645:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126892544:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.792657:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126891392:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.792667:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126891904:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.792676:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126892416:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.792727:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126891648:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.792739:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126892160:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.792750:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126892672:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.792760:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126891264:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.792770:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126891776:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.792780:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507126892288:0@lo:400:kworker.0 00000100:00100000:1.0:1780997114.792790:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507126892800:0@lo:400:kworker.0 00000100:00100000:3.0:1780997114.793410:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997114.794004:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110368128 00000100:00100000:1.0:1780997114.794015:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110368128 00000100:00100000:1.0:1780997114.794077:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1238 00000100:00100000:1.0:1780997114.794087:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:68831:x1867507110368128:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:1.0:1780997114.794135:0:65272:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997114.794158:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a4c1 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bd8 expref: 12 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997114.794175:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689ba6a0c00) 00010000:00010000:1.0:1780997114.794179:0:65272:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780997114.794379:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a4dd lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997114.794393:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a4dd lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997114.794404:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a4dd lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780997114.794604:0:65272:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 107374182411 00000004:00010000:1.0:1780997114.794626:0:65272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000062441057 reply state 0000000092dddae2 transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a4dd lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997114.794638:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a4dd lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997114.794645:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689ba6a0c00) 00010000:00010000:1.0:1780997114.794648:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997114.794650:0:65272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1780997114.794679:0:65272:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a5c47b80 x1867507110368128/t107374182412(0) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:445/0 lens 488/456 e 0 to 0 dl 1780997125 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997114.794771:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:68831:x1867507110368128:12345-192.168.206.51@tcp:36:dd.0 Request processed in 685us (1364us total) trans 107374182412 rc 0/0 00000100:00100000:1.0:1780997114.794778:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1238 00000020:00080000:1.0:1780997114.794788:0:65272:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1780997114.797380:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997114.797435:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110368256 00000100:00100000:3.0:1780997114.797445:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110368256 00000100:00100000:3.0:1780997114.797496:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1239 00000100:00100000:3.0:1780997114.797506:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+14:68831:x1867507110368256:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997114.797528:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997114.797548:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a4e4 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8be6 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.797602:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a4e4 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8be6 expref: 15 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.797617:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a4e4 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8be6 expref: 15 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997114.797634:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689ba6a0c00) 00010000:00010000:3.0:1780997114.797637:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780997114.797640:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3c00, rc 0) 00010000:00000080:3.0:1780997114.797647:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a5c46680 x1867507110368256/t0(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:445/0 lens 376/584 e 0 to 0 dl 1780997125 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997114.797702:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+15:68831:x1867507110368256:12345-192.168.206.51@tcp:101:dd.0 Request processed in 198us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997114.797709:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1239 00000100:00100000:0.0:1780997114.801067:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997114.801100:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110368512 00000100:00100000:0.0:1780997114.801108:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110368512 00000100:00100000:0.0:1780997114.801150:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1240 00000100:00100000:0.0:1780997114.801158:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+15:68831:x1867507110368512:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997114.801177:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997114.801181:0:80049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1780997114.801206:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a4e4 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8be6 expref: 15 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.801220:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689ba6a0c00) 00010000:00010000:0.0:1780997114.801226:0:80049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997114.801251:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c0305a4eb lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8bed expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.801316:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a4f2 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.801329:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a4f2 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.801338:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a4f2 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780997114.801461:0:80049:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x283:0x0], count =127 00000004:00080000:0.0:1780997114.801469:0:80049:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000400:0x283:0x0]+127 in llog 00000004:00080000:0.0:1780997114.801494:0:80049:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000400:0x302:0x0], index 0: 0 00000004:00080000:0.0:1780997114.801500:0:80049:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x303:0x0], index 1: 0 00010000:00010000:0.0:1780997114.801581:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a4f2 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bed expref: 17 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.801589:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689ba6a0c00) 00010000:00010000:0.0:1780997114.801591:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1780997114.801599:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02000/0x30fd811c0305a4eb lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bed expref: 17 pid: 80049 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.801614:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a4f2 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bed expref: 16 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.801640:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689ba6a0c00) 00010000:00010000:0.0:1780997114.801643:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1780997114.801645:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02600, rc 0) 00010000:00000080:0.0:1780997114.801652:0:80049:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b7f10e00 x1867507110368512/t107374182413(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:445/0 lens 376/608 e 0 to 0 dl 1780997125 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997114.801719:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+16:68831:x1867507110368512:12345-192.168.206.51@tcp:101:dd.0 Request processed in 562us (658us total) trans 107374182413 rc 0/0 00000100:00100000:0.0:1780997114.801727:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1240 00000100:00100000:0.0:1780997114.806083:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997114.806123:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110368640 00000100:00100000:0.0:1780997114.806135:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110368640 00000100:00100000:0.0:1780997114.806207:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5935 00000100:00100000:0.0:1780997114.806216:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:68831:x1867507110368640:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997114.806246:0:25181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997114.806267:0:25181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305a4f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8bf4 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997114.806311:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997114.806335:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997114.806337:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997114.806348:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305a4f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bf4 expref: 6 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.806710:0:25181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305a4f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bf4 expref: 6 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997114.806729:0:25181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03c00, rc 0) 00000100:00100000:0.0:1780997114.806998:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:68831:x1867507110368640:12345-192.168.206.51@tcp:101:dd.0 Request processed in 781us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997114.807006:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5935 00000100:00080000:0.0:1780997114.807548:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997114.811457:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997114.811540:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110368768 00000100:00100000:2.0:1780997114.811550:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110368768 00000100:00100000:2.0:1780997114.811624:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5936 00000100:00100000:2.0:1780997114.811634:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:68831:x1867507110368768:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997114.811652:0:8232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997114.811673:0:8232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912e0680/0x30fd811c0305a500 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8bfb expref: -99 pid: 8232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997114.811700:0:8232:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997114.811724:0:8232:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997114.811726:0:8232:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997114.811746:0:8232:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912e0680/0x30fd811c0305a500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bfb expref: 6 pid: 8232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.811765:0:8232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000912e0680/0x30fd811c0305a500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bfb expref: 6 pid: 8232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.811777:0:8232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454200, rc 0) 00000100:00100000:2.0:1780997114.811833:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:68831:x1867507110368768:12345-192.168.206.51@tcp:101:dd.0 Request processed in 200us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997114.811841:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5936 00000100:00080000:3.0:1780997114.811998:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997114.814654:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997114.814754:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110368896 00000100:00100000:2.0:1780997114.814766:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110368896 00000100:00100000:2.0:1780997114.814828:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5937 00000100:00100000:2.0:1780997114.814838:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:68831:x1867507110368896:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997114.814856:0:25182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997114.814881:0:25182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c0305a507 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c02 expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997114.814906:0:25182:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997114.814929:0:25182:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997114.814931:0:25182:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997114.814950:0:25182:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c0305a507 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c02 expref: 7 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.814965:0:25182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c0305a507 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c02 expref: 7 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.814995:0:25182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454400, rc 0) 00000100:00100000:2.0:1780997114.815062:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:68831:x1867507110368896:12345-192.168.206.51@tcp:101:dd.0 Request processed in 225us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997114.815069:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5937 00000100:00100000:2.0:1780997114.821378:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997114.821589:0:24144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110369024 00000100:00100000:1.0:1780997114.821599:0:24144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110369024 00002000:00010000:1.0:1780997114.821646:0:24144:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/770 (1048576->18446744073709551615) 00002000:00100000:1.0:1780997114.821652:0:24144:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff968888607b80 with x1867507110369024 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1780997114.821664:0:24144:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff968888607b80. 00000100:00100000:1.0:1780997114.821708:0:24144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1000 00000100:00100000:1.0:1780997114.821717:0:24144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110369024:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:1.0:1780997114.821959:0:24144:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1780997114.821963:0:24144:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb mtime from disk: 0 -> 1780997114 00002000:00010000:1.0:1780997114.821966:0:24144:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1780997114.821968:0:24144:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb ctime from disk: 0 -> 1780997114 00002000:00010000:1.0:1780997114.821969:0:24144:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1780997114.822043:0:24144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110369024:12345-192.168.206.51@tcp:10:dd.0 Request processed in 326us (677us total) trans 4294969452 rc 0/0 00000100:00100000:1.0:1780997114.822052:0:24144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1000 00002000:00010000:1.0:1780997114.822056:0:24144:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/770 (1048576->18446744073709551615) 00002000:00100000:1.0:1780997114.822058:0:24144:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff968888607b80 with x1867507110369024 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1780997114.822062:0:24144:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff968888607b80. 00000100:00100000:3.0:1780997114.822753:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997114.823855:0:24143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110369152 00000100:00100000:1.0:1780997114.823878:0:24143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110369152 00002000:00010000:1.0:1780997114.823912:0:24143:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/771 (0->18446744073709551615) 00002000:00100000:1.0:1780997114.823916:0:24143:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689a5c46300 with x1867507110369152 ext(0->18446744073709551615) 00002000:00010000:1.0:1780997114.823926:0:24143:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9689a5c46300. 00000100:00100000:1.0:1780997114.823959:0:24143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1001 00000100:00100000:1.0:1780997114.823981:0:24143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110369152:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:1.0:1780997114.824151:0:24143:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1780997114.824155:0:24143:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb mtime from disk: 0 -> 1780997114 00002000:00010000:1.0:1780997114.824157:0:24143:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1780997114.824159:0:24143:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb ctime from disk: 0 -> 1780997114 00002000:00010000:1.0:1780997114.824162:0:24143:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1780997114.824265:0:24143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2394:x1867507110369152:12345-192.168.206.51@tcp:10:dd.0 Request processed in 285us (1513us total) trans 4294969452 rc 0/0 00000100:00100000:1.0:1780997114.824294:0:24143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1001 00002000:00010000:1.0:1780997114.824299:0:24143:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/771 (0->18446744073709551615) 00002000:00100000:1.0:1780997114.824301:0:24143:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689a5c46300 with x1867507110369152 ext(0->18446744073709551615) 00002000:00010000:1.0:1780997114.824306:0:24143:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9689a5c46300. 00000100:00100000:3.0:1780997114.931166:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997114.931358:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110369408 00000100:00100000:1.0:1780997114.931369:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110369408 00000100:00100000:1.0:1780997114.931435:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 226 00000100:00100000:1.0:1780997114.931445:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+16:68831:x1867507110369408:12345-192.168.206.51@tcp:35:dd.0 00000001:00080000:1.0:1780997114.931674:0:63421:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 107374182414 00010000:00000080:1.0:1780997114.931728:0:63421:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a5c47800 x1867507110369408/t107374182415(0) o35->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:445/0 lens 392/456 e 0 to 0 dl 1780997125 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997114.931792:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+18:68831:x1867507110369408:12345-192.168.206.51@tcp:35:dd.0 Request processed in 349us (636us total) trans 107374182415 rc 0/0 00000100:00100000:1.0:1780997114.931800:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 226 00000020:00080000:1.0:1780997114.931805:0:63421:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1780997114.990099:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997114.990185:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110369536 00000100:00100000:1.0:1780997114.990195:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110369536 00000100:00100000:1.0:1780997114.990256:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1241 00000100:00100000:2.0:1780997114.990635:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+18:68832:x1867507110369536:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780997114.990662:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997114.990685:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305a50e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c09 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.990754:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a515 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.990768:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a515 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.990779:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a515 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997114.990824:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780997114.990827:0:63419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780997114.990845:0:63419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a515 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.990868:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454800/0x30fd811c0305a50e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c09 expref: 20 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.990897:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a515 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c09 expref: 19 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997114.990906:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689a5f8f900) 00010000:00010000:2.0:1780997114.990909:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780997114.990914:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455000, rc 0) 00010000:00000080:2.0:1780997114.990922:0:63419:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a5c45c00 x1867507110369536/t0(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:445/0 lens 576/688 e 0 to 0 dl 1780997125 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997114.991007:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+19:68832:x1867507110369536:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 584us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997114.996772:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1241 00000100:00100000:2.0:1780997115.000470:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997115.000551:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110369792 00000100:00100000:3.0:1780997115.000561:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110369792 00000100:00100000:3.0:1780997115.000623:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1242 00000100:00100000:3.0:1780997115.000633:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+19:68832:x1867507110369792:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1780997115.000653:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997115.000672:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a51c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c10 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000745:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a523 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000759:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a523 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000770:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a523 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000783:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a52a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000789:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a52a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000795:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a52a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000870:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a523 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000878:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a523 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000896:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a523 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000901:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a523 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000906:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997115.000910:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a523 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000916:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a523 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000927:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689a5f8f900) 00010000:00010000:3.0:1780997115.000930:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997115.000944:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a523 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000950:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a523 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000963:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a52a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000969:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a52a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000975:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a52a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000981:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997115.000990:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a52a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.000997:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a52a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.001004:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9689ba6a0800) 00010000:00010000:3.0:1780997115.001007:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997115.001011:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a52a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.001015:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a52a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.001048:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a51c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c10 expref: 20 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.001057:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689a5f8f900) 00010000:00010000:3.0:1780997115.001059:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1780997115.001063:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a51c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c10 expref: 20 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.001071:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3600, rc 0) 00010000:00000080:3.0:1780997115.001079:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968888605f80 x1867507110369792/t0(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:446/0 lens 800/608 e 0 to 0 dl 1780997126 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997115.001143:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+19:68832:x1867507110369792:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 512us (684us total) trans 0 rc 301/301 00000100:00100000:3.0:1780997115.001151:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1242 00000100:00100000:3.0:1780997115.006859:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997115.007710:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110369920 00000100:00100000:0.0:1780997115.007723:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110369920 00000100:00100000:0.0:1780997115.007792:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1243 00000100:00100000:0.0:1780997115.007804:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+19:68832:x1867507110369920:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1780997115.007900:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a531 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.007916:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.007946:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.007962:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a538 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.007970:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.007976:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008069:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305a53f lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008078:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305a53f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008085:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305a53f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997115.008122:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:0.0:1780997115.008126:0:80049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997115.008139:0:80049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305a53f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008151:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008158:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a531 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008184:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a531 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008189:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997115.008193:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a531 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008201:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a531 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008212:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689a5f8f900) 00010000:00010000:0.0:1780997115.008215:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997115.008220:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a531 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008226:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008240:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008246:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a538 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008252:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008256:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997115.008259:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008328:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a538 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008337:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff968983653100) 00010000:00010000:0.0:1780997115.008339:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997115.008342:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a538 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008349:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a538 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008364:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305a53f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008370:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305a53f lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008375:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305a53f lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008380:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997115.008383:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305a53f lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008389:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305a53f lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008397:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689ba6a0c00) 00010000:00010000:0.0:1780997115.008399:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997115.008402:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305a53f lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.008417:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305a53f lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1780997115.008442:0:80049:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a5c47480 x1867507110369920/t0(0) o34->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:446/0 lens 472/728 e 0 to 0 dl 1780997126 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997115.008519:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+19:68832:x1867507110369920:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 717us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997115.008526:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1243 00000100:00100000:2.0:1780997115.052635:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997115.052828:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110370176 00000100:00100000:0.0:1780997115.052839:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110370176 00000100:00100000:0.0:1780997115.052905:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1244 00000100:00100000:0.0:1780997115.052915:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+19:68834:x1867507110370176:12345-192.168.206.51@tcp:101:md5sum.0 00010000:00010000:0.0:1780997115.052950:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997115.052978:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305a546 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c17 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053046:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a54d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053060:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a54d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053071:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a54d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053087:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a554 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053117:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053124:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053263:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305a55b lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053311:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305a55b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053319:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305a55b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997115.053328:0:65272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00010000:00010000:0.0:1780997115.053411:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a54d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053534:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a54d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053543:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a54d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053550:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a54d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053556:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997115.053560:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a54d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053580:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a54d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053592:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689a5f8f900) 00010000:00010000:0.0:1780997115.053595:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997115.053599:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a54d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053606:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305a54d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053619:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053625:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a554 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053632:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a554 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053638:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997115.053640:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a554 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053646:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a554 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053654:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff968983653100) 00010000:00010000:0.0:1780997115.053656:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997115.053658:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a554 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053673:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305a554 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053731:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305a546 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c17 expref: 22 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053745:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305a55b lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c17 expref: 21 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997115.053753:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689ba6a0c00) 00010000:00010000:0.0:1780997115.053755:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780997115.053757:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03400, rc 0) 00010000:00000080:0.0:1780997115.053765:0:65272:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968888604700 x1867507110370176/t107374182416(0) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:446/0 lens 800/872 e 0 to 0 dl 1780997126 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997115.055704:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+21:68834:x1867507110370176:12345-192.168.206.51@tcp:101:md5sum.0 Request processed in 2779us (3067us total) trans 107374182416 rc 0/0 00000100:00100000:0.0:1780997115.055717:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1244 00000100:00100000:1.0:1780997115.071585:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997115.071695:0:23858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110370304 00000100:00100000:0.0:1780997115.071707:0:23858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110370304 00002000:00100000:0.0:1780997115.071760:0:23858:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x302:0x0] (0->32767) req@ffff9689ad8b1500 x1867507110370304/t0(0) o3->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:446/0 lens 488/0 e 0 to 0 dl 1780997126 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997115.071771:0:23858:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689ad8b1500 with x1867507110370304 ext(0->32767) 00002000:00010000:0.0:1780997115.071778:0:23858:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9689ad8b1500 00000100:00100000:0.0:1780997115.071814:0:23858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1002 00000100:00100000:0.0:1780997115.071825:0:23858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2396:x1867507110370304:12345-192.168.206.51@tcp:3:md5sum.0 00000100:00100000:0.0:1780997115.073946:0:23858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2396:x1867507110370304:12345-192.168.206.51@tcp:3:md5sum.0 Request processed in 2106us (2354us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997115.073958:0:23858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1002 00002000:00100000:0.0:1780997115.073969:0:23858:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x302:0x0] (0->32767) req@ffff9689ad8b1500 x1867507110370304/t0(0) o3->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:446/0 lens 488/440 e 0 to 0 dl 1780997126 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997115.073978:0:23858:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689ad8b1500 with x1867507110370304 ext(0->32767) 00002000:00010000:0.0:1780997115.073983:0:23858:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9689ad8b1500 00000100:00100000:3.0:1780997115.084413:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997115.084532:0:23856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110370432 00000100:00100000:2.0:1780997115.084544:0:23856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110370432 00002000:00100000:2.0:1780997115.084589:0:23856:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x302:0x0] (32768->1048575) req@ffff9689a5c45f80 x1867507110370432/t0(0) o3->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:446/0 lens 488/0 e 0 to 0 dl 1780997126 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780997115.084600:0:23856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689a5c45f80 with x1867507110370432 ext(32768->1048575) 00002000:00010000:2.0:1780997115.084606:0:23856:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9689a5c45f80 00000100:00100000:2.0:1780997115.084637:0:23856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1003 00000100:00100000:2.0:1780997115.084647:0:23856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2397:x1867507110370432:12345-192.168.206.51@tcp:3:md5sum.0 00000100:00100000:2.0:1780997115.089400:0:23856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2397:x1867507110370432:12345-192.168.206.51@tcp:3:md5sum.0 Request processed in 4742us (4987us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997115.089416:0:23856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1003 00002000:00100000:2.0:1780997115.089450:0:23856:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x302:0x0] (32768->1048575) req@ffff9689a5c45f80 x1867507110370432/t0(0) o3->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:446/0 lens 488/440 e 0 to 0 dl 1780997126 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780997115.089462:0:23856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689a5c45f80 with x1867507110370432 ext(32768->1048575) 00002000:00010000:2.0:1780997115.089470:0:23856:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9689a5c45f80 00000100:00100000:1.0:1780997115.125457:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997115.125728:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110370688 00000100:00100000:3.0:1780997115.125739:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110370688 00000100:00100000:3.0:1780997115.125808:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 227 00000100:00100000:3.0:1780997115.125819:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+21:68834:x1867507110370688:12345-192.168.206.51@tcp:35:md5sum.0 00010000:00000080:3.0:1780997115.126068:0:63421:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968887e06300 x1867507110370688/t107374182417(0) o35->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:446/0 lens 392/456 e 0 to 0 dl 1780997126 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997115.126131:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+22:68834:x1867507110370688:12345-192.168.206.51@tcp:35:md5sum.0 Request processed in 314us (683us total) trans 107374182417 rc 0/0 00000100:00100000:3.0:1780997115.126139:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 227 00000100:00100000:3.0:1780997115.141742:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997115.141801:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997115.141992:0:8237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110370816 00000100:00100000:0.0:1780997115.142003:0:8237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110370816 00002000:00100000:0.0:1780997115.142055:0:8237:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x302:0x0] (1048576->2097151) req@ffff9689a5c44700 x1867507110370816/t0(0) o4->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:446/0 lens 488/0 e 0 to 0 dl 1780997126 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997115.142066:0:8237:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689a5c44700 with x1867507110370816 ext(1048576->2097151) 00002000:00010000:0.0:1780997115.142072:0:8237:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689a5c44700 00000100:00100000:0.0:1780997115.142111:0:8237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1004 00000100:00100000:0.0:1780997115.142121:0:8237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110370816:12345-192.168.206.51@tcp:4:md5sum.0 00000100:00100000:1.0:1780997115.143698:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110370944 00000100:00100000:1.0:1780997115.143710:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110370944 00000100:00100000:1.0:1780997115.143761:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5938 00000100:00100000:1.0:1780997115.143769:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:2394:x1867507110370944:12345-192.168.206.51@tcp:16:kworker.0 00000001:00080000:0.0:1780997115.154055:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969452 is committed 00000100:00100000:1.0:1780997115.154536:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2394:x1867507110370944:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 10760us (12726us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997115.154548:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5938 00000100:00100000:2.0:1780997115.173492:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997115.174490:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110371072 00000100:00100000:3.0:1780997115.174501:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110371072 00000100:00100000:3.0:1780997115.174639:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1245 00000100:00100000:3.0:1780997115.174660:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+22:68836:x1867507110371072:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:3.0:1780997115.174737:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a569 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.174757:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.174770:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.174786:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a570 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.174794:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.174814:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.174904:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a577 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.174915:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a577 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.174923:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a577 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997115.174976:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:3.0:1780997115.174981:0:63584:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780997115.174994:0:63584:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a577 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175007:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a569 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175014:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a569 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175021:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a569 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175028:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a569 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175034:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997115.175038:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a569 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175053:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a569 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175066:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689a5f8f900) 00010000:00010000:3.0:1780997115.175069:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997115.175074:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a569 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175080:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3600/0x30fd811c0305a569 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175095:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175101:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a570 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175107:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a570 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175112:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997115.175115:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a570 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175121:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a570 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175129:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9689ba6a0800) 00010000:00010000:3.0:1780997115.175132:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997115.175135:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a570 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175151:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2800/0x30fd811c0305a570 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175166:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a577 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175172:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a577 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175178:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a577 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175184:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997115.175187:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a577 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175192:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a577 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175200:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689ba6a0c00) 00010000:00010000:3.0:1780997115.175202:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997115.175204:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a577 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997115.175210:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3200/0x30fd811c0305a577 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1780997115.175232:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bb525880 x1867507110371072/t0(0) o34->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:446/0 lens 472/728 e 0 to 0 dl 1780997126 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997115.175362:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+22:68836:x1867507110371072:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 706us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997115.175376:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1245 00000100:00100000:0.0:1780997115.201880:0:8237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2394:x1867507110370816:12345-192.168.206.51@tcp:4:md5sum.0 Request processed in 59745us (60130us total) trans 4294969453 rc 0/0 00000100:00100000:0.0:1780997115.201896:0:8237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1004 00002000:00100000:0.0:1780997115.201911:0:8237:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x302:0x0] (1048576->2097151) req@ffff9689a5c44700 x1867507110370816/t4294969453(0) o4->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:446/0 lens 488/448 e 0 to 0 dl 1780997126 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997115.201920:0:8237:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689a5c44700 with x1867507110370816 ext(1048576->2097151) 00002000:00010000:0.0:1780997115.201926:0:8237:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689a5c44700 00000100:00100000:1.0:1780997115.301979:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126893056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997115.302057:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997115.302115:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126893056 00000100:00100000:1.0:1780997115.302122:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126893056 00000100:00100000:1.0:1780997115.302170:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:1.0:1780997115.302179:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126893056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997115.302210:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997115.302265:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126893056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997115.302291:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00100000:1.0:1780997115.302531:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126893056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997115.302997:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997115.303009:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126893440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997115.303052:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997115.304599:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126893440 00000100:00100000:3.0:1780997115.304610:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126893440 00000100:00100000:3.0:1780997115.304664:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:3.0:1780997115.304674:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126893440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997115.304697:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17088320 pending 1073152 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997115.304769:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126893440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997115.304776:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00100000:0.0:1780997115.305000:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997115.305017:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126893568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780997115.305064:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997115.305514:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126893440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997115.305611:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126893184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997115.305646:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997115.305679:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997115.305686:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126893312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997115.305711:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997115.305767:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126893568 00000100:00100000:1.0:1780997115.305772:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126893568 00000100:00100000:1.0:1780997115.305801:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126893312 00000100:00100000:1.0:1780997115.305804:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126893312 00000100:00100000:1.0:1780997115.305819:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:1.0:1780997115.305825:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126893568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780997115.305840:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17088320 pending 1073152 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997115.305892:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126893568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997115.305899:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:1.0:1780997115.305913:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:1.0:1780997115.305919:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126893312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780997115.305939:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997115.305980:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126893312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997115.305986:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:1.0:1780997115.306021:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126893568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997115.306048:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126893312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780997115.306609:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126893184 00000100:00100000:0.0:1780997115.306615:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126893184 00000100:00100000:0.0:1780997115.306657:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00100000:0.0:1780997115.306664:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126893184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780997115.306690:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445261312 avail 1299021824 00010000:00000080:0.0:1780997115.306706:0:23042:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9688858b3100 x1867507126893184/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:446/0 lens 224/368 e 0 to 0 dl 1780997126 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997115.306758:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126893184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997115.306764:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00000100:00100000:2.0:1780997115.306901:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126893184:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1780997115.625048:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997115.654075:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997115.654198:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997115.657183:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110371328 00000100:00100000:0.0:1780997115.657199:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110371328 00000100:00100000:3.0:1780997115.657341:0:85149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110371200 00000100:00100000:3.0:1780997115.657348:0:85149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110371200 00000100:00100000:0.0:1780997115.657459:0:85144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:0.0:1780997115.657472:0:85144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96899673a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110371200:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997115.657567:0:85144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96899673a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110371200:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 98us (3369us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997115.657576:0:85144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:2.0:1780997115.657818:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1236 00000100:00100000:2.0:1780997115.657829:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110371328:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997115.657867:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110371328:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 41us (3803us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997115.657874:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1236 00000100:00080000:0.0:1780997115.658112:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1780997116.646129:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1780997117.207829:0:86392:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1780997117.207884:0:86392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.207900:0:86392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.207909:0:86392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.207916:0:86392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.207960:0:86392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1780997117.207965:0:86392:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1780997117.207992:0:86392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1780997117.208008:0:86392:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1780997117.208014:0:86392:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1780997117.208042:0:86392:0:(import.c:65:import_set_state_nolock()) ffff9689ba670800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1780997117.208106:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126893696:0@lo:39:umount.0 00000100:00100000:1.0:1780997117.208174:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997117.208305:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126893696 00000100:00100000:0.0:1780997117.208314:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126893696 00000100:00100000:0.0:1780997117.208371:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:0.0:1780997117.208380:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1867507126893696:12345-0@lo:39:umount.0 00000020:00000080:0.0:1780997117.208404:0:65272:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a1aa 00000100:00080000:0.0:1780997117.208425:0:65272:0:(import.c:65:import_set_state_nolock()) ffff9689bcc11800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1780997117.208454:0:65272:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc117b80 x1867507126893696/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:448/0 lens 224/224 e 0 to 0 dl 1780997128 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1780997117.208584:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997117.208592:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.208600:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842000 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997117.208604:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.208624:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997117.208631:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997117.208636:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1780997117.208639:0:6340:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1780997117.208641:0:6340:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1780997117.208670:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.208677:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997117.208707:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.208714:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc842000/0x30fd811c0305a08b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a092 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.208727:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997117.208729:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997117.208731:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997117.208737:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997117.208745:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997117.208755:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126893824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997117.208788:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997117.208828:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126893824 00000100:00100000:2.0:1780997117.208832:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126893824 00000100:00100000:2.0:1780997117.208870:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:2.0:1780997117.208879:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126893824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997117.208896:0:18812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997117.208911:0:18812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb3000/0x30fd811c0305a092 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a08b expref: 23 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.208943:0:18812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997117.208973:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3497:x1867507126893824:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997117.208981:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:2.0:1780997117.209023:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126893824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997117.209189:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3495:x1867507126893696:12345-0@lo:39:umount.0 Request processed in 811us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997117.209197:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000020:00000080:0.0:1780997117.209205:0:65272:0:(genops.c:906:class_export_put()) final put ffff9689bcc14000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1780997117.209326:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcc14000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1780997117.209382:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bcc11800 for lustre-MDT0000 00000100:00080000:1.0:1780997117.209500:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ba670800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1780997117.209546:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126893696:0@lo:39:umount.0 00000100:00080000:3.0:1780997117.209587:0:86392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1780997117.209591:0:86392:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1780997117.209594:0:86392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1780997117.210678:0:86392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.210693:0:86392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.210701:0:86392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.210707:0:86392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.210765:0:86392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997117.210772:0:86392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.210778:0:86392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.210783:0:86392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.210807:0:86392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.210836:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997117.210842:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.210849:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842600 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997117.210852:0:37626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.210860:0:37626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997117.210867:0:37626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997117.210872:0:37626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1780997117.210874:0:37626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1780997117.210906:0:37626:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.210912:0:37626:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1780997117.210976:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126893952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997117.211032:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997117.211115:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126893952 00000100:00100000:1.0:1780997117.211123:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126893952 00000100:00100000:1.0:1780997117.211168:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1780997117.211176:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3497:x1867507126893952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997117.211195:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997117.211208:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb3e00/0x30fd811c03059fb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059fab expref: 22 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997117.211221:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997117.211296:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.211304:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc842600/0x30fd811c03059fab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059fb2 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.211315:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997117.211318:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.211324:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2a00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997117.211327:0:37626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.211334:0:37626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997117.211340:0:37626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997117.211345:0:37626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1780997117.211347:0:37626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1780997117.211361:0:37626:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.211367:0:37626:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997117.211384:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.211391:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997117.211392:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997117.211401:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997117.211417:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126894080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997117.211447:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997117.211489:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126894080 00000100:00100000:2.0:1780997117.211493:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126894080 00000100:00100000:2.0:1780997117.211523:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1780997117.211531:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3498:x1867507126894080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997117.211540:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997117.211550:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc842400/0x30fd811c0305a0bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a0b5 expref: 22 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.211560:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997117.211587:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3498:x1867507126894080:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997117.211595:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1780997117.211636:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126894080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997117.211707:0:86392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1780997117.211712:0:86392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a0b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a0bc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997117.211721:0:86392:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1780997117.211729:0:86392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.211736:0:86392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.211742:0:86392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.211748:0:86392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.211759:0:86392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997117.211764:0:86392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.211772:0:86392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.211778:0:86392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.211791:0:86392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.211801:0:86392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1780997117.211805:0:86392:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1780997117.211808:0:86392:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1780997117.211840:0:86392:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1780997117.211844:0:86392:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1780997117.211848:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1780997117.211853:0:86392:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1780997117.212947:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997117.212956:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.212966:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc843200 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997117.212970:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.212978:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997117.212985:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997117.213003:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1780997117.213006:0:14480:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1780997117.213009:0:14480:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1780997117.213046:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.213052:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997117.213076:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.213084:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc843200/0x30fd811c0305a07d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a084 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.213096:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997117.213100:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.213104:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dac00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997117.213106:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.213112:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997117.213117:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997117.213122:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1780997117.213124:0:14480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1780997117.213125:0:14480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1780997117.213146:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.213152:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1780997117.213954:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3497:x1867507126893952:12345-0@lo:103:ldlm_bl.0 Request processed in 2773us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997117.213966:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000004:00000080:3.0:1780997117.214297:0:86392:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1780997117.214704:0:85138:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182417 is committed 00010000:00010000:3.0:1780997117.214771:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a4dd lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.214781:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a4dd lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.214788:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a4dd lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.214793:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956fc00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997117.214798:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a4dd lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.214805:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a4dd lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.214819:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689ba6a0c00) 00010000:00010000:3.0:1780997117.214822:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997117.214827:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a4dd lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997117.214845:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fc00/0x30fd811c0305a4dd lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1780997117.214904:0:86392:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1780997117.214912:0:86392:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689bcc15000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1780997117.214918:0:86392:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689bd36c800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1780997117.214931:0:86392:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689bd36a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1780997117.214936:0:86392:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff968990f71800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1780997117.214942:0:86392:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff968990f72000 285c134c-d3a6-4c01-bb4d-8148c50d5f95 192.168.206.51@tcp 12 (0 0 7) 0 0 0 0: 0000000000000000 107374182417 stale:0 00000020:00080000:3.0:1780997117.214948:0:86392:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff968886ec4d40) has exports, disconnecting them 00000020:00080000:3.0:1780997117.214952:0:86392:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689bcc15000), last request at 1780997089 00000020:00000080:3.0:1780997117.214962:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a1a3 00000100:00080000:3.0:1780997117.214971:0:86392:0:(import.c:65:import_set_state_nolock()) ffff9689bcc17000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1780997117.215000:0:86392:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bcc15000): rc 0 00000020:00000080:3.0:1780997117.215002:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689bcc15000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1780997117.215015:0:86392:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689bd36c800), last request at 1780997114 00000020:00000080:3.0:1780997117.215018:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a19c 00000100:00080000:3.0:1780997117.215022:0:86392:0:(import.c:65:import_set_state_nolock()) ffff9689b0b69800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1780997117.215028:0:86392:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bd36c800): rc 0 00000020:00000080:3.0:1780997117.215029:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689bd36c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1780997117.215033:0:86392:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689bd36a800), last request at 1780997114 00000020:00000080:3.0:1780997117.215036:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a195 00000100:00080000:3.0:1780997117.215039:0:86392:0:(import.c:65:import_set_state_nolock()) ffff9689bd36a000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1780997117.215044:0:86392:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bd36a800): rc 0 00000020:00000080:3.0:1780997117.215045:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689bd36a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1780997117.215057:0:86392:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff968990f71800), last request at 1780997083 00000020:00000080:3.0:1780997117.215065:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059fff 00000100:00080000:3.0:1780997117.215078:0:86392:0:(import.c:65:import_set_state_nolock()) ffff9689b0b6b800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1780997117.215114:0:86392:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff968990f71800): rc 0 00000020:00000080:3.0:1780997117.215116:0:86392:0:(genops.c:906:class_export_put()) final put ffff968990f71800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1780997117.215121:0:86392:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.206.51@tcp (ffff968990f72000), last request at 1780997115 00000020:00000080:3.0:1780997117.215124:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059ff8 00000020:00010000:3.0:1780997117.215130:0:86392:0:(genops.c:1942:obd_stale_export_put()) Put export ffff968990f72000: total 4 00000100:00080000:3.0:1780997117.215133:0:86392:0:(import.c:65:import_set_state_nolock()) ffff9689bc969000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1780997117.215138:0:86392:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.206.51@tcp (ffff968990f72000): rc 0 00000004:00000080:3.0:1780997117.215145:0:86392:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa8c8c4ef3ae0 00000100:00080000:3.0:1780997117.215166:0:86392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1780997117.215170:0:86392:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1780997117.216022:0:86392:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1780997117.216053:0:86392:0:(import.c:65:import_set_state_nolock()) ffff9689a67f5800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1780997117.216102:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126894464:0@lo:39:umount.0 00000100:00100000:3.0:1780997117.216181:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997117.216342:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126894464 00000100:00100000:3.0:1780997117.216351:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126894464 00000100:00100000:3.0:1780997117.216409:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970 00000100:00100000:3.0:1780997117.216420:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126894464:12345-0@lo:39:umount.0 00000020:00000080:3.0:1780997117.216454:0:80061:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a030 00000100:00080000:3.0:1780997117.216463:0:80061:0:(import.c:65:import_set_state_nolock()) ffff9689bfab4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780997117.216481:0:80061:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378731 00000100:00100000:3.0:1780997117.216670:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3495:x1867507126894464:12345-0@lo:39:umount.0 Request processed in 250us (487us total) trans 81604378732 rc 0/0 00000100:00100000:3.0:1780997117.216678:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00000100:00080000:3.0:1780997117.216746:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689a67f5800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1780997117.216753:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126894464:0@lo:39:umount.0 00000100:00080000:3.0:1780997117.216822:0:86392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1780997117.216825:0:86392:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 3 00000004:00080000:3.0:1780997117.216837:0:86392:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:3.0:1780997117.216910:0:86392:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1780997117.216939:0:86392:0:(import.c:65:import_set_state_nolock()) ffff9689bfa9b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1780997117.216950:0:86392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1780997117.216953:0:86392:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 3 00000004:00080000:3.0:1780997117.216971:0:86392:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780997117.217050:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126894592:0@lo:9:umount.0 00000100:00100000:3.0:1780997117.217088:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780997117.217115:0:86392:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1780997117.217125:0:86392:0:(import.c:65:import_set_state_nolock()) ffff9689bfa9f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1780997117.217140:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126894720:0@lo:9:umount.0 00000100:00100000:3.0:1780997117.217161:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1780997117.217227:0:86392:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff968886ec4d40) has no exports 00010000:00010000:2.0:1780997117.217332:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.217344:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96898d6dac00/0x30fd811c03059f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c03059fa4 expref: -99 pid: 85137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997117.217370:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126894592 00000100:00100000:2.0:1780997117.217375:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126894592 00000100:00100000:2.0:1780997117.217423:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126894720 00000100:00100000:2.0:1780997117.217426:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126894720 00000100:00100000:2.0:1780997117.217449:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5939 00000100:00100000:2.0:1780997117.217457:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126894592:12345-0@lo:9:umount.0 00000020:00000080:2.0:1780997117.217476:0:25178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a05a 00000100:00080000:2.0:1780997117.217483:0:25178:0:(import.c:65:import_set_state_nolock()) ffff9689bc85f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1780997117.217520:0:25178:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:2.0:1780997117.217644:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+2:3495:x1867507126894592:12345-0@lo:9:umount.0 Request processed in 188us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997117.217650:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5939 00000100:00100000:2.0:1780997117.217665:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5940 00000100:00100000:2.0:1780997117.217671:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126894720:12345-0@lo:9:umount.0 00000020:00000080:2.0:1780997117.217682:0:25178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a068 00000100:00080000:2.0:1780997117.217687:0:25178:0:(import.c:65:import_set_state_nolock()) ffff9689bc969800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1780997117.217704:0:25178:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:2.0:1780997117.217772:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+2:3495:x1867507126894720:12345-0@lo:9:umount.0 Request processed in 101us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997117.217790:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5940 00000100:00100000:2.0:1780997117.217816:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126894208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997117.217845:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997117.217889:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126894336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997117.217913:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997117.217960:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126894208 00000100:00100000:2.0:1780997117.217965:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126894208 00000100:00100000:2.0:1780997117.217995:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126894336 00000100:00100000:2.0:1780997117.217998:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126894336 00000100:00100000:2.0:1780997117.218015:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1780997117.218022:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3499:x1867507126894208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997117.218032:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997117.218048:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc843600/0x30fd811c0305a084 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a07d expref: 21 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.218061:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997117.218086:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3499:x1867507126894208:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997117.218092:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1780997117.218104:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1780997117.218110:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3496:x1867507126894336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997117.218121:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997117.218129:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888955400/0x30fd811c03059fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c03059f9d expref: 19 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.218138:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997117.218170:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3496:x1867507126894336:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997117.218176:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1780997117.218207:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126894208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997117.218229:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126894336:0@lo:103:ldlm_bl.0 00000020:00010000:2.0:1780997117.218241:0:6339:0:(genops.c:1928:obd_stale_export_get()) Get export ffff968990f72000: total 4 00010000:00010000:2.0:1780997117.218244:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997117.218291:0:6339:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff968990f72000, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1780997117.218324:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c0305a3e8 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ba0 expref: 8 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.218343:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305a4d6 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bdf expref: 7 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.218356:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305a4f2 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bed expref: 6 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.218369:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305a515 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c09 expref: 5 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.218389:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455400/0x30fd811c0305a3e1 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b99 expref: 4 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.218400:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305a55b lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c17 expref: 3 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.218413:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305a3da lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b92 expref: 2 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997117.218434:0:6339:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff968990f72000, canceled 7 locks, left on hash table 0. 00010000:00010000:1.0:1780997117.220998:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780997117.221068:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997117.221076:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780997117.221189:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126893952:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1780997117.221346:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcc15000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1780997117.221398:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bd36c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1780997117.221422:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bd36a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1780997117.221437:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff968990f71800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1780997117.221463:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bcc17000 for lustre-MDT0000 00000020:00000080:0.0:1780997117.221468:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689b0b69800 for lustre-MDT0000 00000020:00000080:0.0:1780997117.221471:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bd36a000 for lustre-MDT0000 00000020:00000080:0.0:1780997117.221474:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689b0b6b800 for lustre-MDT0000 00000020:00080000:3.0:1780997117.221890:0:86392:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff968886ec4d40) has no exports 00010000:00010000:0.0:1780997117.224366:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997117.224591:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997117.224594:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997117.224596:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1780997117.246088:0:6339:0:(genops.c:906:class_export_put()) final put ffff968990f72000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000100:00080000:2.0:1780997117.248074:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bfa9f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1780997117.248099:0:3495:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:2.0:1780997117.248101:0:3495:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997117.248107:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126894720:0@lo:9:umount.0 00000100:00080000:2.0:1780997117.248121:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bfa9b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1780997117.248132:0:3495:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:2.0:1780997117.248134:0:3495:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997117.248136:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126894592:0@lo:9:umount.0 00010000:00010000:2.0:1780997117.248167:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997117.248170:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997117.248172:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780997117.249347:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968990f72000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-MDT0000 00000020:00000080:0.0:1780997117.253107:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bc969000 for lustre-MDT0000 00000020:00000080:3.0:1780997117.265569:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a014 00000020:00000080:3.0:1780997117.265586:0:86392:0:(genops.c:906:class_export_put()) final put ffff968986169800/lustre-QMT0000_UUID 00000020:01000000:3.0:1780997117.265640:0:86392:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1780997117.265722:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997117.265733:0:86392:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1780997117.265738:0:86392:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff968990fe0000) has no exports 00000020:00000080:2.0:1780997117.266028:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a00d 00000020:00000080:2.0:1780997117.266033:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689bc85f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780997117.266110:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968986169800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1780997117.266191:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc85f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1780997117.266259:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780997117.266423:0:86392:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1780997117.266428:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689b1067000/lustre-QMT0000_UUID 00000020:00000080:2.0:1780997117.266431:0:86392:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b1067000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1780997117.266439:0:86392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1780997117.266568:0:86392:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968888e7f4e0 - data ffff9689ae245438/ffff9689bff59800 00000020:01000000:2.0:1780997117.266699:0:86392:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9689bb4f6480 - data ffff9689aee16d80/ffff968987103c00 00000100:00080000:2.0:1780997117.305729:0:86392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780997117.305739:0:86392:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1780997117.305755:0:86392:0:(client.c:3169:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9689a5c47100 x1867507126894464/t81604378732(81604378732) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997127 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997117.305801:0:86392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1780997117.309402:0:86392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780997117.309412:0:86392:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 4 00000004:00080000:2.0:1780997117.309482:0:86392:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997117.309485:0:86392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1780997117.311969:0:85156:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1780997117.311991:0:85156:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:0.0:1780997117.312003:0:85156:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:2.0:1780997117.312671:0:86392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780997117.312677:0:86392:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 4 00000004:00080000:2.0:1780997117.312687:0:86392:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997117.312690:0:86392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1780997117.313009:0:85158:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1780997117.313014:0:85158:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:1.0:1780997117.313026:0:85158:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:2.0:1780997117.313885:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059fc7 00000020:00000080:2.0:1780997117.313895:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689ba41d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1780997117.314650:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059fe3 00000020:00000080:2.0:1780997117.314658:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689bca59800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780997117.314664:0:86392:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1780997117.314669:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997117.314678:0:86392:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1780997117.314682:0:86392:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff968886ec3380) has no exports 00000004:01000000:2.0:1780997117.314835:0:86392:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1780997117.314843:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a061 00000020:00000080:2.0:1780997117.314847:0:86392:0:(genops.c:906:class_export_put()) final put ffff96888b411000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780997117.314852:0:86392:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1780997117.314855:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997117.314860:0:86392:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780997117.314862:0:86392:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff96888ac519c0) has no exports 00000020:00000080:2.0:1780997117.314868:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a053 00000020:00000080:2.0:1780997117.314870:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689ba41f800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1780997117.315177:0:86392:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1780997117.315181:0:86392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780997117.315185:0:86392:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 5 00000004:00080000:2.0:1780997117.315190:0:86392:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997117.315192:0:86392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780997117.315240:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780997117.315247:0:86392:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780997117.315252:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a045 00000020:00000080:2.0:1780997117.315257:0:86392:0:(genops.c:906:class_export_put()) final put ffff96888b413800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780997117.315260:0:86392:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1780997117.315263:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997117.315266:0:86392:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780997117.315301:0:86392:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff96888ac50000) has no exports 00000020:00000080:2.0:1780997117.315305:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a03e 00000020:00000080:2.0:1780997117.315308:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689ba41b800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1780997117.317015:0:86392:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1780997117.317023:0:86392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780997117.317026:0:86392:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 5 00000004:00080000:2.0:1780997117.317033:0:86392:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997117.317036:0:86392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780997117.317072:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780997117.317082:0:86392:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1780997117.317096:0:86392:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1780997117.317102:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a029 00000020:00000080:2.0:1780997117.317109:0:86392:0:(genops.c:906:class_export_put()) final put ffff96898616b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780997117.317115:0:86392:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1780997117.317122:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997117.317125:0:86392:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780997117.317129:0:86392:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9689aeba0000) has no exports 00000020:00000080:2.0:1780997117.317134:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a022 00000020:00000080:2.0:1780997117.317138:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689a67f5000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780997117.317655:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba41d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780997117.317664:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bca59800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1780997117.317670:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96888b411000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780997117.317676:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba41f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780997117.317680:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bfa9f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780997117.317686:0:13646:0:(genops.c:906:class_export_put()) final put ffff96888b415800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780997117.317688:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96888b415800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1780997117.317702:0:13646:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997117.317792:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96888b413800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780997117.317797:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba41b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780997117.317800:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bfa9b800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780997117.317803:0:13646:0:(genops.c:906:class_export_put()) final put ffff96898616b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780997117.317804:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96898616b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1780997117.317807:0:13646:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997117.317839:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96898616b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1780997117.317845:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689a67f5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1780997117.318332:0:86392:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1780997117.318338:0:86392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1780997117.318342:0:86392:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1780997117.318348:0:86392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780997117.318385:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997117.318393:0:86392:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997117.318419:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997117.318422:0:86392:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997117.318425:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689ba41e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780997117.318427:0:86392:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba41e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1780997117.318443:0:86392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997117.318503:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059fea 00000020:00000080:0.0:1780997117.318509:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689bca5e800/lustre-MDD0000_UUID 00000020:01000000:0.0:1780997117.318513:0:86392:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1780997117.318516:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780997117.318521:0:86392:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1780997117.318524:0:86392:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff968886ec19c0) has no exports 00000020:00000080:0.0:1780997117.318554:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997117.318557:0:86392:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1780997117.318560:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059ff1 00000020:00000080:0.0:1780997117.318564:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689bca5a800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1780997117.318570:0:86392:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689bcd7b000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1780997117.318573:0:86392:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689bcd7b000 3 00000020:01000004:0.0:1780997117.318575:0:86392:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9689bcd7b000 from lustre-MDT0000 00000020:00000080:0.0:1780997117.318590:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997117.318593:0:86392:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1780997117.318595:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689ba418800/lustre-MDT0000_UUID 00000020:00000080:0.0:1780997117.318597:0:86392:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba418800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1780997117.318604:0:86392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1780997117.318631:0:86392:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1780997117.318642:0:86392:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1780997117.318645:0:86392:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1780997117.318647:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780997117.318650:0:86392:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1780997117.318662:0:86392:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9689bcb9f000 5bc603cc-b633-43af-a003-872c004686c8 192.168.206.51@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780997117.318668:0:86392:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9689868b9000 bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780997117.318672:0:86392:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff968990fe4d40) has exports, disconnecting them 00000020:00080000:0.0:1780997117.318676:0:86392:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.206.51@tcp (ffff9689bcb9f000), last request at 1780997084 00000020:00000080:0.0:1780997117.318698:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a0ae 00000020:00010000:0.0:1780997117.318702:0:86392:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689bcb9f000: total 2 00000100:00080000:0.0:1780997117.318707:0:86392:0:(import.c:65:import_set_state_nolock()) ffff9689bcb9d000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780997117.318726:0:86392:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.206.51@tcp (ffff9689bcb9f000): rc 0 00000020:00080000:0.0:1780997117.318729:0:86392:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9689868b9000), last request at 1780997083 00000020:00000080:0.0:1780997117.318778:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059f8f 00000020:00010000:0.0:1780997117.318782:0:86392:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689868b9000: total 2 00000100:00080000:0.0:1780997117.318784:0:86392:0:(import.c:65:import_set_state_nolock()) ffff9689868b8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780997117.318792:0:86392:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689868b9000): rc 0 00000020:00080000:0.0:1780997117.318796:0:86392:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff968990fe4d40) has no exports 00000020:00010000:0.0:1780997117.318804:0:6340:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689bcb9f000: total 2 00010000:00010000:0.0:1780997117.318829:0:6340:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689bcb9f000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1780997117.318855:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888955c00/0x30fd811c0305a180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b6f expref: 5 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.318870:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb3400/0x30fd811c0305a18e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b7d expref: 4 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.318881:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888955800/0x30fd811c0305a179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b68 expref: 3 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.318891:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888955200/0x30fd811c0305a187 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8b76 expref: 2 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.318900:0:6340:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689bcb9f000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1780997117.318916:0:6340:0:(genops.c:906:class_export_put()) final put ffff9689bcb9f000/5bc603cc-b633-43af-a003-872c004686c8 00000020:00010000:0.0:1780997117.318933:0:6340:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689868b9000: total 3 00010000:00010000:0.0:1780997117.319034:0:6340:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689868b9000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1780997117.319059:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305a0f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a0ed expref: 14 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.319073:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888954600/0x30fd811c0305a172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a16b expref: 13 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.319102:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888954e00/0x30fd811c0305a102 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a0fb expref: 12 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.319112:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888954000/0x30fd811c0305a110 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a109 expref: 11 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.319122:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96898d6dba00/0x30fd811c0305a11e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a117 expref: 10 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.319131:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888955000/0x30fd811c0305a12c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a125 expref: 9 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.319141:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96898d6daa00/0x30fd811c0305a13a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a133 expref: 8 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.319153:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2200/0x30fd811c0305a0ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a0c3 expref: 7 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.319161:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a141 expref: 6 pid: 85145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.319172:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888954200/0x30fd811c0305a164 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a15d expref: 5 pid: 85149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.319183:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc843c00/0x30fd811c0305a0d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a0d1 expref: 4 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.319193:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2c00/0x30fd811c0305a156 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a14f expref: 3 pid: 85144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.319218:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc843400/0x30fd811c0305a0e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a0df expref: 2 pid: 85143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997117.319228:0:6340:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689868b9000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1780997117.319242:0:6340:0:(genops.c:906:class_export_put()) final put ffff9689868b9000/bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 00010000:00010000:0.0:1780997117.319247:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997117.319249:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997117.319250:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997117.319392:0:85144:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9689a5fc2c00:85144] 1 exiting: rc = 0 00000100:00100000:1.0:1780997117.319717:0:85143:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9689ad820600:85143] 0 exiting: rc = 1 00000100:00100000:1.0:1780997117.319773:0:85145:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9689a5fc3000:85145] 2 exiting: rc = 0 00000020:00000080:1.0:1780997117.319813:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689a67f5800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1780997117.319818:0:13646:0:(genops.c:906:class_export_put()) final put ffff9689ba41a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780997117.319821:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba41a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1780997117.319825:0:13646:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997117.319884:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bca5e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1780997117.319887:0:13646:0:(genops.c:906:class_export_put()) final put ffff9689ba419000/lustre-MDD0000_UUID 00000020:00000080:1.0:1780997117.319889:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba419000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1780997117.319892:0:13646:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1780997117.319929:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bca5a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780997117.319934:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcb9f000/5bc603cc-b633-43af-a003-872c004686c8 for MGS 00000020:00000080:1.0:1780997117.319965:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689868b9000/bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 for MGS 00000020:00000080:1.0:1780997117.319977:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bcb9d000 for MGS 00000020:00000080:1.0:1780997117.319981:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689868b8800 for MGS 00010000:00010000:1.0:1780997117.320015:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997117.351443:0:85149:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9689812e6600:85149] 3 exiting: rc = 0 00000100:00100000:0.0:1780997117.352126:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352137:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352143:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352161:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352167:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352173:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352181:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352187:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352193:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352200:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352206:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352211:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352217:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352223:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352230:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352236:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352242:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352247:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352253:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352258:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352263:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352286:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352295:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352313:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352319:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352325:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352331:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352337:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352343:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352349:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352354:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352362:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352370:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352383:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352393:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352399:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352405:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352411:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352418:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352423:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352428:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352439:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352523:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352528:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352534:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352539:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352544:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352550:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352556:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352560:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352565:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352570:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352574:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352579:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352583:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352588:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352593:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352598:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352613:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352618:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352624:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352629:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352634:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780997117.352640:0:86392:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1780997117.361524:0:86392:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9689bb20e5a0 - data ffff9689aedf2510/ffff9689848bb000 00000020:01000000:0.0:1780997117.361660:0:86392:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968887c77f60 - data ffff9689aef0a000/ffff9689a5ef3c00 00000020:00000080:0.0:1780997117.362427:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059f88 00000020:00000080:0.0:1780997117.362437:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689a5871800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1780997117.362533:0:86392:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689bcd7b000 from MGS, refs=2 00000020:01000004:0.0:1780997117.362537:0:86392:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689bcd7b000 2 00000020:01000004:0.0:1780997117.362541:0:86392:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9689bcd7b000 from MGS 00000020:00000080:0.0:1780997117.362565:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997117.362573:0:86392:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1780997117.362576:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689a5873000/MGS 00000020:00000080:0.0:1780997117.362579:0:86392:0:(genops.c:865:class_export_destroy()) destroying export ffff9689a5873000/MGS for MGS 00000020:01000000:0.0:1780997117.362587:0:86392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1780997117.362659:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689a5871800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1780997117.362671:0:86392:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1780997117.362675:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780997117.362680:0:86392:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1780997117.362687:0:86392:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff968886bcf000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780997117.362693:0:86392:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff968886ec0000) has exports, disconnecting them 00000020:00080000:0.0:1780997117.362699:0:86392:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff968886bcf000), last request at 1780997083 00000020:00000080:0.0:1780997117.362703:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a0a0 00000020:00080000:0.0:1780997117.362789:0:86392:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff968886bcf000): rc 0 00000020:00000080:0.0:1780997117.362795:0:86392:0:(genops.c:906:class_export_put()) final put ffff968886bcf000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1780997117.362999:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff968886bcf000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1780997117.367360:0:86392:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1780997117.367369:0:86392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1780997117.367374:0:86392:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1780997117.367381:0:86392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1780997117.367874:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997117.367956:0:86392:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1780997117.367964:0:86392:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689bcd7b000 1 00000020:00000080:1.0:1780997117.367971:0:86392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03059f7a 00000020:00000080:1.0:1780997117.367980:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689a5872000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1780997117.367988:0:86392:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1780997117.367993:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780997117.367997:0:86392:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1780997117.368001:0:86392:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff96888ac53380) has no exports 00000020:00000080:2.0:1780997117.368429:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689ba670800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1780997117.368436:0:36:0:(genops.c:906:class_export_put()) final put ffff968886bcb000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1780997117.368512:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff968886bcb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1780997117.368525:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1780997117.368606:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689a5872000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780997117.439708:0:86392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997117.439724:0:86392:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1780997117.439729:0:86392:0:(genops.c:906:class_export_put()) final put ffff9689bcd7c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780997117.439734:0:86392:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcd7c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1780997117.439749:0:86392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1780997117.439872:0:86392:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9689bcd79000 00000020:02000400:1.0:1780997117.439949:0:86392:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1780997117.672452:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997118.705091:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997119.717644:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997119.909673:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126895104:0@lo:400:kworker.0 00000100:00100000:2.0:1780997119.909756:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997119.909811:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126895616:0@lo:400:kworker.0 00000100:00100000:2.0:1780997119.909840:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997119.909866:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1780997119.909872:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126894976:0@lo:400:kworker.0 00000100:00100000:2.0:1780997119.909918:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997119.909937:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126895488:0@lo:400:kworker.0 00000100:00100000:2.0:1780997119.909961:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997119.910065:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126895104 00000100:00100000:1.0:1780997119.910074:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126895104 00000100:00100000:1.0:1780997119.910142:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126894976 00000100:00100000:1.0:1780997119.910148:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126894976 00000100:00100000:1.0:1780997119.910168:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1780997119.910188:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126895104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997119.910245:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126895104:12345-0@lo:400:kworker.0 Request processed in 68us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997119.910289:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1780997119.910308:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1780997119.910312:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3499:x1867507126894976:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780997119.910318:0:63418:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780997119.910344:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3499:x1867507126894976:12345-0@lo:400:kworker.0 Request processed in 30us (425us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780997119.910350:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00080000:1.0:1780997119.910389:0:3499:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1780997119.910394:0:3499:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1780997119.910397:0:3499:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1780997119.910402:0:3499:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997119.910405:0:3499:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3616 00000100:00080000:1.0:1780997119.910410:0:3499:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997119.910433:0:3499:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc116d80 x1867507126896000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997119.910449:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126894976:0@lo:400:kworker.0 00000100:00100000:1.0:1780997119.910464:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126895104:0@lo:400:kworker.0 00000100:00100000:0.0:1780997119.910713:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126894848:0@lo:400:kworker.0 00000400:00000100:0.0:1780997119.910740:0:3497:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126894848 offset 0 length 224: 4 00000100:00100000:0.0:1780997119.910772:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126895360:0@lo:400:kworker.0 00000100:00100000:0.0:1780997119.910796:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997119.910815:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a679a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507126895872:0@lo:400:kworker.0 00000100:00100000:0.0:1780997119.910837:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997119.910855:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1780997119.910861:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126895232:0@lo:400:kworker.0 00000100:00100000:0.0:1780997119.910881:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997119.910898:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126895744:0@lo:400:kworker.0 00000100:00100000:0.0:1780997119.910930:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997119.910958:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126895616 00000100:00100000:0.0:1780997119.910962:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126895616 00000100:00100000:0.0:1780997119.910992:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126895744 00000100:00100000:0.0:1780997119.910994:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126895744 00000100:00100000:0.0:1780997119.911023:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1780997119.911030:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126895616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997119.911065:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126895616:12345-0@lo:400:kworker.0 Request processed in 35us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997119.911070:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1780997119.911084:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1780997119.911089:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126895744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997119.911115:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126895744:12345-0@lo:400:kworker.0 Request processed in 27us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997119.911120:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1780997119.911135:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126895488 00000100:00100000:0.0:1780997119.911138:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126895488 00000100:00100000:0.0:1780997119.911160:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00100000:0.0:1780997119.911164:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3499:x1867507126895488:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780997119.911308:0:23042:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780997119.911329:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3499:x1867507126895488:12345-0@lo:400:kworker.0 Request processed in 165us (1368us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780997119.911334:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00000100:00100000:0.0:1780997119.911363:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126895360 00000100:00100000:0.0:1780997119.911365:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126895360 00000100:00100000:0.0:1780997119.911383:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126895872 00000100:00100000:0.0:1780997119.911384:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126895872 00000100:00100000:0.0:1780997119.911391:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126895232 00000100:00100000:0.0:1780997119.911392:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126895232 00000100:00100000:0.0:1780997119.911397:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1780997119.911401:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126895360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997119.911419:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126895360:12345-0@lo:400:kworker.0 Request processed in 18us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997119.911423:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1780997119.911429:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1780997119.911431:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3497:x1867507126895872:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780997119.911434:0:63419:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780997119.911445:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3497:x1867507126895872:12345-0@lo:400:kworker.0 Request processed in 12us (608us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780997119.911448:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1780997119.911453:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1780997119.911455:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3497:x1867507126895232:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780997119.911458:0:63419:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780997119.911467:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3497:x1867507126895232:12345-0@lo:400:kworker.0 Request processed in 11us (586us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780997119.911470:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00080000:0.0:1780997119.911495:0:3497:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780997119.911503:0:3497:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780997119.911506:0:3497:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780997119.911508:0:3497:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997119.911511:0:3497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3616 00000100:00080000:0.0:1780997119.911514:0:3497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997119.911532:0:3497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba655880 x1867507126896128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997119.911543:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126895232:0@lo:400:kworker.0 00000100:00100000:0.0:1780997119.911552:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126895744:0@lo:400:kworker.0 00000100:00100000:0.0:1780997119.911558:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126895360:0@lo:400:kworker.0 00000100:00080000:0.0:1780997119.911562:0:3497:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780997119.911564:0:3497:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780997119.911566:0:3497:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780997119.911568:0:3497:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997119.911581:0:3497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3616 00000100:00080000:0.0:1780997119.911583:0:3497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997119.911591:0:3497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba656d80 x1867507126896256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997119.911597:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a679a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507126895872:0@lo:400:kworker.0 00000100:00080000:2.0:1780997119.911809:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997119.911814:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997119.911817:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997119.911830:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126896000:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1780997119.911866:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997119.911893:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126896128:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1780997119.911923:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997119.911941:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126896256:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1780997119.911963:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997119.911990:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126896000 00000100:00100000:2.0:1780997119.911995:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126896000 00000100:00100000:2.0:1780997119.912028:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126896128 00000100:00100000:2.0:1780997119.912031:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126896128 00000100:00100000:2.0:1780997119.912040:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126896256 00000100:00100000:2.0:1780997119.912042:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126896256 00000100:00100000:2.0:1780997119.912051:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:2.0:1780997119.912055:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126896000:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1780997119.912073:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997119.912113:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126896000:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 56us (246us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997119.912120:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:2.0:1780997119.912140:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1780997119.912143:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126896128:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1780997119.912150:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997119.912166:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126896128:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 22us (243us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997119.912169:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1780997119.912175:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1780997119.912177:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126896256:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1780997119.912307:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997119.912326:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126896256:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 148us (364us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997119.912330:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00080000:2.0:1780997119.912354:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997119.912357:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997119.912359:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126896000:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1780997119.912364:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997119.912365:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997119.912367:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126896128:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1780997119.912371:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997119.912373:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997119.912374:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126896256:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1780997119.912781:0:3499:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1780997119.912787:0:3499:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1780997119.912790:0:3499:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1780997119.912795:0:3499:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997119.912799:0:3499:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3616 00000100:00080000:1.0:1780997119.912812:0:3499:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997119.912835:0:3499:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc114380 x1867507126896384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997119.912858:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126895488:0@lo:400:kworker.0 00000100:00100000:1.0:1780997119.912876:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126895616:0@lo:400:kworker.0 00000100:00100000:2.0:1780997119.913292:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126896384:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1780997119.913322:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997119.913364:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126896384 00000100:00100000:3.0:1780997119.913374:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126896384 00000100:00100000:3.0:1780997119.913411:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:3.0:1780997119.913416:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126896384:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1780997119.913441:0:80061:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997119.913479:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126896384:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 62us (155us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997119.913485:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00000100:00080000:2.0:1780997119.913807:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997119.913811:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997119.913813:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126896384:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1780997120.424131:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126896512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997120.424224:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997120.424391:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126896512 00000100:00100000:0.0:1780997120.424400:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126896512 00000100:00100000:0.0:1780997120.424477:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050 00000100:00100000:0.0:1780997120.424501:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126896512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997120.424531:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17088320 pending 1073152 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997120.424584:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126896512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997120.424591:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050 00000100:00100000:3.0:1780997120.424681:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126896512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997120.425093:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997120.425108:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126896640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997120.425141:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997120.425294:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126896640 00000100:00100000:3.0:1780997120.425299:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126896640 00000100:00100000:3.0:1780997120.425332:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051 00000100:00100000:3.0:1780997120.425338:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126896640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997120.425358:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997120.425400:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126896640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997120.425407:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051 00000100:00100000:3.0:1780997120.425440:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126896640:0@lo:13:osp-pre-1-1.0 00000001:00100000:2.0:1780997120.426192:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780997120.426198:0:9294:0:(genops.c:906:class_export_put()) final put ffff9689bc96a800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1780997120.426222:0:9294:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969452 is committed 00000020:00000080:3.0:1780997120.426420:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1780997120.426468:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bc969800 for lustre-OST0001 00010000:00010000:1.0:1780997120.741460:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997120.772089:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997120.772144:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:2.0:1780997120.772183:0:3491:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110371456 offset 0 length 224: 4 00000100:00100000:2.0:1780997120.772213:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997120.772252:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997120.772367:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110371840 00000100:00100000:1.0:1780997120.772376:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110371840 00000100:00100000:1.0:1780997120.772434:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110371968 00000100:00100000:1.0:1780997120.772437:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110371968 00000100:00100000:1.0:1780997120.772459:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2556 00000100:00100000:1.0:1780997120.772480:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2395:x1867507110371840:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997120.772550:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2395:x1867507110371840:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 74us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997120.772559:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2556 00000100:00100000:1.0:1780997120.772573:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2557 00000100:00100000:1.0:1780997120.772579:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110371968:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997120.772598:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110371968:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 19us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997120.772603:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2557 00000100:00100000:3.0:1780997120.772776:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110371584 00000100:00100000:3.0:1780997120.772780:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110371584 00000100:00100000:3.0:1780997120.772810:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110371712 00000100:00100000:3.0:1780997120.772812:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110371712 00000100:00100000:3.0:1780997120.772833:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1239 00000100:00100000:3.0:1780997120.772839:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110371712:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997120.772872:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110371712:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 34us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997120.772878:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1239 00000100:00100000:3.0:1780997120.772914:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1253 00000100:00100000:3.0:1780997120.772918:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1867507110371584:12345-192.168.206.51@tcp:400:kworker.0 00000020:00080000:3.0:1780997120.772924:0:63417:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.206.51@tcp 00000100:00100000:3.0:1780997120.772945:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1867507110371584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (869us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780997120.772951:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1253 00000100:00080000:2.0:1780997120.773050:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997120.773055:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997120.773057:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997120.783476:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997120.783559:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110372096 00000100:00100000:3.0:1780997120.783571:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110372096 00000100:00100000:3.0:1780997120.783622:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1254 00000100:00100000:3.0:1780997120.783629:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1867507110372096:12345-192.168.206.51@tcp:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1780997120.783654:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997120.783718:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1867507110372096:12345-192.168.206.51@tcp:38:ptlrpcd_00_01.0 Request processed in 89us (253us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997120.783725:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1254 00000001:00100000:0.0:1780997121.451495:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780997121.451504:0:8226:0:(genops.c:906:class_export_put()) final put ffff9689891ad000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1780997121.451572:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969453 is committed 00000020:00000080:1.0:1780997121.453061:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689891ad000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1780997121.453131:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bc85f800 for lustre-OST0000 00010000:00010000:0.0:1780997121.766860:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997122.790522:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1780997123.495371:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1780997123.495384:0:72364:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378732 is committed 00000020:00000080:0.0:1780997123.495389:0:72364:0:(genops.c:906:class_export_put()) final put ffff9689bfab2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780997123.495462:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bfab2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1780997123.495546:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bfab4000 for lustre-MDT0001 00010000:00010000:0.0:1780997123.813564:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997124.837461:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780997125.031028:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1780997125.031160:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997125.031186:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126896768:0@lo:400:kworker.0 00000400:00000100:0.0:1780997125.031240:0:3497:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126896768 offset 0 length 224: 4 00000100:00080000:1.0:1780997125.031493:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997125.031510:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997125.031515:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3647 00000100:00080000:1.0:1780997125.031520:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780997125.031526:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997125.031550:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc116d80 x1867507126896896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997125.031606:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997125.031610:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997125.031612:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997125.031616:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3647 00000100:00080000:1.0:1780997125.031618:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780997125.031621:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997125.031641:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfaabb80 x1867507126897152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997125.031672:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997125.031675:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997125.031676:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997125.031680:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3647 00000100:00080000:1.0:1780997125.031682:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780997125.031686:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997125.031813:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780997125.031825:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126897024:0@lo:400:kworker.0 00000100:00100000:3.0:1780997125.031870:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997125.031921:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126897024 00000100:00100000:3.0:1780997125.031929:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126897024 00000100:00100000:3.0:1780997125.031984:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1780997125.031993:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126897024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997125.032058:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126897024:12345-0@lo:400:kworker.0 Request processed in 67us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997125.032066:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1780997125.032104:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126897024:0@lo:400:kworker.0 00000100:00100000:3.0:1780997125.032307:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126897280:0@lo:400:kworker.0 00000100:00100000:3.0:1780997125.032350:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997125.032400:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126897280 00000100:00100000:3.0:1780997125.032405:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126897280 00000100:00100000:3.0:1780997125.032432:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1780997125.032438:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126897280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997125.032472:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126897280:12345-0@lo:400:kworker.0 Request processed in 34us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997125.032478:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1780997125.032502:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126897280:0@lo:400:kworker.0 00000100:00100000:1.0:1780997125.032581:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bff6f800 x1867507126897408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997125.032628:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997125.032631:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997125.032639:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997125.032643:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3647 00000100:00080000:1.0:1780997125.032646:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780997125.032650:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997125.032666:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7a4c000 x1867507126897792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997125.032687:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997125.032695:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126897536:0@lo:400:kworker.0 00000100:00100000:1.0:1780997125.032726:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997125.032747:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126897664:0@lo:400:kworker.0 00000100:00100000:1.0:1780997125.032766:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997125.032869:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126897536 00000100:00100000:0.0:1780997125.032884:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126897536 00000100:00100000:0.0:1780997125.032924:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126897664 00000100:00100000:0.0:1780997125.032928:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126897664 00000100:00100000:0.0:1780997125.032953:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:0.0:1780997125.032960:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126897536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997125.033006:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126897536:12345-0@lo:400:kworker.0 Request processed in 47us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997125.033012:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:0.0:1780997125.033025:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:0.0:1780997125.033030:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126897664:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1780997125.033317:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997125.033322:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997125.033331:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997125.034084:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126897536:0@lo:400:kworker.0 00000100:00100000:2.0:1780997125.034257:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126896896:0@lo:38:kworker.0 00000100:00100000:2.0:1780997125.034321:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997125.034360:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126897152:0@lo:38:kworker.0 00000100:00100000:2.0:1780997125.034384:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997125.034404:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126897408:0@lo:38:kworker.0 00000100:00100000:2.0:1780997125.034429:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997125.034448:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126897792:0@lo:38:kworker.0 00000100:00100000:2.0:1780997125.034470:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997125.034503:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126897408 00000100:00100000:2.0:1780997125.034509:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126897408 00000100:00100000:2.0:1780997125.034537:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:2.0:1780997125.034542:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126897408:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997125.034563:0:23042:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997125.034602:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126897408:12345-0@lo:38:kworker.0 Request processed in 57us (171us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997125.034608:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00100000:2.0:1780997125.034633:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126896896 00000100:00100000:2.0:1780997125.034637:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126896896 00000100:00100000:2.0:1780997125.034652:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126897152 00000100:00100000:2.0:1780997125.034655:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126897152 00000100:00100000:2.0:1780997125.034668:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126897792 00000100:00100000:2.0:1780997125.034670:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126897792 00000100:00100000:2.0:1780997125.034682:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:2.0:1780997125.034686:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126896896:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997125.034696:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997125.034723:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126896896:12345-0@lo:38:kworker.0 Request processed in 35us (401us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997125.034741:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:2.0:1780997125.034753:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1780997125.034757:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126897152:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997125.034766:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997125.034789:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126897152:12345-0@lo:38:kworker.0 Request processed in 31us (405us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997125.034794:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1780997125.034806:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1780997125.034809:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126897792:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997125.034817:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997125.034840:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126897792:12345-0@lo:38:kworker.0 Request processed in 29us (369us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997125.034846:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00080000:2.0:1780997125.034888:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997125.034894:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997125.034897:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126896896:0@lo:38:kworker.0 00000100:00080000:2.0:1780997125.034907:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997125.034911:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997125.034914:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126897152:0@lo:38:kworker.0 00000100:00080000:2.0:1780997125.034920:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997125.034923:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997125.034926:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126897408:0@lo:38:kworker.0 00000100:00080000:2.0:1780997125.034932:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997125.034941:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997125.034943:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126897792:0@lo:38:kworker.0 00000100:00100000:0.0:1780997125.036525:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126897664:12345-0@lo:400:kworker.0 Request processed in 3487us (3750us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997125.036536:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:1.0:1780997125.036714:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126897664:0@lo:400:kworker.0 00000100:00100000:0.0:1780997125.544004:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780997125.544032:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126898048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997125.544130:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997125.544199:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126898048 00000100:00100000:0.0:1780997125.544207:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126898048 00000100:00100000:0.0:1780997125.544259:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:0.0:1780997125.544267:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126898048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997125.544319:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997125.544376:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126898048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997125.544384:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:0.0:1780997125.544432:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126898048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997125.544603:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126897920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997125.544636:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997125.544727:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126897920 00000100:00100000:3.0:1780997125.544732:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126897920 00000100:00100000:3.0:1780997125.544768:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:3.0:1780997125.544775:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126897920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997125.544792:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997125.544834:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126897920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997125.544841:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00100000:1.0:1780997125.545015:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126897920:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1780997125.862515:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997125.892818:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:3.0:1780997125.892858:0:3489:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110372224 offset 0 length 224: 4 00000100:00100000:3.0:1780997125.892887:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997125.892918:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997125.892955:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997125.893050:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110372608 00000100:00100000:2.0:1780997125.893059:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110372608 00000100:00100000:2.0:1780997125.893130:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110372736 00000100:00100000:2.0:1780997125.893132:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110372736 00000100:00100000:2.0:1780997125.893156:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2560 00000100:00100000:2.0:1780997125.893165:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110372608:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997125.893233:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110372608:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997125.893240:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2560 00000100:00100000:2.0:1780997125.893254:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2561 00000100:00100000:2.0:1780997125.893260:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110372736:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997125.893319:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110372736:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 59us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997125.893326:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2561 00000100:00100000:2.0:1780997125.893345:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110372352 00000100:00100000:2.0:1780997125.893348:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110372352 00000100:00100000:2.0:1780997125.893363:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110372480 00000100:00100000:2.0:1780997125.893365:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110372480 00000100:00100000:2.0:1780997125.893386:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1242 00000100:00100000:2.0:1780997125.893391:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110372480:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997125.893416:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110372480:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997125.893421:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1242 00000100:00100000:2.0:1780997125.893431:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1258 00000100:00100000:2.0:1780997125.893448:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110372352:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:2.0:1780997125.893468:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997125.893488:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110372352:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 39us (692us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997125.893494:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1258 00000100:00080000:3.0:1780997125.893710:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997125.893719:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997125.893721:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1780997126.886257:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997127.911745:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997128.935154:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997129.961555:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780997130.150765:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997130.150773:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997130.150776:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997130.150785:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3652 00000100:00080000:0.0:1780997130.150791:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780997130.150798:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997130.150820:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba654000 x1867507126898304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997130.150835:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780997130.150878:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126898176:0@lo:400:kworker.0 00000100:00080000:0.0:1780997130.150885:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997130.150890:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997130.150892:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997130.150897:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3652 00000100:00080000:0.0:1780997130.150899:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780997130.150903:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997130.150917:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba656d80 x1867507126898560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1780997130.150942:0:3498:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126898176 offset 0 length 224: 4 00000100:00080000:0.0:1780997130.150945:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997130.150949:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997130.150951:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997130.150956:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3652 00000100:00080000:0.0:1780997130.150959:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780997130.150963:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997130.150978:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a679a680 x1867507126898816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997130.151008:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1780997130.151012:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126898944:0@lo:400:kworker.0 00000100:00080000:0.0:1780997130.151013:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997130.151017:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997130.151022:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3652 00000100:00080000:0.0:1780997130.151025:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780997130.151029:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997130.151042:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6796d80 x1867507126899200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997130.151055:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997130.151077:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126898304:0@lo:38:kworker.0 00000100:00100000:3.0:1780997130.151083:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780997130.151091:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126899072:0@lo:400:kworker.0 00000100:00100000:0.0:1780997130.151117:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997130.151124:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997130.151143:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126898560:0@lo:38:kworker.0 00000100:00100000:0.0:1780997130.151170:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997130.151179:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126898944 00000100:00100000:3.0:1780997130.151188:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126898944 00000100:00100000:0.0:1780997130.151190:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a679a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126898816:0@lo:38:kworker.0 00000100:00100000:0.0:1780997130.151216:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997130.151238:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126899200:0@lo:38:kworker.0 00000100:00100000:3.0:1780997130.151244:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126899072 00000100:00100000:3.0:1780997130.151249:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126899072 00000100:00100000:0.0:1780997130.151264:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997130.151298:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1780997130.151309:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126898944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997130.151323:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126898432:0@lo:400:kworker.0 00000100:00100000:0.0:1780997130.151358:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997130.151380:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126898944:12345-0@lo:400:kworker.0 Request processed in 61us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997130.151381:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997130.151389:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126898688:0@lo:400:kworker.0 00000100:00100000:3.0:1780997130.151395:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1780997130.151418:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:0.0:1780997130.151419:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997130.151430:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126899072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997130.151465:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126899072:12345-0@lo:400:kworker.0 Request processed in 39us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997130.151471:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1780997130.151491:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126898304 00000100:00100000:3.0:1780997130.151495:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126898304 00000100:00100000:3.0:1780997130.151521:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126898560 00000100:00100000:3.0:1780997130.151524:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126898560 00000100:00100000:3.0:1780997130.151532:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126899200 00000100:00100000:3.0:1780997130.151534:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126899200 00000100:00100000:3.0:1780997130.151540:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126898432 00000100:00100000:3.0:1780997130.151542:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126898432 00000100:00100000:3.0:1780997130.151559:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126898688 00000100:00100000:3.0:1780997130.151561:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126898688 00000100:00100000:3.0:1780997130.151574:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1780997130.151580:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126898432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997130.151617:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126898432:12345-0@lo:400:kworker.0 Request processed in 38us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997130.151625:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1780997130.151637:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1780997130.151643:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126898688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997130.151669:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126898688:12345-0@lo:400:kworker.0 Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997130.151675:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1780997130.151686:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:3.0:1780997130.151690:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126898304:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997130.151709:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997130.151754:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126898304:12345-0@lo:38:kworker.0 Request processed in 62us (637us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997130.151760:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:3.0:1780997130.151772:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:3.0:1780997130.151776:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126898560:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997130.151786:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997130.151802:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126898816 00000100:00100000:0.0:1780997130.151808:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126898816 00000100:00100000:3.0:1780997130.151817:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126898560:12345-0@lo:38:kworker.0 Request processed in 38us (645us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997130.151824:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:3.0:1780997130.151838:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:3.0:1780997130.151842:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126899200:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997130.151863:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997130.151887:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126899200:12345-0@lo:38:kworker.0 Request processed in 44us (624us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997130.151894:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00080000:3.0:1780997130.151922:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997130.151927:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997130.151929:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997130.155767:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997130.155786:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997130.155790:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126898304:0@lo:38:kworker.0 00000100:00080000:2.0:1780997130.155805:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997130.155808:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997130.155811:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126898560:0@lo:38:kworker.0 00000100:00080000:2.0:1780997130.155823:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997130.155826:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997130.155828:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126899200:0@lo:38:kworker.0 00000100:00100000:0.0:1780997130.156563:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00100000:0.0:1780997130.156573:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126898816:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997130.156599:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997130.156691:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126898816:12345-0@lo:38:kworker.0 Request processed in 117us (5474us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997130.156700:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00080000:0.0:1780997130.156762:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997130.156767:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997130.156769:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a679a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126898816:0@lo:38:kworker.0 00000100:00100000:2.0:1780997130.157003:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126899072:0@lo:400:kworker.0 00000100:00100000:2.0:1780997130.157018:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126898944:0@lo:400:kworker.0 00000100:00100000:3.0:1780997130.158659:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126898688:0@lo:400:kworker.0 00000100:00100000:3.0:1780997130.158677:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126898432:0@lo:400:kworker.0 00000100:00100000:0.0:1780997130.661421:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997130.661447:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126899328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997130.661515:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997130.661557:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126899328 00000100:00100000:0.0:1780997130.661564:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126899328 00000100:00100000:0.0:1780997130.661604:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:0.0:1780997130.661612:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126899328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997130.661641:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997130.661683:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126899328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997130.661691:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:0.0:1780997130.661749:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126899328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997130.662538:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126899456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997130.662576:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997130.662676:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126899456 00000100:00100000:3.0:1780997130.662682:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126899456 00000100:00100000:3.0:1780997130.662723:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:3.0:1780997130.662732:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126899456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997130.662751:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997130.662796:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126899456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997130.662802:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00100000:1.0:1780997130.662875:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126899456:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1780997130.981549:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1780997131.016542:0:3490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110372864 offset 0 length 224: 4 00000100:00100000:3.0:1780997131.016591:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997131.016645:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997131.016907:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110373376 00000100:00100000:0.0:1780997131.016917:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110373376 00000100:00100000:2.0:1780997131.017022:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110373120 00000100:00100000:2.0:1780997131.017026:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110373120 00000100:00100000:0.0:1780997131.017085:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2564 00000100:00100000:0.0:1780997131.017100:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2396:x1867507110373376:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997131.017167:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2396:x1867507110373376:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997131.017184:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2564 00000100:00080000:3.0:1780997131.020576:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997131.020586:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997131.021886:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1245 00000100:00100000:2.0:1780997131.021905:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110373120:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997131.022009:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110373120:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 110us (5418us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997131.022017:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1245 00000100:00100000:3.0:1780997131.022225:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997131.022367:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997131.022397:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110372992 00000100:00100000:0.0:1780997131.022399:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110373248 00000100:00100000:3.0:1780997131.022405:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110372992 00000100:00100000:3.0:1780997131.022430:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1262 00000100:00100000:3.0:1780997131.022437:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110372992:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:3.0:1780997131.022461:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997131.022496:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110372992:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 59us (272us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997131.022503:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1262 00000100:00100000:0.0:1780997131.024836:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110373248 00000100:00100000:0.0:1780997131.024931:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2565 00000100:00100000:0.0:1780997131.024952:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110373248:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997131.025050:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2397:x1867507110373248:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 110us (2682us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997131.025058:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2565 00000100:00080000:0.0:1780997131.025090:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1780997132.005589:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997133.030216:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997134.054442:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997135.085187:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780997135.269539:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997135.269548:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997135.269552:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997135.269562:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3657 00000100:00080000:2.0:1780997135.269569:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1780997135.269576:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997135.269601:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6795880 x1867507126899712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997135.269630:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997135.269634:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997135.269635:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997135.269639:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3657 00000100:00080000:2.0:1780997135.269642:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1780997135.269646:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997135.269657:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba655f80 x1867507126899968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997135.269681:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997135.269685:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997135.269686:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997135.269689:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3657 00000100:00080000:2.0:1780997135.269692:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1780997135.269695:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997135.269707:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba656d80 x1867507126900224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997135.269749:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997135.269752:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997135.269754:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997135.269758:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3657 00000100:00080000:2.0:1780997135.269760:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1780997135.269764:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997135.269776:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfaabb80 x1867507126900608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997135.269797:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126899584:0@lo:400:kworker.0 00000100:00100000:2.0:1780997135.269829:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126899712:0@lo:38:kworker.0 00000400:00000100:3.0:1780997135.269870:0:3498:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126899584 offset 0 length 224: 4 00000100:00100000:0.0:1780997135.269918:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126899840:0@lo:400:kworker.0 00000100:00100000:2.0:1780997135.271991:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997135.272043:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126899968:0@lo:38:kworker.0 00000100:00100000:2.0:1780997135.272084:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997135.272108:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126900224:0@lo:38:kworker.0 00000100:00100000:2.0:1780997135.272153:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997135.272176:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126900608:0@lo:38:kworker.0 00000100:00100000:2.0:1780997135.272199:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997135.272247:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126900096:0@lo:400:kworker.0 00000100:00100000:2.0:1780997135.272294:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997135.272316:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997135.272323:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126900352:0@lo:400:kworker.0 00000100:00100000:2.0:1780997135.272348:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997135.272381:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126899712 00000100:00100000:2.0:1780997135.272388:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126899712 00000100:00100000:2.0:1780997135.272422:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126899968 00000100:00100000:2.0:1780997135.272431:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126899968 00000100:00100000:2.0:1780997135.272448:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126900608 00000100:00100000:2.0:1780997135.272450:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126900608 00000100:00100000:2.0:1780997135.272458:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126900096 00000100:00100000:2.0:1780997135.272460:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126900096 00000100:00100000:2.0:1780997135.272492:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1780997135.272502:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126900096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997135.272556:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126900096:12345-0@lo:400:kworker.0 Request processed in 55us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997135.272563:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1780997135.272581:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1780997135.272585:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126899712:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997135.272603:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997135.272638:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126899712:12345-0@lo:38:kworker.0 Request processed in 51us (652us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997135.272644:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1780997135.272656:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1780997135.272660:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126899968:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997135.272668:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997135.272691:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126899968:12345-0@lo:38:kworker.0 Request processed in 30us (607us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997135.272697:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1780997135.272707:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1780997135.272711:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126900608:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997135.272720:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997135.272743:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507126900608:12345-0@lo:38:kworker.0 Request processed in 30us (543us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997135.272756:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1780997135.272774:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126900224 00000100:00100000:2.0:1780997135.272778:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126900224 00000100:00100000:2.0:1780997135.273009:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:2.0:1780997135.273014:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126900224:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997135.273023:0:8242:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997135.273052:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126900224:12345-0@lo:38:kworker.0 Request processed in 36us (898us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997135.273057:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00000100:00100000:2.0:1780997135.273083:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126900352 00000100:00100000:2.0:1780997135.273087:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126900352 00000100:00100000:2.0:1780997135.273117:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1780997135.273123:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126900352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997135.273157:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126900352:12345-0@lo:400:kworker.0 Request processed in 35us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997135.273163:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00080000:2.0:1780997135.273183:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997135.273187:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997135.273226:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126900352:0@lo:400:kworker.0 00000100:00100000:2.0:1780997135.273237:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126900096:0@lo:400:kworker.0 00000100:00080000:2.0:1780997135.273288:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997135.273293:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997135.273297:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126899712:0@lo:38:kworker.0 00000100:00080000:2.0:1780997135.273308:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997135.273311:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997135.273324:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126899968:0@lo:38:kworker.0 00000100:00080000:2.0:1780997135.273338:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997135.273342:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997135.273346:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126900224:0@lo:38:kworker.0 00000100:00080000:2.0:1780997135.273359:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997135.273364:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997135.273368:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126900608:0@lo:38:kworker.0 00000100:00100000:3.0:1780997135.273377:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126900480:0@lo:400:kworker.0 00000100:00100000:3.0:1780997135.273427:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997135.273482:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126900480 00000100:00100000:3.0:1780997135.273487:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126900480 00000100:00100000:3.0:1780997135.273520:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:3.0:1780997135.273527:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126900480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997135.273561:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126900480:12345-0@lo:400:kworker.0 Request processed in 35us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997135.273568:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00080000:3.0:1780997135.273586:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997135.275103:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126900480:0@lo:400:kworker.0 00000100:00100000:1.0:1780997135.278145:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997135.278921:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126899840 00000100:00100000:2.0:1780997135.278932:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126899840 00000100:00100000:2.0:1780997135.279097:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1780997135.279108:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126899840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997135.279194:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126899840:12345-0@lo:400:kworker.0 Request processed in 88us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997135.279201:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1780997135.279295:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126899840:0@lo:400:kworker.0 00000100:00080000:3.0:1780997135.279356:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00000400:3.0:1780997135.780183:0:3497:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780997119/real 1780997119] req@ffff9689a5c47100 x1867507126894848/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997135 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997135.780222:0:3497:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9689a5c47100 x1867507126894848/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997135 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997135.780232:0:3497:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1780997135.780236:0:3497:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1780997135.780239:0:3497:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.151@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1780997135.780241:0:3497:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1780997135.780245:0:3497:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689a5c47100 x1867507126894848/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997135 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997135.780255:0:3497:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689bc114380 x1867507126896768/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997141 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997135.780264:0:3497:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689ba656a00 x1867507126898176/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997146 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997135.780301:0:3497:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689b1123b80 x1867507126899584/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997151 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1780997135.780310:0:3497:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1780997135.780314:0:3497:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1780997135.780315:0:3497:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1780997135.780318:0:3497:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1780997135.780333:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126899584:0@lo:400:kworker.0 00000100:00100000:0.0:1780997135.780344:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126898176:0@lo:400:kworker.0 00000100:00100000:3.0:1780997135.780405:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126896768:0@lo:400:kworker.0 00000100:00100000:3.0:1780997135.780410:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126894848:0@lo:400:kworker.0 00000100:00080000:1.0:1780997135.780986:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997135.780992:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1780997135.780995:0:36:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997135.780999:0:36:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3611 00000100:00080000:1.0:1780997135.781008:0:36:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997135.781039:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968986936680 x1867507126900736/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997135.781086:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997135.781090:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997135.781092:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997135.781097:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3662 00000100:00080000:1.0:1780997135.781100:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997135.781105:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997135.781123:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968986937100 x1867507126900864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997135.781188:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997135.781192:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997135.781195:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997135.781198:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3662 00000100:00080000:1.0:1780997135.781201:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997135.781204:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997135.781218:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988613b80 x1867507126901120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997135.781230:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126900992:0@lo:400:kworker.0 00000100:00080000:1.0:1780997135.781247:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997135.781250:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997135.781251:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997135.781255:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3662 00000100:00080000:1.0:1780997135.781257:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1780997135.781262:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126901248:0@lo:400:kworker.0 00000100:00080000:1.0:1780997135.781262:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997135.781308:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988612300 x1867507126901376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997135.781325:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997135.781403:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126900736:0@lo:250:kworker.0 00000100:00080000:1.0:1780997135.782247:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997135.782251:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997135.782254:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997135.782258:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3662 00000100:00080000:1.0:1780997135.782261:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997135.782266:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997135.782304:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988610700 x1867507126901760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997135.782384:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126901632:0@lo:400:kworker.0 00000400:00000100:3.0:1780997135.782664:0:3495:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126900736 offset 0 length 520: 4 00000100:00100000:3.0:1780997135.782889:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126900864:0@lo:38:kworker.0 00000100:00100000:3.0:1780997135.782931:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997135.782955:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126901120:0@lo:38:kworker.0 00000100:00100000:3.0:1780997135.782976:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997135.782993:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126901376:0@lo:38:kworker.0 00000100:00100000:3.0:1780997135.783018:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997135.783044:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126901760:0@lo:38:kworker.0 00000100:00100000:3.0:1780997135.783063:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997135.783107:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126900992 00000100:00100000:3.0:1780997135.783114:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126900992 00000100:00100000:3.0:1780997135.783155:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126900864 00000100:00100000:3.0:1780997135.783158:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126900864 00000100:00100000:3.0:1780997135.783173:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126901120 00000100:00100000:3.0:1780997135.783176:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126901120 00000100:00100000:3.0:1780997135.783183:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126901760 00000100:00100000:3.0:1780997135.783185:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126901760 00000100:00100000:3.0:1780997135.783196:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1780997135.783204:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126900992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997135.783257:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126900992:12345-0@lo:400:kworker.0 Request processed in 53us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997135.783264:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1780997135.783299:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1780997135.783304:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126900864:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997135.783321:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997135.783355:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126900864:12345-0@lo:38:kworker.0 Request processed in 50us (423us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997135.783362:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1780997135.783381:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:3.0:1780997135.783384:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126901120:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997135.783395:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997135.783424:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126901120:12345-0@lo:38:kworker.0 Request processed in 38us (447us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997135.783430:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:3.0:1780997135.783449:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1780997135.783453:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126901760:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997135.783462:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997135.783486:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126901760:12345-0@lo:38:kworker.0 Request processed in 32us (422us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997135.783491:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00080000:3.0:1780997135.783610:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997135.783617:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997135.783622:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126901760:0@lo:38:kworker.0 00000100:00080000:3.0:1780997135.783636:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997135.783639:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997135.783641:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126900864:0@lo:38:kworker.0 00000100:00080000:3.0:1780997135.783648:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997135.783651:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997135.783654:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126901120:0@lo:38:kworker.0 00000100:00100000:3.0:1780997135.790185:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126901504:0@lo:400:kworker.0 00000100:00100000:3.0:1780997135.790280:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997135.790287:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997135.790344:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126902016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997135.790371:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997135.791863:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126901248 00000100:00100000:3.0:1780997135.791883:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126901248 00000100:00100000:3.0:1780997135.791940:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1780997135.791950:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126901248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997135.792022:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126901248:12345-0@lo:400:kworker.0 Request processed in 73us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997135.792029:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1780997135.792054:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126901504 00000100:00100000:3.0:1780997135.792058:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126901504 00000100:00100000:3.0:1780997135.792085:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:3.0:1780997135.792091:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126901504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997135.792136:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126901504:12345-0@lo:400:kworker.0 Request processed in 45us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997135.792142:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:3.0:1780997135.792181:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126901248:0@lo:400:kworker.0 00000100:00100000:3.0:1780997135.792223:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126901504:0@lo:400:kworker.0 00000100:00100000:3.0:1780997135.792623:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126901376 00000100:00100000:3.0:1780997135.792631:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126901376 00000100:00100000:3.0:1780997135.792661:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:3.0:1780997135.792718:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126901376:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997135.792739:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997135.792863:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126901376:12345-0@lo:38:kworker.0 Request processed in 194us (9843us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997135.792872:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00000100:00100000:0.0:1780997135.792905:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126902016 00000100:00100000:0.0:1780997135.792912:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126902016 00000100:00080000:3.0:1780997135.792941:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997135.792948:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997135.792953:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:3.0:1780997135.792956:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126901376:0@lo:38:kworker.0 00000100:00100000:0.0:1780997135.792964:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126902016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997135.792991:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997135.793042:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126902016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (2669us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997135.793049:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00100000:0.0:1780997135.793087:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126900992:0@lo:400:kworker.0 00000100:00100000:0.0:1780997135.793129:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126901888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997135.793428:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997135.793462:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126901888 00000100:00100000:0.0:1780997135.793466:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126901888 00000100:00100000:0.0:1780997135.793492:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:0.0:1780997135.793499:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126901888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997135.793516:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997135.793550:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126901888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997135.793554:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126902016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997135.793560:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:0.0:1780997135.793602:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126901888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997135.795022:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997135.795189:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126901632 00000100:00100000:0.0:1780997135.795196:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126901632 00000100:00100000:0.0:1780997135.795248:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:0.0:1780997135.795257:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126901632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997135.795343:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126901632:12345-0@lo:400:kworker.0 Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997135.795351:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:1.0:1780997135.795451:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126901632:0@lo:400:kworker.0 00000400:00000100:3.0:1780997136.072482:0:3490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110373504 offset 0 length 520: 4 00000100:00100000:3.0:1780997136.072523:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997136.072571:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997136.072605:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997136.072629:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997136.072657:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110373632 00000100:00100000:3.0:1780997136.072667:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110373632 00000100:00100000:3.0:1780997136.072706:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110373760 00000100:00100000:3.0:1780997136.072709:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110373760 00000100:00100000:3.0:1780997136.072904:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1250 00000100:00100000:3.0:1780997136.072918:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110373760:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997136.073008:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110373760:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 94us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997136.073016:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1250 00000100:00100000:3.0:1780997136.073036:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1269 00000100:00100000:3.0:1780997136.073041:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110373632:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:3.0:1780997136.073061:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997136.073088:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110373632:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 46us (565us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997136.073093:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1269 00000100:00100000:3.0:1780997136.073115:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110373888 00000100:00100000:3.0:1780997136.073119:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110373888 00000100:00100000:3.0:1780997136.073144:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110374016 00000100:00100000:3.0:1780997136.073146:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110374016 00000100:00100000:3.0:1780997136.073165:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2570 00000100:00100000:3.0:1780997136.073189:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110373888:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997136.073218:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110373888:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 31us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997136.073224:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2570 00000100:00100000:0.0:1780997136.073245:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2571 00000100:00100000:0.0:1780997136.073257:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110374016:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997136.073324:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110374016:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 70us (693us total) trans 0 rc 0/0 00000100:00080000:2.0:1780997136.074352:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997136.074358:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997136.074361:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997136.093214:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2571 00010000:00010000:3.0:1780997136.101549:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997137.125575:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997138.150404:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997139.177994:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1780997140.080771:0:87009:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1780997140.080778:0:87009:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1780997140.080779:0:87009:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1780997140.081589:0:87009:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9689aebbd000 00000020:01000004:1.0:1780997140.081608:0:87009:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1780997140.081624:0:87009:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1780997140.081640:0:87009:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff96888ac53380) 00000020:00000080:1.0:1780997140.081658:0:87009:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1780997140.199218:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1780997140.246485:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1780997140.246688:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1780997140.248620:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1780997140.248864:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1780997140.249178:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1780997140.249464:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1780997140.249656:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1780997140.251733:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1780997140.253117:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1780997140.253445:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1780997140.253985:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1780997140.254299:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1780997140.254621:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1780997140.254979:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1780997140.256094:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1780997140.266463:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.266819:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.267873:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.268233:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.269593:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.270561:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.270850:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.271151:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.271366:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.271676:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.272031:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.272240:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.272616:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.273231:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.273805:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.275163:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.275559:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.275831:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.276348:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.276709:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.277142:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.278106:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.279145:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.280034:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.280862:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.281833:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.282335:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.282636:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.282898:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1780997140.283159:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.283397:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.283710:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1780997140.284627:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1780997140.285103:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1780997140.285805:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1780997140.287306:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1780997140.287568:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1780997140.287890:0:87009:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1780997140.288499:0:87009:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1780997140.288715:0:87009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1780997140.288733:0:87009:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1780997140.288743:0:87009:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305a585 00000020:01000004:2.0:1780997140.288749:0:87009:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1780997140.288760:0:87009:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1780997140.288765:0:87009:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9689aebbd000 from MGS 00000020:01000004:2.0:1780997140.288768:0:87009:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1780997140.288778:0:87009:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff968990fe0000) 00000020:00000080:2.0:1780997140.288799:0:87009:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1780997140.288864:0:87009:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689aebbd000 from MGS, refs=2 00080000:01000000:2.0:1780997140.288869:0:87009:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1780997140.288873:0:87009:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305a593 00010000:00010000:2.0:1780997140.288995:0:87009:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1780997140.295775:0:87009:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1780997140.298960:0:87013:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1780997140.299011:0:87009:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1780997140.299063:0:87009:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1780997140.301162:0:87009:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1780997140.301452:0:87009:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1780997140.301621:0:87009:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1780997140.301629:0:87009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1780997140.317328:0:87009:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1780997140.317344:0:87009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1780997140.318064:0:87009:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1780997140.318072:0:87009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1780997140.319825:0:87009:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1780997140.319852:0:87009:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1780997140.319854:0:87009:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1780997140.319859:0:87009:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1780997140.319873:0:87009:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96898d0e6000 already not connected (conn 70, was 0): CONNECTING 00000100:00100000:2.0:1780997140.319889:0:87009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1780997140.902846:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997140.902867:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126902144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997140.902942:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997140.903046:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126902144 00000100:00100000:0.0:1780997140.903056:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126902144 00000100:00100000:0.0:1780997140.903124:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:0.0:1780997140.903133:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126902144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997140.903175:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997140.903223:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126902144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997140.903230:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:0.0:1780997140.903300:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126902144:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1780997140.903724:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997140.904166:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997140.904171:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1780997140.904174:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997140.904177:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997140.904180:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997140.904185:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3663 00000100:00080000:3.0:1780997140.904189:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780997140.904193:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997140.904221:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b5880 x1867507126902272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997140.904247:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997140.904250:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997140.904252:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997140.904255:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3663 00000100:00080000:3.0:1780997140.904257:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780997140.904260:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997140.904289:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b7480 x1867507126902528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997140.904304:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997140.904307:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997140.904308:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997140.904311:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3663 00000100:00080000:3.0:1780997140.904323:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780997140.904327:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997140.904341:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b7b80 x1867507126902784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997140.904363:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997140.904367:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997140.904368:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997140.904371:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3663 00000100:00080000:3.0:1780997140.904373:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780997140.904376:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997140.904386:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b6300 x1867507126903040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997140.904417:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780997140.904428:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126902912:0@lo:400:kworker.0 00000100:00100000:3.0:1780997140.904472:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997140.904522:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126902912 00000100:00100000:3.0:1780997140.904528:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126902912 00000100:00100000:0.0:1780997140.904743:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126902272:0@lo:38:kworker.0 00000100:00100000:0.0:1780997140.904795:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997140.904815:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126902528:0@lo:38:kworker.0 00000100:00100000:0.0:1780997140.904838:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997140.904857:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126902784:0@lo:38:kworker.0 00000100:00100000:0.0:1780997140.904879:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997140.904893:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126903040:0@lo:38:kworker.0 00000100:00100000:0.0:1780997140.904926:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997140.904961:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126902656:0@lo:400:kworker.0 00000100:00100000:0.0:1780997140.904985:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997140.905003:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780997140.905008:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126902400:0@lo:400:kworker.0 00000100:00100000:0.0:1780997140.905030:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997140.905054:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126902272 00000100:00100000:0.0:1780997140.905058:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126902272 00000100:00100000:0.0:1780997140.905080:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126902528 00000100:00100000:0.0:1780997140.905082:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126902528 00000100:00100000:0.0:1780997140.905090:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126903040 00000100:00100000:0.0:1780997140.905092:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126903040 00000100:00100000:0.0:1780997140.905098:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126902656 00000100:00100000:0.0:1780997140.905100:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126902656 00000100:00100000:0.0:1780997140.905132:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126902400 00000100:00100000:0.0:1780997140.905135:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126902400 00000100:00100000:0.0:1780997140.905152:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1780997140.905159:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126902656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997140.905207:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126902656:12345-0@lo:400:kworker.0 Request processed in 48us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997140.905213:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1780997140.905229:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1780997140.905234:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126902400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997140.905262:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126902400:12345-0@lo:400:kworker.0 Request processed in 27us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997140.905286:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1780997140.905299:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1780997140.905303:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126902272:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997140.905321:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997140.905837:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:3.0:1780997140.905848:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126902912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997140.905897:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126902912:12345-0@lo:400:kworker.0 Request processed in 52us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997140.905903:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:3.0:1780997140.905931:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1780997140.905935:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126902528:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997140.905948:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997140.905992:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126902528:12345-0@lo:38:kworker.0 Request processed in 54us (1152us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997140.905999:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1780997140.906013:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1780997140.906017:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126903040:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997140.906027:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997140.906050:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126903040:12345-0@lo:38:kworker.0 Request processed in 32us (1123us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997140.906056:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00080000:3.0:1780997140.906077:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997140.906082:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997140.906116:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126902912:0@lo:400:kworker.0 00000100:00100000:3.0:1780997140.906204:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126902400:0@lo:400:kworker.0 00000100:00100000:3.0:1780997140.906214:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126902656:0@lo:400:kworker.0 00000100:00080000:3.0:1780997140.906249:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997140.906253:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997140.906256:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126902528:0@lo:38:kworker.0 00000100:00080000:3.0:1780997140.906263:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997140.906266:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997140.906287:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126903040:0@lo:38:kworker.0 00000100:00100000:2.0:1780997140.906389:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126902784 00000100:00100000:2.0:1780997140.906396:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126902784 00000100:00100000:2.0:1780997140.906430:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:2.0:1780997140.906435:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126902784:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997140.906446:0:8242:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997140.906500:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126902784:12345-0@lo:38:kworker.0 Request processed in 49us (1605us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997140.906506:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000100:00080000:2.0:1780997140.906555:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997140.906566:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997140.906570:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126902784:0@lo:38:kworker.0 00000100:00100000:1.0:1780997140.906765:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997140.906776:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126903168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997140.906819:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997140.906868:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126903168 00000100:00100000:1.0:1780997140.906872:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126903168 00000100:00100000:1.0:1780997140.906904:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1780997140.906911:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126903168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780997140.906934:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780997140.906971:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126903168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997140.906977:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1780997140.907015:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126903168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997140.937816:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126902272:12345-0@lo:38:kworker.0 Request processed in 32501us (33011us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997140.937833:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00080000:3.0:1780997140.938880:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997140.938888:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997140.938892:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126902272:0@lo:38:kworker.0 00010000:00010000:3.0:1780997141.222108:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997141.252405:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997141.252446:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997141.252480:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997141.252518:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997141.252565:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110374272 00000100:00100000:3.0:1780997141.252584:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110374272 00000100:00100000:3.0:1780997141.252647:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110374144 00000100:00100000:3.0:1780997141.252651:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110374144 00000100:00100000:3.0:1780997141.252668:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1253 00000100:00100000:3.0:1780997141.252678:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110374272:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997141.252765:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110374272:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 89us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997141.252773:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1253 00000100:00100000:3.0:1780997141.252802:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1273 00000100:00100000:3.0:1780997141.252807:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110374144:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:3.0:1780997141.252830:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997141.252856:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110374144:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 48us (337us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997141.252862:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1273 00000100:00080000:3.0:1780997141.252979:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997141.252997:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110374528 00000100:00100000:2.0:1780997141.253001:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110374528 00000100:00080000:3.0:1780997141.253026:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997141.253034:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110374400 00000100:00100000:2.0:1780997141.253036:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110374400 00000100:00100000:3.0:1780997141.253075:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2573 00000100:00100000:3.0:1780997141.253082:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd01bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110374528:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997141.253082:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2574 00000100:00100000:2.0:1780997141.253088:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110374400:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997141.253115:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd01bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110374528:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997141.253123:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110374400:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 37us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997141.253130:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2574 00000100:00100000:3.0:1780997141.253134:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2573 00000100:00080000:2.0:1780997141.253150:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1780997142.245516:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997143.269608:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997144.293519:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997145.317492:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780997146.021484:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997146.021492:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1780997146.021495:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997146.021498:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997146.021503:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997146.021512:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3668 00000100:00100000:1.0:1780997146.021513:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126903296:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1780997146.021516:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780997146.021523:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997146.021544:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b4a80 x1867507126903424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997146.021563:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997146.021566:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997146.021567:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997146.021570:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3668 00000100:00080000:3.0:1780997146.021572:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780997146.021575:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997146.021578:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997146.021583:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b5500 x1867507126903680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997146.021604:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997146.021608:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1780997146.021614:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997146.021619:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126903552:0@lo:400:kworker.0 00000100:00080000:3.0:1780997146.021621:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997146.021625:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3668 00000100:00080000:3.0:1780997146.021627:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780997146.021630:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997146.021642:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b7800 x1867507126903936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997146.021643:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780997146.021657:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997146.021660:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780997146.021661:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997146.021664:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3668 00000100:00100000:1.0:1780997146.021664:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126903808:0@lo:400:kworker.0 00000100:00080000:3.0:1780997146.021666:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780997146.021670:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997146.021679:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b5f80 x1867507126904192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997146.021687:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997146.021702:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997146.021707:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126904064:0@lo:400:kworker.0 00000100:00100000:1.0:1780997146.021731:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997146.021752:0:3495:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780997135/real 1780997135] req@ffff968986936680 x1867507126900736/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780997145 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997146.021782:0:3495:0:(client.c:2511:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff968986936680 x1867507126900736/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780997145 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997146.021801:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126903424:0@lo:38:kworker.0 00000100:00100000:1.0:1780997146.021801:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126903552 00000100:00100000:1.0:1780997146.021808:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126903552 00000100:00100000:2.0:1780997146.021827:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997146.021845:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126903680:0@lo:38:kworker.0 00000100:00100000:1.0:1780997146.021854:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126903808 00000100:00100000:1.0:1780997146.021856:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126903808 00000100:00100000:2.0:1780997146.021863:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997146.021873:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126903424 00000100:00100000:2.0:1780997146.021876:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126903936:0@lo:38:kworker.0 00000100:00100000:1.0:1780997146.021876:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126903424 00000100:00100000:1.0:1780997146.021885:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126903680 00000100:00100000:1.0:1780997146.021887:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126903680 00000100:00100000:2.0:1780997146.021896:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997146.021897:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1780997146.021909:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126904192:0@lo:38:kworker.0 00000100:00100000:1.0:1780997146.021911:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126903552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997146.021926:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780997146.021936:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997146.021944:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1780997146.021953:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126900736:0@lo:250:kworker.0 00000100:00080000:2.0:1780997146.021979:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 10000000:01000000:2.0:1780997146.021994:0:87009:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1780997146.022009:0:87009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305a15d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a164 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997146.022019:0:87009:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305a15d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a164 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997146.022026:0:87009:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1780997146.022038:0:87009:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780997146.022048:0:87009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305a15d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a164 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022060:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126903296 00000100:00100000:0.0:1780997146.022064:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126903296 00010000:00010000:2.0:1780997146.022066:0:87009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96898d6dbe00/0x30fd811c0305a0c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a0ca expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022099:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:0.0:1780997146.022106:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126903296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997146.022131:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 10000000:00010000:2.0:1780997146.022169:0:87009:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96898d6dbe00/0x30fd811c0305a0c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a0ca expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022172:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126903296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (593us total) trans 0 rc 0/0 10000000:01000000:2.0:1780997146.022175:0:87009:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780997146.022180:0:87009:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780997146.022184:0:87009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96898d6dbe00/0x30fd811c0305a0c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a0ca expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022184:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00010000:00010000:2.0:1780997146.022193:0:87009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c0305a0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a0e6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997146.022199:0:87009:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c0305a0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a0e6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997146.022204:0:87009:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1780997146.022205:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126904192 00010000:00010000:2.0:1780997146.022207:0:87009:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:0.0:1780997146.022208:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126904192 00010000:00010000:2.0:1780997146.022210:0:87009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96898d6db200/0x30fd811c0305a0df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a0e6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997146.022219:0:87009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc843800/0x30fd811c0305a109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a110 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022220:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 10000000:00010000:2.0:1780997146.022225:0:87009:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc843800/0x30fd811c0305a109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a110 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022226:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126903808:12345-0@lo:400:kworker.0 10000000:01000000:2.0:1780997146.022231:0:87009:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780997146.022234:0:87009:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780997146.022237:0:87009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc843800/0x30fd811c0305a109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a110 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997146.022259:0:87009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305a117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a11e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022259:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126903808:12345-0@lo:400:kworker.0 Request processed in 33us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997146.022265:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 10000000:00010000:2.0:1780997146.022266:0:87009:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305a117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a11e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022297:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 10000000:01000000:2.0:1780997146.022299:0:87009:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1780997146.022301:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126903424:12345-0@lo:38:kworker.0 00010000:00010000:2.0:1780997146.022303:0:87009:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780997146.022307:0:87009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305a117 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a11e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997146.022316:0:87009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2600/0x30fd811c0305a133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a13a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:0.0:1780997146.022317:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 10000000:00010000:2.0:1780997146.022321:0:87009:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2600/0x30fd811c0305a133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a13a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997146.022326:0:87009:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780997146.022329:0:87009:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780997146.022332:0:87009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2600/0x30fd811c0305a133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a13a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997146.022340:0:87009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96898d6da600/0x30fd811c0305a141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a148 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022346:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126903424:12345-0@lo:38:kworker.0 Request processed in 44us (519us total) trans 0 rc -19/-19 10000000:00010000:2.0:1780997146.022347:0:87009:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96898d6da600/0x30fd811c0305a141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a148 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997146.022353:0:87009:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1780997146.022353:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00010000:00010000:2.0:1780997146.022362:0:87009:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780997146.022366:0:87009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96898d6da600/0x30fd811c0305a141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a148 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022366:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1780997146.022370:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126903680:12345-0@lo:38:kworker.0 00010000:00010000:2.0:1780997146.022376:0:87009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc842e00/0x30fd811c0305a16b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a172 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:0.0:1780997146.022379:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 10000000:00010000:2.0:1780997146.022382:0:87009:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc842e00/0x30fd811c0305a16b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a172 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997146.022387:0:87009:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780997146.022390:0:87009:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780997146.022393:0:87009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc842e00/0x30fd811c0305a16b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a172 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022398:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126903680:12345-0@lo:38:kworker.0 Request processed in 28us (534us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997146.022404:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00010000:00010000:2.0:1780997146.022405:0:87009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc842800/0x30fd811c0305a0d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a0d8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997146.022411:0:87009:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc842800/0x30fd811c0305a0d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a0d8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022413:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 10000000:01000000:2.0:1780997146.022417:0:87009:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1780997146.022417:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126904192:12345-0@lo:38:kworker.0 00010000:00010000:2.0:1780997146.022420:0:87009:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780997146.022423:0:87009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc842800/0x30fd811c0305a0d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a0d8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:0.0:1780997146.022426:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:2.0:1780997146.022435:0:87009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96898d6da000/0x30fd811c0305a0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a0f4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997146.022442:0:87009:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96898d6da000/0x30fd811c0305a0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a0f4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022444:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126904192:12345-0@lo:38:kworker.0 Request processed in 26us (517us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997146.022455:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 10000000:01000000:2.0:1780997146.022456:0:87009:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1780997146.022459:0:87009:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780997146.022464:0:87009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96898d6da000/0x30fd811c0305a0ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a0f4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1780997146.022472:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780997146.022475:0:87009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305a0fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a102 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997146.022480:0:87009:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305a0fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a102 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997146.022485:0:87009:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1780997146.022487:0:87009:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780997146.022490:0:87009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305a0fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a102 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997146.022499:0:87009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305a125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a12c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022503:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126904320:0@lo:13:osp-pre-0-1.0 10000000:00010000:2.0:1780997146.022506:0:87009:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305a125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a12c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997146.022511:0:87009:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1780997146.022514:0:87009:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780997146.022517:0:87009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3800/0x30fd811c0305a125 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a12c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997146.022526:0:87009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968888954400/0x30fd811c0305a14f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a156 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022526:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1780997146.022541:0:87009:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968888954400/0x30fd811c0305a14f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a156 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997146.022546:0:87009:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1780997146.022549:0:87009:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780997146.022553:0:87009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968888954400/0x30fd811c0305a14f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a156 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.022562:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126903296:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1780997146.022567:0:87009:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96898d0e6000 already not connected (conn 70, was 0): DISCONN 00000100:00080000:2.0:1780997146.022571:0:87009:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997146.022575:0:87009:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3663 00000100:00080000:2.0:1780997146.022577:0:87009:0:(import.c:591:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780997146.022581:0:87009:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00080000:0.0:1780997146.022587:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997146.022590:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997146.022593:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126903424:0@lo:38:kworker.0 00000100:00100000:2.0:1780997146.022595:0:87009:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a5d82300 x1867507126904448/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997146.022600:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997146.022603:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00080000:2.0:1780997146.022606:0:87009:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1780997146.022606:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126903680:0@lo:38:kworker.0 00000100:00080000:0.0:1780997146.022613:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997146.022616:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997146.022619:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126904192:0@lo:38:kworker.0 00000100:00100000:0.0:1780997146.022637:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126904448:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1780997146.022643:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126904320 00000100:00100000:2.0:1780997146.022646:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126904320 00000100:00100000:0.0:1780997146.022663:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997146.022677:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:2.0:1780997146.022684:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126904320:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1780997146.022690:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1780997146.022700:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997146.022739:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126904320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.022746:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00100000:3.0:1780997146.022869:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126904064 00000100:00100000:3.0:1780997146.022874:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126904064 00000100:00100000:3.0:1780997146.022903:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:3.0:1780997146.022910:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126904064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997146.022964:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126904320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997146.022999:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126903936 00000100:00100000:0.0:1780997146.023003:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126903936 00000100:00100000:0.0:1780997146.023022:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:0.0:1780997146.023027:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126903936:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997146.023037:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997146.023180:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126903808:0@lo:400:kworker.0 00000100:00080000:2.0:1780997146.023210:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997146.023219:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1780997146.023244:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126904448 00000100:00100000:2.0:1780997146.023248:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126904448 00000100:00100000:2.0:1780997146.023288:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1780997146.023293:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b798fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3495:x1867507126904448:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1780997146.023307:0:87016:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo t0 exp 0000000000000000 cur 3673 last 0 00000020:00000080:2.0:1780997146.023331:0:87016:0:(genops.c:1406:class_connect()) connect: client bdcd4e03-8d56-43b8-bfda-3b2f97e67d18, cookie 0x30fd811c0305a59a 00000100:00080000:2.0:1780997146.023433:0:87016:0:(import.c:65:import_set_state_nolock()) ffff968886f5c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997146.023476:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b798fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:3495:x1867507126904448:12345-0@lo:250:mount.lustre.0 Request processed in 181us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.023482:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1780997146.023517:0:3495:0:(client.c:3131:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 26 00000100:00080000:2.0:1780997146.023524:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:2.0:1780997146.023530:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1780997146.023533:0:3495:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1780997146.023536:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1780997146.023539:0:3495:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1780997146.023551:0:3495:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1780997146.023557:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126904448:0@lo:250:mount.lustre.0 00000020:01000000:2.0:1780997146.023590:0:36:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.206.151@tcp 10000000:01000000:2.0:1780997146.023604:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1780997146.023607:0:36:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780997146.023609:0:36:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1780997146.023610:0:36:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780997146.023611:0:36:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780997146.023612:0:36:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780997146.023613:0:36:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780997146.023614:0:36:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780997146.023616:0:36:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780997146.023618:0:36:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1780997146.023649:0:36:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1780997146.023655:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1780997146.023657:0:36:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780997146.023658:0:36:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1780997146.023659:0:36:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780997146.023660:0:36:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780997146.023661:0:36:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780997146.023662:0:36:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780997146.023663:0:36:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780997146.023664:0:36:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780997146.023665:0:36:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1780997146.023683:0:36:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1780997146.023687:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1780997146.023688:0:36:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780997146.023689:0:36:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1780997146.023690:0:36:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780997146.023691:0:36:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780997146.023692:0:36:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780997146.023693:0:36:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780997146.023695:0:36:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780997146.023696:0:36:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780997146.023697:0:36:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1780997146.023708:0:36:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1780997146.023731:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126904576:0@lo:253:kworker.0 00000100:00100000:2.0:1780997146.023775:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997146.023808:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126904704:0@lo:253:kworker.0 00000100:00100000:2.0:1780997146.023836:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997146.023850:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997146.023855:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126904832:0@lo:253:kworker.0 00000100:00100000:2.0:1780997146.023879:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997146.023895:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126904576 00000100:00100000:2.0:1780997146.023899:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126904576 00000100:00100000:2.0:1780997146.023914:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126904704 00000100:00100000:2.0:1780997146.023917:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126904704 00000100:00100000:2.0:1780997146.023924:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126904832 00000100:00100000:2.0:1780997146.023932:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126904832 00000100:00100000:2.0:1780997146.023947:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1780997146.023952:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b798d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:3499:x1867507126904576:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1780997146.023970:0:87016:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00080000:2.0:1780997146.024002:0:87009:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1780997146.024011:0:87009:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1780997146.024046:0:87009:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1780997146.024051:0:87009:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000100:00100000:1.0:1780997146.025386:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126903552:12345-0@lo:400:kworker.0 Request processed in 3469us (3735us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997146.025399:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1780997146.025445:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1780997146.025454:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b798d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:3496:x1867507126904704:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1780997146.025476:0:87017:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1780997146.025513:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126903552:0@lo:400:kworker.0 10000000:01000000:1.0:1780997146.025693:0:87019:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1780997146.025796:0:87016:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 112 00000100:00100000:3.0:1780997146.027629:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126904064:12345-0@lo:400:kworker.0 Request processed in 4712us (5888us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997146.027642:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:1.0:1780997146.027833:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126904064:0@lo:400:kworker.0 00000040:01000000:2.0:1780997146.028310:0:87009:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1780997146.028357:0:87009:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1780997146.028363:0:87009:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1780997146.028364:0:87009:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1780997146.028365:0:87009:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780997146.028367:0:87009:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780997146.028368:0:87009:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780997146.028370:0:87009:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780997146.028371:0:87009:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780997146.028373:0:87009:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1780997146.028375:0:87009:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780997146.028376:0:87009:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1780997146.028380:0:87009:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1780997146.028382:0:87009:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1780997146.028383:0:87009:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1780997146.028384:0:87009:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780997146.028385:0:87009:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780997146.028386:0:87009:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780997146.028387:0:87009:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780997146.028388:0:87009:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780997146.028389:0:87009:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1780997146.028390:0:87009:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780997146.028391:0:87009:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1780997146.028419:0:87009:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1780997146.028439:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126904960:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1780997146.028490:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997146.028518:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff968887499780 going to sleep for 11 seconds 20000000:01000000:3.0:1780997146.029391:0:87020:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1780997146.029396:0:87020:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1780997146.029399:0:87020:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1780997146.029402:0:87020:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1780997146.029776:0:87020:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1780997146.029880:0:87016:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1780997146.029906:0:87016:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1780997146.030004:0:87015:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1780997146.030014:0:87015:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1780997146.030334:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126904960 00000100:00100000:1.0:1780997146.030344:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126904960 00000100:00100000:2.0:1780997146.030508:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1780997146.030519:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3496:x1867507126904832:12345-0@lo:253:kworker.0 00000100:00100000:0.0:1780997146.030526:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126903936:12345-0@lo:38:kworker.0 Request processed in 7497us (8628us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997146.030535:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 20000000:01000000:2.0:1780997146.030551:0:87021:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:3.0:1780997146.031304:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997146.031312:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997146.031317:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126903936:0@lo:38:kworker.0 20000000:01000000:2.0:1780997146.032786:0:87017:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1780997146.033561:0:87016:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1780997146.033639:0:87016:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1780997146.036061:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b798d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3499:x1867507126904576:12345-0@lo:253:kworker.0 Request processed in 12096us (12273us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997146.036085:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1780997146.036138:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1780997146.036151:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:87009:x1867507126904960:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1780997146.036200:0:87016:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1780997146.036203:0:87016:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1780997146.036206:0:87016:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1780997146.036212:0:87016:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:0.0:1780997146.036595:0:3499:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1780997146.036598:0:3499:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1780997146.036600:0:3499:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997146.036601:0:3499:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997146.036602:0:3499:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997146.036604:0:3499:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997146.036605:0:3499:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780997146.036607:0:3499:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997146.036608:0:3499:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1780997146.036612:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126904576:0@lo:253:kworker.0 00000100:00100000:3.0:1780997146.036766:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:87009:x1867507126904960:12345-0@lo:253:mount.lustre.0 Request processed in 620us (8275us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997146.036774:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1780997146.036896:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126904960:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1780997146.036909:0:87009:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1780997146.036911:0:87009:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1780997146.036912:0:87009:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780997146.036913:0:87009:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997146.036915:0:87009:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997146.036916:0:87009:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997146.036916:0:87009:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997146.036918:0:87009:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997146.036919:0:87009:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780997146.036920:0:87009:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997146.036922:0:87009:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1780997146.036951:0:87009:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9689aebbd000 from lustre-MDT0000 10000000:01000000:0.0:1780997146.036987:0:87009:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1780997146.036990:0:87009:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1780997146.037000:0:87009:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9689aebbd000 10000000:01000000:0.0:1780997146.037005:0:87009:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1780997146.037010:0:87009:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9689aebbd000 10000000:01000000:0.0:1780997146.037013:0:87009:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1780997146.037016:0:87009:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9689aebbd000 from 1 10000000:01000000:0.0:1780997146.037019:0:87009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1780997146.037370:0:87009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997146.037381:0:87009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997146.037391:0:87009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.037423:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126905088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780997146.037461:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997146.037487:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886fbbe40 going to sleep for 11 seconds 20000000:01000000:2.0:1780997146.038106:0:87017:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000100:00100000:3.0:1780997146.038162:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126905088 00000100:00100000:3.0:1780997146.038171:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126905088 00000100:00100000:3.0:1780997146.038214:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1780997146.038223:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:87009:x1867507126905088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997146.038237:0:87016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997146.038256:0:87016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305a5a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a5a1 expref: -99 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.038299:0:87016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305a5a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a5a1 expref: 7 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.038325:0:87016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305a5a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a5a1 expref: 7 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.038335:0:87016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2800, rc 0) 00000100:00100000:3.0:1780997146.038381:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:87009:x1867507126905088:12345-0@lo:101:mount.lustre.0 Request processed in 159us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997146.038388:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1780997146.038452:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126905088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997146.038468:0:87009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.038477:0:87009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997146.038493:0:87009:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1780997146.038503:0:87009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.038511:0:87009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997146.038517:0:87009:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1780997146.038520:0:87009:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1780997146.038524:0:87009:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9689aebbd000 10000000:01000000:3.0:1780997146.038527:0:87009:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1780997146.038530:0:87009:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1780997146.038532:0:87009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1780997146.038559:0:87009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.038566:0:87009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.038574:0:87009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997146.038590:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126905216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1780997146.038620:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997146.038642:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722600 going to sleep for 11 seconds 00000100:00100000:3.0:1780997146.038663:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126905216 00000100:00100000:3.0:1780997146.038667:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126905216 00000100:00100000:3.0:1780997146.038697:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1780997146.038704:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:87009:x1867507126905216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997146.038711:0:87016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997146.038719:0:87016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb3600/0x30fd811c0305a5b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a5af expref: -99 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.038733:0:87016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb3600/0x30fd811c0305a5b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a5af expref: 8 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.038741:0:87016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb3600/0x30fd811c0305a5b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a5af expref: 8 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.038750:0:87016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3600, rc 0) 00000100:00100000:3.0:1780997146.038788:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:87009:x1867507126905216:12345-0@lo:101:mount.lustre.0 Request processed in 84us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997146.038794:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1780997146.038831:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126905216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997146.038841:0:87009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.038848:0:87009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997146.038903:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126905344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780997146.038927:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997146.038951:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722600 going to sleep for 11 seconds 00000100:00100000:3.0:1780997146.038964:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126905344 00000100:00100000:3.0:1780997146.038967:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126905344 00000100:00100000:3.0:1780997146.038985:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1780997146.038991:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:87009:x1867507126905344:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780997146.039139:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:87009:x1867507126905344:12345-0@lo:501:mount.lustre.0 Request processed in 147us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997146.039146:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1780997146.039172:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126905344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780997146.039198:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126905472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780997146.039235:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997146.039247:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722600 going to sleep for 11 seconds 00000100:00100000:3.0:1780997146.039258:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126905472 00000100:00100000:3.0:1780997146.039261:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126905472 00000100:00100000:3.0:1780997146.039300:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1780997146.039307:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:87009:x1867507126905472:12345-0@lo:503:mount.lustre.0 20000000:01000000:0.0:1780997146.040550:0:87021:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1780997146.041422:0:87019:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 2 10000000:01000000:1.0:1780997146.041429:0:87019:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780997146.041452:0:87019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96888956f200/0x30fd811c0305a5bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.041470:0:87019:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96888956f200/0x30fd811c0305a5bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780997146.041480:0:87019:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000052068s 00010000:00010000:1.0:1780997146.041485:0:87019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96888956f200/0x30fd811c0305a5bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.041492:0:87019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96888956f200/0x30fd811c0305a5bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.041510:0:87019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96888956f200/0x30fd811c0305a5bd lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.041519:0:87019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96888956f200/0x30fd811c0305a5bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.041526:0:87019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997146.041530:0:87019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96888956f200/0x30fd811c0305a5bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.041539:0:87019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96888956f200/0x30fd811c0305a5bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.041550:0:87019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96888956f200/0x30fd811c0305a5bd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.041557:0:87019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96888956f200/0x30fd811c0305a5bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.041565:0:87019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96888956f200/0x30fd811c0305a5bd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997146.041888:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:87009:x1867507126905472:12345-0@lo:503:mount.lustre.0 Request processed in 2576us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997146.041907:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1780997146.045690:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126905472:0@lo:503:mount.lustre.0 20000000:01000000:1.0:1780997146.046306:0:87021:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1780997146.046317:0:87021:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1780997146.046651:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:3496:x1867507126904832:12345-0@lo:253:kworker.0 Request processed in 16132us (22768us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997146.046663:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1780997146.046777:0:3496:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1780997146.046785:0:3496:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1780997146.046787:0:3496:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997146.046789:0:3496:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997146.046790:0:3496:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997146.046792:0:3496:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997146.046793:0:3496:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780997146.046796:0:3496:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997146.046797:0:3496:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1780997146.046801:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126904832:0@lo:253:kworker.0 20000000:01000000:3.0:1780997146.047895:0:87019:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1780997146.047903:0:87019:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1780997146.047926:0:87019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689bcbb2000/0x30fd811c0305a5c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.047952:0:87019:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb2000/0x30fd811c0305a5c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780997146.047963:0:87019:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000061024s 00010000:00010000:3.0:1780997146.047968:0:87019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bcbb2000/0x30fd811c0305a5c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.047974:0:87019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bcbb2000/0x30fd811c0305a5c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.047981:0:87019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689bcbb2000/0x30fd811c0305a5c4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.047989:0:87019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689bcbb2000/0x30fd811c0305a5c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.047995:0:87019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997146.047999:0:87019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689bcbb2000/0x30fd811c0305a5c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.048007:0:87019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689bcbb2000/0x30fd811c0305a5c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.048019:0:87019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689bcbb2000/0x30fd811c0305a5c4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.048042:0:87019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689bcbb2000/0x30fd811c0305a5c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.048050:0:87019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2000/0x30fd811c0305a5c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.048423:0:87022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87022:1867507126905600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997146.048493:0:87022:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997146.048529:0:87022:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886fbbb40 going to sleep for 11 seconds 20000000:01000000:2.0:1780997146.048629:0:87017:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1780997146.049132:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b798d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3496:x1867507126904704:12345-0@lo:253:kworker.0 Request processed in 23678us (25292us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.049143:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1780997146.049176:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126905600 00000100:00100000:2.0:1780997146.049184:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126905600 00000100:00100000:2.0:1780997146.049223:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1780997146.049232:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:87022:x1867507126905600:12345-0@lo:502:llog_process_th.0 00000020:01000004:2.0:1780997146.049475:0:3496:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1780997146.049478:0:3496:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1780997146.049480:0:3496:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780997146.049481:0:3496:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780997146.049482:0:3496:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780997146.049483:0:3496:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780997146.049485:0:3496:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780997146.049486:0:3496:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780997146.049487:0:3496:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1780997146.049490:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126904704:0@lo:253:kworker.0 00000100:00100000:2.0:1780997146.050564:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:87022:x1867507126905600:12345-0@lo:502:llog_process_th.0 Request processed in 1329us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.050575:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1780997146.059743:0:87022:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87022:1867507126905600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780997146.059808:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780997146.059824:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997146.059827:0:87022:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1780997146.059832:0:87022:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1780997146.059837:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780997146.059855:0:87022:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff968886ec4d40) 00000020:00000080:0.0:1780997146.059886:0:87022:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:0.0:1780997146.059890:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1780997146.059990:0:87022:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1780997146.059997:0:87022:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305a5d2 00000020:00000080:0.0:1780997146.060247:0:87022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1780997146.060252:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997146.060255:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997146.060260:0:87022:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1780997146.060263:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780997146.060267:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997146.060287:0:87022:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1780997146.060291:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780997146.060299:0:87022:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff968886ec3380) 00000020:00000080:0.0:1780997146.060310:0:87022:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:0.0:1780997146.060315:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1780997146.060317:0:87022:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1780997146.060320:0:87022:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1780997146.060325:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1780997146.060371:0:87022:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689aebbd000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1780997146.060383:0:87022:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff968886ec0000) 00000020:00000080:0.0:1780997146.060394:0:87022:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:0.0:1780997146.060435:0:87022:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1780997146.060440:0:87022:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305a5e7 00000020:00000080:0.0:1780997146.060524:0:87022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1780997146.060531:0:87022:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1780997146.060535:0:87022:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x30fd811c0305a5ee 00080000:01000000:0.0:1780997146.060540:0:87022:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1780997146.060543:0:87022:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305a5f5 00010000:00010000:1.0:1780997146.134070:0:87022:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:1.0:1780997146.134221:0:87022:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 285c134c-d3a6-4c01-bb4d-8148c50d5f95 idx: 0 lr: 103079215115 srv lr: 107374182400 lx: 0 gen 22 00000001:00080000:1.0:1780997146.134264:0:87022:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 21 00000001:00000004:1.0:1780997146.134316:0:87022:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:1.0:1780997146.134422:0:87022:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1780997146.134480:0:87022:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff96888a563e40: xid 1867507110365312, transno 107374182407, client gen 22, slot idx 0 00000001:00080000:1.0:1780997146.134492:0:87022:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff96888a563900: xid 1867507110365056, transno 107374182406, client gen 22, slot idx 1 00000020:00000080:1.0:1780997146.137245:0:87022:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff96888ac54d40) 00000020:00000080:1.0:1780997146.137291:0:87022:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:1.0:1780997146.137381:0:87022:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1780997146.137388:0:87022:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305a611 00000020:00000080:2.0:1780997146.139963:0:87022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1780997146.147445:0:87022:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x30fd811c0305a618 00000020:00000080:0.0:1780997146.148752:0:87022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1780997146.148776:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997146.148782:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997146.148784:0:87022:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1780997146.148787:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1780997146.148790:0:87022:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1780997146.148792:0:87022:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780997146.148793:0:87022:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780997146.148794:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1780997146.148796:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997146.148798:0:87022:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1780997146.148800:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780997146.148812:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997146.148813:0:87022:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1780997146.148818:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1780997146.148870:0:87022:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1780997146.148886:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997146.148890:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997146.148891:0:87022:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1780997146.148893:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780997146.148896:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997146.148898:0:87022:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1780997146.148901:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1780997146.148905:0:87022:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:00000080:0.0:1780997146.148935:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780997146.149079:0:87022:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff968886ec19c0) 00000020:00000080:0.0:1780997146.149101:0:87022:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1780997146.149109:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1780997146.149171:0:87022:0:(osp_dev.c:1197:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1780997146.149177:0:87022:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1780997146.149183:0:87022:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305a626 00010000:00080000:0.0:1780997146.149213:0:87022:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96898d685000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1780997146.157471:0:87022:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1780997146.167266:0:87022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997146.167461:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1780997146.167515:0:87022:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1780997146.167539:0:87022:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305a62d 00000100:00080000:1.0:1780997146.167551:0:87022:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780997146.167558:0:87022:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96898d685000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997146.167599:0:87022:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988613480 x1867507126905728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997146.167630:0:87022:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1780997146.167737:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997146.167741:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997146.167743:0:87022:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1780997146.167746:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780997146.167749:0:87022:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1780997146.167751:0:87022:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997146.167765:0:87022:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997146.167767:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780997146.167770:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997146.167771:0:87022:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780997146.167775:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1780997146.167779:0:87022:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1780997146.167783:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997146.167784:0:87022:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1780997146.167787:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780997146.167791:0:87022:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:1.0:1780997146.167824:0:87022:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1780997146.167837:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780997146.167852:0:87022:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96888ac50000) 00000020:00000080:1.0:1780997146.167871:0:87022:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1780997146.167876:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1780997146.167944:0:87022:0:(osp_dev.c:1197:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1780997146.167950:0:87022:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1780997146.167955:0:87022:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305a63b 00010000:00080000:1.0:1780997146.167996:0:87022:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689bc9e1000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1780997146.168194:0:87022:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1780997146.168704:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126905728:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780997146.168794:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997146.169502:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126905728 00000100:00100000:1.0:1780997146.169512:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126905728 00000100:00100000:1.0:1780997146.169552:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:1.0:1780997146.169558:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126905728:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1780997146.169587:0:8242:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3673 last 0 00000020:00000080:1.0:1780997146.169623:0:8242:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305a642 00000004:00100000:1.0:1780997146.169638:0:8242:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780997146.169742:0:8242:0:(import.c:65:import_set_state_nolock()) ffff9689869c9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997146.169818:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126905728:12345-0@lo:38:llog_process_th.0 Request processed in 258us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997146.169826:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000100:00100000:2.0:1780997146.169971:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780997146.169981:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:2.0:1780997146.169989:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1780997146.169999:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1780997146.170002:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d685000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1780997146.170023:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126905728:0@lo:38:llog_process_th.0 00000040:01000000:0.0:1780997146.170036:0:87022:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1780997146.170067:0:87022:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1780997146.170143:0:87022:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000100:00100000:0.0:1780997146.170717:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780997146.170731:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126905856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997146.170790:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997146.175098:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126905856 00000100:00100000:3.0:1780997146.175113:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126905856 00000100:00100000:3.0:1780997146.175172:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:3.0:1780997146.175183:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126905856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780997146.175233:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1780997146.175413:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126905856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 230us (4620us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997146.175422:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000040:00080000:2.0:1780997146.176388:0:87022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780997146.176422:0:87022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000040:00080000:2.0:1780997146.176600:0:87022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:2.0:1780997146.178092:0:87028:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:2.0:1780997146.178100:0:87028:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1780997146.178337:0:87028:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:2.0:1780997146.178360:0:87028:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1780997146.178490:0:87028:0:(llog.c:800:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:2.0:1780997146.178494:0:87028:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1780997146.182036:0:87022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780997146.182055:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1780997146.182103:0:87022:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1780997146.182123:0:87022:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305a649 00000100:00080000:2.0:1780997146.182133:0:87022:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780997146.182139:0:87022:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9689bc9e1000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997146.182179:0:87022:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a5d83800 x1867507126905984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997146.182210:0:87022:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1780997146.182264:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997146.182297:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997146.182299:0:87022:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1780997146.182303:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1780997146.182305:0:87022:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1780997146.182307:0:87022:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780997146.182308:0:87022:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780997146.182310:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1780997146.182324:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997146.182326:0:87022:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1780997146.182329:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1780997146.182333:0:87022:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1780997146.182336:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997146.182337:0:87022:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1780997146.182340:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1780997146.182344:0:87022:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:2.0:1780997146.182367:0:87022:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1780997146.182369:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1780997146.182379:0:87022:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff968990fe19c0) 00000020:00000080:2.0:1780997146.182395:0:87022:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:2.0:1780997146.182398:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1780997146.182455:0:87022:0:(osp_dev.c:1197:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1780997146.182461:0:87022:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1780997146.182465:0:87022:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305a657 00010000:00080000:2.0:1780997146.182490:0:87022:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689ba41b800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:2.0:1780997146.182657:0:87022:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:1.0:1780997146.183613:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126905856:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1780997146.184058:0:87022:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1780997146.184077:0:87022:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1780997146.185192:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126905984:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1780997146.185267:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1780997146.186676:0:87022:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000100:00100000:1.0:1780997146.186904:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126905984 00000100:00100000:1.0:1780997146.186917:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126905984 00000100:00100000:1.0:1780997146.186964:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5941 00000100:00100000:1.0:1780997146.186973:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3495:x1867507126905984:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1780997146.187016:0:25171:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3673 last 0 00000020:00000080:1.0:1780997146.187046:0:25171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305a65e 00002000:00100000:1.0:1780997146.187062:0:25171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9689bcb6b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1780997146.187066:0:25171:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1780997146.187069:0:25171:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1780997146.187126:0:25171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1780997146.187159:0:25171:0:(import.c:65:import_set_state_nolock()) ffff9689bcb6c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997146.187261:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126905984:12345-0@lo:8:llog_process_th.0 Request processed in 288us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997146.187287:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5941 00000100:00100000:3.0:1780997146.187327:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780997146.187337:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1780997146.187345:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1780997146.187349:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1780997146.187352:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bc9e1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1780997146.187386:0:3495:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:3.0:1780997146.187392:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126905984:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1780997146.187726:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780997146.187749:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126906112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780997146.187795:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997146.187867:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126906112 00000100:00100000:0.0:1780997146.187873:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126906112 00000100:00100000:0.0:1780997146.187917:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:0.0:1780997146.187924:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126906112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780997146.188020:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997146.188068:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126906112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997146.188075:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00080000:0.0:1780997146.188096:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997146.189488:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126906112:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1780997146.189886:0:87028:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000040:00080000:3.0:1780997146.190028:0:87022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1780997146.190065:0:87022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000040:00080000:3.0:1780997146.190229:0:87022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000004:00080000:0.0:1780997146.190496:0:87028:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3673736224489ns, next at 0ns, rc = 0 00080000:00080000:0.0:1780997146.190504:0:87028:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:1.0:1780997146.192037:0:87030:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:1.0:1780997146.192044:0:87030:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1780997146.192237:0:87030:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000020:00000080:3.0:1780997146.194428:0:87022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1780997146.194443:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1780997146.194485:0:87022:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1780997146.194507:0:87022:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305a665 00000100:00080000:3.0:1780997146.194517:0:87022:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1780997146.194538:0:87022:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9689ba41b800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997146.194574:0:87022:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b4000 x1867507126906240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780997146.194607:0:87022:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1780997146.194655:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780997146.194660:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997146.194662:0:87022:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1780997146.194665:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997146.194670:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997146.194671:0:87022:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1780997146.194675:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1780997146.194677:0:87022:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1780997146.194679:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780997146.194681:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997146.194682:0:87022:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1780997146.194685:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997146.194687:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997146.194688:0:87022:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1780997146.194691:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1780997146.194721:0:87022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87022:1867507126906368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997146.194832:0:87022:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997146.194878:0:87022:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997146.194893:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126906368 00000100:00100000:0.0:1780997146.194900:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126906368 00000100:00100000:0.0:1780997146.194989:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1780997146.194999:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:87022:x1867507126906368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997146.195010:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126906240:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780997146.195048:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997146.195084:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126906240 00000100:00100000:2.0:1780997146.195088:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126906240 00000100:00100000:2.0:1780997146.195109:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5942 00000100:00100000:2.0:1780997146.195114:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3495:x1867507126906240:12345-0@lo:8:llog_process_th.0 00000100:00100000:0.0:1780997146.195114:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:87022:x1867507126906368:12345-0@lo:502:llog_process_th.0 Request processed in 117us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997146.195121:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1780997146.195135:0:8230:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3673 last 0 00000020:00000080:2.0:1780997146.195170:0:8230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305a66c 00002000:00100000:2.0:1780997146.195186:0:8230:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9688858f4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1780997146.195190:0:8230:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1780997146.195193:0:8230:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1780997146.195288:0:8230:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1780997146.195311:0:8230:0:(import.c:65:import_set_state_nolock()) ffff9688858f0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997146.195351:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126906240:12345-0@lo:8:llog_process_th.0 Request processed in 235us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.195358:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5942 00000100:00100000:2.0:1780997146.195394:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780997146.195402:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1780997146.195409:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1780997146.195414:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1780997146.195416:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ba41b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1780997146.195420:0:3495:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:2.0:1780997146.195425:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126906240:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780997146.195481:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126906496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997146.195507:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997146.195885:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126906496 00000100:00100000:2.0:1780997146.195891:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126906496 00000100:00100000:2.0:1780997146.195928:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:2.0:1780997146.195936:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126906496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780997146.195950:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997146.196046:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126906496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.196053:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00080000:2.0:1780997146.196081:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997146.196106:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126906496:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1780997146.197785:0:87030:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1780997146.198545:0:87022:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87022:1867507126906368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780997146.198605:0:87022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997146.198614:0:87022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997146.198616:0:87022:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1780997146.198621:0:87022:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1780997146.198780:0:87009:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1780997146.198812:0:87009:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1780997146.198835:0:87009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.198847:0:87009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997146.198855:0:87009:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9689aebbd000 from 1 10000000:01000000:3.0:1780997146.198858:0:87009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1780997146.198901:0:87009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.198910:0:87009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.198920:0:87009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997146.198954:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126906624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1780997146.199026:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997146.199071:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c900 going to sleep for 11 seconds 00000100:00100000:2.0:1780997146.199290:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126906624 00000100:00100000:2.0:1780997146.199298:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126906624 00000040:00080000:1.0:1780997146.199300:0:87030:0:(llog.c:800:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:1.0:1780997146.199304:0:87030:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1780997146.199328:0:87030:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1780997146.199335:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1780997146.199343:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:87009:x1867507126906624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997146.199358:0:87015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997146.199375:0:87015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455e00/0x30fd811c0305a67a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a673 expref: -99 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780997146.199377:0:87030:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3673745106067ns, next at 0ns, rc = 0 00080000:00080000:1.0:1780997146.199382:0:87030:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:2.0:1780997146.199400:0:87015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455e00/0x30fd811c0305a67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a673 expref: 8 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997146.199410:0:87015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455e00/0x30fd811c0305a67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a673 expref: 8 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997146.199419:0:87015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455e00, rc 0) 00000100:00100000:2.0:1780997146.199473:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:87009:x1867507126906624:12345-0@lo:101:mount.lustre.0 Request processed in 130us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.199480:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1780997146.199950:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126906624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997146.199965:0:87009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a67a expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.199975:0:87009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a67a expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997146.202315:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126906752:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1780997146.202402:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997146.202493:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db73c0 going to sleep for 11 seconds 00000004:00080000:0.0:1780997146.203301:0:87010:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1780997146.203666:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126906752 00000100:00100000:3.0:1780997146.203675:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126906752 00000100:00100000:3.0:1780997146.203730:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1780997146.203741:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:87009:x1867507126906752:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1780997146.203781:0:87016:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1780997146.203876:0:87016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1780997146.203881:0:87016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1780997146.203891:0:87016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1780997146.203894:0:87016:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 115 00000100:00100000:3.0:1780997146.204196:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:87009:x1867507126906752:12345-0@lo:256:mount.lustre.0 Request processed in 456us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997146.204205:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1780997146.204303:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126906752:0@lo:256:mount.lustre.0 00000004:00080000:0.0:1780997146.205066:0:87010:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:1.0:1780997146.206193:0:87009:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780997146.206229:0:87009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a67a expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.206243:0:87009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a67a expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997146.206360:0:87009:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9689aebbd000 from 1 10000000:01000000:0.0:1780997146.206364:0:87009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780997146.206428:0:87009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997146.206437:0:87009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997146.206451:0:87009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.206480:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126906880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780997146.206549:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997146.206594:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986925f00 going to sleep for 11 seconds 00000100:00100000:3.0:1780997146.206672:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126906880 00000100:00100000:3.0:1780997146.206681:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126906880 00000100:00100000:3.0:1780997146.206733:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1780997146.206742:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:87009:x1867507126906880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997146.206765:0:87017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997146.206780:0:87017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb2c00/0x30fd811c0305a688 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a681 expref: -99 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.206803:0:87017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb2c00/0x30fd811c0305a688 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a681 expref: 9 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.206813:0:87017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb2c00/0x30fd811c0305a688 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a681 expref: 9 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.206821:0:87017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2c00, rc 0) 00000100:00100000:3.0:1780997146.206869:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:87009:x1867507126906880:12345-0@lo:101:mount.lustre.0 Request processed in 127us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997146.206876:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1780997146.206900:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126906880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997146.206913:0:87009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.206933:0:87009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997146.207063:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126907008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780997146.207091:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997146.207111:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997146.207135:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126907008 00000100:00100000:2.0:1780997146.207141:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126907008 00000100:00100000:2.0:1780997146.207174:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1780997146.207181:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:87009:x1867507126907008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997146.207393:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:87009:x1867507126907008:12345-0@lo:501:mount.lustre.0 Request processed in 212us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.207401:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1780997146.207462:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126907008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780997146.207491:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126907136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780997146.207690:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997146.207717:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997146.207774:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126907136 00000100:00100000:3.0:1780997146.207778:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126907136 00000100:00100000:3.0:1780997146.207805:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1780997146.207812:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:87009:x1867507126907136:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780997146.207904:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:87009:x1867507126907136:12345-0@lo:503:mount.lustre.0 Request processed in 92us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997146.207919:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1780997146.207952:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126907136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780997146.208358:0:87032:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87032:1867507126907264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997146.208385:0:87032:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997146.208402:0:87032:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898363bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997146.208475:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126907264 00000100:00100000:2.0:1780997146.208481:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126907264 00000100:00100000:2.0:1780997146.208510:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1780997146.208517:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:87032:x1867507126907264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997146.209166:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:87032:x1867507126907264:12345-0@lo:502:llog_process_th.0 Request processed in 647us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.209174:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1780997146.209243:0:87032:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87032:1867507126907264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780997146.209358:0:87032:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780997146.209368:0:87032:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997146.209371:0:87032:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1780997146.209377:0:87032:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9689aebbd000 00000020:00000080:0.0:1780997146.209381:0:87032:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1780997146.209388:0:87032:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997146.209390:0:87032:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997146.209391:0:87032:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1780997146.209393:0:87032:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780997146.209395:0:87032:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997146.209396:0:87032:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1780997146.209400:0:87032:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9689aebbd000 00000020:00000080:0.0:1780997146.209401:0:87032:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1780997146.209537:0:87032:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87032:1867507126907392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997146.209579:0:87032:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997146.209614:0:87032:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898363bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997146.209855:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126907392 00000100:00100000:2.0:1780997146.209861:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126907392 00000100:00100000:2.0:1780997146.209900:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1780997146.209908:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:87032:x1867507126907392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997146.210016:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:87032:x1867507126907392:12345-0@lo:502:llog_process_th.0 Request processed in 109us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.210023:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1780997146.210105:0:87032:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87032:1867507126907392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780997146.210130:0:87032:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997146.210134:0:87032:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997146.210136:0:87032:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1780997146.210140:0:87032:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1780997146.210424:0:87009:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1780997146.210448:0:87009:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780997146.210465:0:87009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997146.210475:0:87009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997146.210522:0:87009:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1780997146.210525:0:87009:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9689aebbd000 10000000:01000000:2.0:1780997146.210535:0:87009:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9689aebbd000 10000000:01000000:2.0:1780997146.210539:0:87009:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1780997146.210545:0:87009:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689aebbd000 from 1 10000000:01000000:2.0:1780997146.210548:0:87009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780997146.210574:0:87009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997146.210583:0:87009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997146.210592:0:87009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997146.210614:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126907520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780997146.210647:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997146.210691:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997146.210962:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126907520 00000100:00100000:1.0:1780997146.210968:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126907520 00000100:00100000:1.0:1780997146.211002:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1780997146.211009:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:87009:x1867507126907520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997146.211018:0:87016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997146.211030:0:87016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96888956f200/0x30fd811c0305a696 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a68f expref: -99 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.211051:0:87016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96888956f200/0x30fd811c0305a696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a68f expref: 10 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.211072:0:87016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96888956f200/0x30fd811c0305a696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a68f expref: 10 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.211082:0:87016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956f200, rc 0) 00000100:00100000:1.0:1780997146.211119:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:87009:x1867507126907520:12345-0@lo:101:mount.lustre.0 Request processed in 110us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997146.211124:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1780997146.211162:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126907520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997146.211173:0:87009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.211181:0:87009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997146.211225:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126907648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780997146.211250:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997146.211264:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997146.211302:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126907648 00000100:00100000:1.0:1780997146.211306:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126907648 00000100:00100000:1.0:1780997146.211328:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1780997146.211335:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:87009:x1867507126907648:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780997146.211438:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:87009:x1867507126907648:12345-0@lo:501:mount.lustre.0 Request processed in 103us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997146.211444:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1780997146.211473:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126907648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780997146.211508:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126907776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780997146.211543:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997146.211556:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997146.211569:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126907776 00000100:00100000:1.0:1780997146.211572:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126907776 00000100:00100000:1.0:1780997146.211588:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1780997146.211593:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:87009:x1867507126907776:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780997146.211664:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:87009:x1867507126907776:12345-0@lo:503:mount.lustre.0 Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997146.211671:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1780997146.211723:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126907776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997146.212295:0:87033:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87033:1867507126907904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997146.212333:0:87033:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997146.212357:0:87033:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac279c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997146.212432:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126907904 00000100:00100000:1.0:1780997146.212437:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126907904 00000100:00100000:1.0:1780997146.212468:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1780997146.212474:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:87033:x1867507126907904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997146.212552:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:87033:x1867507126907904:12345-0@lo:502:llog_process_th.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997146.212559:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1780997146.212597:0:87033:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87033:1867507126907904:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1780997146.212646:0:87033:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1780997146.212661:0:87033:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff96888ac519c0) 00000020:00000080:1.0:1780997146.212696:0:87033:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1780997146.222875:0:87033:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689aebbd000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1780997146.222885:0:87033:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689aebbd000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1780997146.222889:0:87033:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689aebbd000 4 00010000:00080000:2.0:1780997146.222928:0:87033:0:(ldlm_lib.c:102:import_set_conn()) imp ffff968983330800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:2.0:1780997146.226209:0:87033:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1780997146.228469:0:87033:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1780997146.228540:0:87033:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1780997146.228558:0:87033:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x30fd811c0305a6a4 00000100:00080000:2.0:1780997146.228570:0:87033:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780997146.228576:0:87033:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff968983330800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997146.228631:0:87033:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a5d82d80 x1867507126908032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997146.228675:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126908032:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780997146.232851:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780997146.232929:0:87033:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1780997146.233009:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126908032 00000100:00100000:0.0:1780997146.233018:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126908032 00000100:00100000:0.0:1780997146.233059:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:0.0:1780997146.233068:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126908032:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1780997146.233130:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126908032:12345-0@lo:38:llog_process_th.0 Request processed in 63us (283us total) trans 0 rc -11/-11 00000100:00100000:0.0:1780997146.233154:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:0.0:1780997146.233215:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1780997146.233223:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968983330800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997146.233227:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1780997146.233230:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126908032:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780997146.234998:0:87033:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87033:1867507126908160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997146.235082:0:87033:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997146.235119:0:87033:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27300 going to sleep for 11 seconds 00000100:00100000:0.0:1780997146.235239:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126908160 00000100:00100000:0.0:1780997146.235246:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126908160 00000100:00100000:0.0:1780997146.235312:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1780997146.235321:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:87033:x1867507126908160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997146.235436:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:87033:x1867507126908160:12345-0@lo:502:llog_process_th.0 Request processed in 116us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997146.235443:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1780997146.235505:0:87033:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87033:1867507126908160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997146.235636:0:87033:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87033:1867507126908288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997146.235670:0:87033:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997146.235961:0:87033:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898363b300 going to sleep for 11 seconds 00000100:00100000:2.0:1780997146.235994:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126908288 00000100:00100000:2.0:1780997146.235999:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126908288 00000100:00100000:2.0:1780997146.236060:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1780997146.236068:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:87033:x1867507126908288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997146.236151:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:87033:x1867507126908288:12345-0@lo:502:llog_process_th.0 Request processed in 84us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.236158:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1780997146.236223:0:87033:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87033:1867507126908288:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1780997146.236241:0:87033:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1780997146.236547:0:87009:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1780997146.236570:0:87009:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780997146.236591:0:87009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.236601:0:87009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780997146.236652:0:87009:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1780997146.236655:0:87009:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780997146.236656:0:87009:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997146.236657:0:87009:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997146.236658:0:87009:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997146.236660:0:87009:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997146.236661:0:87009:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780997146.236662:0:87009:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780997146.236664:0:87009:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997146.236666:0:87009:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780997146.236669:0:87009:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1780997146.236672:0:87009:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1780997146.236673:0:87009:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780997146.236674:0:87009:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997146.236675:0:87009:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997146.236676:0:87009:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997146.236677:0:87009:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997146.236687:0:87009:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780997146.236688:0:87009:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780997146.236689:0:87009:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997146.236690:0:87009:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780997146.236706:0:87009:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1780997146.236717:0:87009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126908416:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1780997146.236764:0:87009:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997146.236779:0:87009:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898510ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997146.237027:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126908416 00000100:00100000:0.0:1780997146.237033:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126908416 00000100:00100000:0.0:1780997146.237060:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1780997146.237067:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bf8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:87009:x1867507126908416:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1780997146.237086:0:87021:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1780997146.237100:0:87021:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1780997146.244419:0:87021:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1780997146.244436:0:87021:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1780997146.244845:0:87019:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1780997146.244851:0:87019:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1780997146.244872:0:87019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.244893:0:87019:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689ba455e00/0x30fd811c0305a67a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a673 expref: 10 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.244903:0:87019:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997146.245326:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bf8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:87009:x1867507126908416:12345-0@lo:253:mount.lustre.0 Request processed in 8255us (8557us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997146.245338:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1780997146.245507:0:87019:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689ba455e00/0x30fd811c0305a67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305a673 expref: 9 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.245526:0:87019:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689ba455e00/0x30fd811c0305a67a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305a673 expref: 9 pid: 87015 timeout: 3773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997146.245546:0:87019:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87019:1867507126908544:0@lo:104: 00000100:00100000:3.0:1780997146.245595:0:87019:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997146.245637:0:87019:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898510c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997146.245875:0:87009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:87009:1867507126908416:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1780997146.245889:0:87009:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1780997146.245901:0:87009:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1780997146.245903:0:87009:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780997146.245904:0:87009:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997146.245905:0:87009:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997146.245907:0:87009:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997146.245908:0:87009:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997146.245910:0:87009:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780997146.245911:0:87009:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780997146.245913:0:87009:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997146.245914:0:87009:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1780997146.245928:0:87009:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1780997146.246056:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126908544 00000100:00100000:2.0:1780997146.246063:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126908544 00000100:00100000:2.0:1780997146.246108:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1780997146.246117:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:87019:x1867507126908544:12345-0@lo:104: 00010000:00010000:2.0:1780997146.246130:0:6334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305a67a expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997146.246186:0:6334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1780997146.246192:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:87019:x1867507126908544:12345-0@lo:104: Request processed in 77us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.246197:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1780997146.247393:0:87019:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87019:1867507126908544:0@lo:104: 00010000:00010000:3.0:1780997146.247415:0:87019:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997146.247484:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997146.247491:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305a67a expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997146.247499:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2000 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:0.0:1780997146.247504:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305a67a expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997146.247513:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305a67a expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997146.247520:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305a67a expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997146.247526:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997146.247569:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305a67a expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997146.247575:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780997146.247604:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305a67a expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997146.247612:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2000/0x30fd811c0305a673 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305a67a expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997146.247629:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997146.247641:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997146.247643:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997146.247651:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997146.247665:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126908672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997146.248206:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997146.248876:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126908672 00000100:00100000:3.0:1780997146.248884:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126908672 00010000:00010000:3.0:1780997146.248914:0:8261:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689ba455e00/0x30fd811c0305a67a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305a673 expref: 10 pid: 87015 timeout: 3773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997146.248959:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:3.0:1780997146.248968:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b620e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:3496:x1867507126908672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997146.248989:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997146.248995:0:8261:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689ba455e00/0x30fd811c0305a67a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305a673 expref: 10 pid: 87015 timeout: 3773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.249007:0:8261:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689ba455e00/0x30fd811c0305a67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305a673 expref: 10 pid: 87015 timeout: 3773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.249022:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455e00/0x30fd811c0305a67a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305a673 expref: 10 pid: 87015 timeout: 3773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.249037:0:8261:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.249045:0:8261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780997146.249060:0:8261:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004211101s 00010000:00010000:3.0:1780997146.249065:0:8261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.249073:0:8261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.249080:0:8261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.249087:0:8261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.249093:0:8261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997146.249097:0:8261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.249111:0:8261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.249133:0:8261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997146.249143:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997146.249190:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b620e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:3496:x1867507126908672:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997146.249198:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:3.0:1780997146.249295:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126908672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997146.249474:0:87019:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.249483:0:87019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997146.249490:0:87019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2e00/0x30fd811c0305a6ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1780997146.258785:0:87009:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444067 00000040:01000000:0.0:1780997146.259108:0:87009:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1780997146.259414:0:87041:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1780997146.259782:0:87041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1780997146.260925:0:87009:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1780997146.264093:0:87042:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87042:1867507126908800:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780997146.264173:0:87042:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997146.264219:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126908800 00000100:00100000:1.0:1780997146.264226:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126908800 00000100:00100000:1.0:1780997146.264293:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1780997146.264302:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87042:x1867507126908800:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780997146.264374:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87042:x1867507126908800:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997146.264381:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1780997146.264406:0:87042:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688887563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997146.264429:0:87042:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87042:1867507126908800:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1780997146.264471:0:87042:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1780997146.264498:0:87042:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87042:1867507126908928:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780997146.264528:0:87042:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997146.264551:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126908928 00000100:00100000:1.0:1780997146.264554:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126908928 00000100:00100000:1.0:1780997146.264580:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:1.0:1780997146.264587:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87042:x1867507126908928:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780997146.264685:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87042:x1867507126908928:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 98us (156us total) trans 0 rc 0/0 00000040:01000000:2.0:1780997146.265375:0:87009:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1780997146.265428:0:87009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1780997146.266874:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000100:00100000:1.0:1780997146.266936:0:87042:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688887563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997146.266972:0:87042:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87042:1867507126908928:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780997146.267079:0:87042:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87042:1867507126909056:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780997146.267139:0:87042:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997146.267178:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126909056 00000100:00100000:1.0:1780997146.267184:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126909056 00000100:00100000:1.0:1780997146.267219:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:1.0:1780997146.267227:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87042:x1867507126909056:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780997146.267311:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87042:x1867507126909056:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997146.267317:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00000100:00100000:1.0:1780997146.267336:0:87042:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688887563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997146.267348:0:87042:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87042:1867507126909056:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1780997146.267392:0:87042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780997146.269420:0:87042:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1780997146.269536:0:87042:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00000080:2.0:1780997146.269867:0:87009:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1780997146.269882:0:87009:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1780997146.269975:0:87009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780997146.270941:0:87009:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1780997146.271485:0:87009:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1780997146.271522:0:87009:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1780997146.271615:0:87009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1780997146.271859:0:87041:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1780997146.271926:0:87041:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1780997146.271931:0:87041:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:3.0:1780997146.272124:0:87040:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444067 00000020:00080000:3.0:1780997146.272127:0:87040:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444067 00080000:10000000:2.0:1780997146.272908:0:87009:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00010000:00080000:2.0:1780997146.276132:0:87009:0:(ldlm_lib.c:3037:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182407 00010000:00080000:0.0:1780997146.277016:0:87043:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 87043 00010000:02000000:0.0:1780997146.277067:0:87043:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1780997146.277071:0:87043:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1780997146.277074:0:87043:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1780997146.277153:0:87009:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1780997146.277170:0:87009:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1780997146.277196:0:87009:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:2.0:1780997146.277217:0:87009:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1780997146.282020:0:87009:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1780997146.282347:0:87009:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1780997146.342422:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997146.375464:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997146.375501:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997146.375534:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997146.375558:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997146.375573:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110374784 00000100:00100000:0.0:1780997146.375584:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110374784 00000100:00100000:2.0:1780997146.375598:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997146.375622:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110374912 00000100:00100000:2.0:1780997146.375626:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110374912 00000100:00100000:2.0:1780997146.375659:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110375040 00000100:00100000:2.0:1780997146.375663:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110375040 00000100:00100000:2.0:1780997146.375701:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2576 00000100:00100000:2.0:1780997146.375711:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110374912:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997146.375791:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110374912:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 81us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.375876:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2576 00000100:00100000:2.0:1780997146.376115:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2577 00000100:00100000:2.0:1780997146.376127:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110375040:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997146.376160:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110375040:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 38us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.376166:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2577 00000100:00080000:2.0:1780997146.384743:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997146.384763:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997146.384767:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997146.384781:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110375168 00000100:00100000:2.0:1780997146.384793:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110375168 00000100:00100000:2.0:1780997146.384838:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:2.0:1780997146.384848:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2393:x1867507110375168:12345-192.168.206.51@tcp:250:kworker.0 00010000:00080000:2.0:1780997146.384880:0:87016:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 5bc603cc-b633-43af-a003-872c004686c8@192.168.206.51@tcp t0 exp 0000000000000000 cur 3673 last 0 00000020:00000080:2.0:1780997146.384911:0:87016:0:(genops.c:1406:class_connect()) connect: client 5bc603cc-b633-43af-a003-872c004686c8, cookie 0x30fd811c0305a6b2 00000100:00080000:2.0:1780997146.385048:0:87016:0:(import.c:65:import_set_state_nolock()) ffff968994764000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997146.385119:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+4:2393:x1867507110375168:12345-192.168.206.51@tcp:250:kworker.0 Request processed in 271us (9518us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.385127:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:2.0:1780997146.385319:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110374656 00000100:00100000:2.0:1780997146.385324:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110374656 00000100:00100000:2.0:1780997146.385632:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1256 00000100:00100000:2.0:1780997146.385645:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110374784:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997146.385688:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110374784:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 48us (10187us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.385695:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1256 00000100:00100000:2.0:1780997146.385710:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1278 00000100:00100000:2.0:1780997146.385731:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110374656:12345-192.168.206.51@tcp:38:kworker.0 00010000:00080000:2.0:1780997146.385746:0:65272:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '285c134c-d3a6-4c01-bb4d-8148c50d5f95' at ffff968985081000, cookie 0x30fd811c0305a5fc 00010000:00080000:2.0:1780997146.385762:0:65272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp recovering/t107374182408 exp ffff968985081000 cur 3673 last 1780997146 00010000:02000400:2.0:1780997146.385769:0:65272:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1780997146.385774:0:65272:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1780997146.385791:0:65272:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1780997146.385892:0:65272:0:(import.c:65:import_set_state_nolock()) ffff96888a013800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997146.385919:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110374656:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 188us (10359us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997146.385925:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1278 00000100:00100000:2.0:1780997146.402313:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997146.402397:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110366208 00000100:00100000:0.0:1780997146.402408:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110366208 00000100:00100000:0.0:1780997146.402469:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1279 00000100:00100000:0.0:1780997146.402479:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110366208:12345-192.168.206.51@tcp:36:mcreate.0 00010000:00080000:0.0:1780997146.402497:0:63417:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:0.0:1780997146.402521:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110366208:12345-192.168.206.51@tcp:36:mcreate.0 Request processed in 45us (216us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997146.402533:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1279 00010000:00080000:3.0:1780997146.402862:0:87043:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:1.0:1780997147.173394:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1780997147.173402:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9689aebbd000 from 116 10000000:01000000:1.0:1780997147.173408:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1780997147.173459:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.173472:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.173485:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997147.173516:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.173591:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.173649:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984a720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997147.173831:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126909184 00000100:00100000:2.0:1780997147.173840:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126909184 00000100:00100000:2.0:1780997147.173894:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1780997147.173903:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:6348:x1867507126909184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997147.173917:0:87015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997147.173930:0:87015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba454800/0x30fd811c0305a6c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a6b9 expref: -99 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.173952:0:87015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454800/0x30fd811c0305a6c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a6b9 expref: 10 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.173960:0:87015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba454800/0x30fd811c0305a6c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a6b9 expref: 10 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.173969:0:87015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454800, rc 0) 00000100:00100000:2.0:1780997147.174009:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126909184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.174023:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1780997147.174133:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997147.174149:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.174158:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997147.174203:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.174236:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.174256:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984a720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997147.174487:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126909312 00000100:00100000:2.0:1780997147.174493:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126909312 00000100:00100000:2.0:1780997147.174529:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1780997147.174537:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126909312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1780997147.174554:0:87016:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1780997147.174576:0:87016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1780997147.174579:0:87016:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 116 00000100:00100000:2.0:1780997147.174852:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126909312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 315us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.174860:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1780997147.174928:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1780997147.174985:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1780997147.174993:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.175002:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997147.175010:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780997147.175012:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968886f5e000 from 52 10000000:01000000:0.0:1780997147.175015:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780997147.175036:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03600/0x30fd811c0305a6c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.175043:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03600/0x30fd811c0305a6c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.175051:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03600/0x30fd811c0305a6c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997147.175063:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.175096:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997147.175123:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780997147.175171:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126909440 00000100:00100000:2.0:1780997147.175176:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126909440 00000100:00100000:2.0:1780997147.175295:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1780997147.175304:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888a32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126909440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997147.175313:0:87015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997147.175323:0:87015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba454e00/0x30fd811c0305a6ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a6c7 expref: -99 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.175340:0:87015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454e00/0x30fd811c0305a6ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a6c7 expref: 11 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.175349:0:87015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba454e00/0x30fd811c0305a6ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a6c7 expref: 11 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.175357:0:87015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454e00, rc 0) 00000100:00100000:2.0:1780997147.175388:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888a32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126909440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.175403:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1780997147.175690:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997147.175702:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03600/0x30fd811c0305a6c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6ce expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.175710:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03600/0x30fd811c0305a6c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a6ce expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997147.175789:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.175817:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997147.175883:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318c00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997147.176098:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126909568 00000100:00100000:1.0:1780997147.176103:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126909568 00000100:00100000:1.0:1780997147.176136:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1780997147.176152:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968885cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126909568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.176302:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968885cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126909568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997147.176309:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1780997147.176851:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.176893:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.176939:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997147.176973:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318c00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997147.177145:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126909696 00000100:00100000:1.0:1780997147.177150:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126909696 00000100:00100000:1.0:1780997147.177188:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1780997147.177197:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968885cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126909696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.177316:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968885cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126909696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997147.177324:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1780997147.177421:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997147.178325:0:87101:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1780997147.178711:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1780997147.178736:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780997147.178756:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03600/0x30fd811c0305a6c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6ce expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.178768:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03600/0x30fd811c0305a6c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6ce expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997147.178777:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1780997147.178780:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff968886f5e000 from 113 10000000:01000000:1.0:1780997147.178783:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1780997147.178815:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956fc00/0x30fd811c0305a6d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.178823:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff96888956fc00/0x30fd811c0305a6d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.178832:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff96888956fc00/0x30fd811c0305a6d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997147.178863:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.178912:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.178946:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984a72780 going to sleep for 11 seconds 00000100:00100000:0.0:1780997147.179079:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126909824 00000100:00100000:0.0:1780997147.179087:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126909824 00000100:00100000:0.0:1780997147.179143:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1780997147.179153:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968885cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126909824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997147.179167:0:87021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997147.179183:0:87021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff02800/0x30fd811c0305a6dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a6d5 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.179210:0:87021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02800/0x30fd811c0305a6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a6d5 expref: 12 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.179221:0:87021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff02800/0x30fd811c0305a6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a6d5 expref: 12 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.179230:0:87021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02800, rc 0) 00000100:00100000:0.0:1780997147.179298:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968885cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126909824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997147.179313:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1780997147.179496:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997147.179514:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff96888956fc00/0x30fd811c0305a6d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6dc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.179525:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff96888956fc00/0x30fd811c0305a6d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a6dc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997147.179578:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.179623:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.179650:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984a72780 going to sleep for 11 seconds 00000100:00100000:0.0:1780997147.179794:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126909952 00000100:00100000:0.0:1780997147.179799:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126909952 00000100:00100000:0.0:1780997147.179835:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1780997147.179843:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968885cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126909952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1780997147.179857:0:87016:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1780997147.179875:0:87016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1780997147.179879:0:87016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1780997147.179882:0:87016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1780997147.179885:0:87016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1780997147.179887:0:87016:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:0.0:1780997147.179963:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968885cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126909952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997147.179969:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1780997147.180119:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126909952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1780997147.180191:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780997147.180197:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956fc00/0x30fd811c0305a6d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6dc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.180205:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff96888956fc00/0x30fd811c0305a6d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6dc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997147.180212:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1780997147.180214:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1780997147.180216:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1780997147.180234:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956ec00/0x30fd811c0305a6e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.180251:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff96888956ec00/0x30fd811c0305a6e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.180259:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff96888956ec00/0x30fd811c0305a6e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997147.180301:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.180331:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.180354:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888eb0900 going to sleep for 11 seconds 00000100:00100000:2.0:1780997147.180403:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126910080 00000100:00100000:2.0:1780997147.180408:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126910080 00000100:00100000:2.0:1780997147.180436:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1780997147.180443:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb1f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126910080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997147.180452:0:87017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997147.180462:0:87017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455c00/0x30fd811c0305a6ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a6e3 expref: -99 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.180477:0:87017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455c00/0x30fd811c0305a6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a6e3 expref: 13 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.180485:0:87017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455c00/0x30fd811c0305a6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a6e3 expref: 13 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.180492:0:87017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455c00, rc 0) 00000100:00100000:2.0:1780997147.180528:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb1f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126910080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.180534:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1780997147.184540:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997147.184569:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff96888956ec00/0x30fd811c0305a6e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6ea expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.184582:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff96888956ec00/0x30fd811c0305a6e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a6ea expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997147.184696:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.184770:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.184817:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888eb0900 going to sleep for 11 seconds 00000100:00100000:0.0:1780997147.184930:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126910208 00000100:00100000:0.0:1780997147.184936:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126910208 00000100:00100000:0.0:1780997147.184981:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1780997147.184990:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb1f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126910208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.185152:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb1f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126910208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997147.185161:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1780997147.185327:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.185360:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.185406:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.185431:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888eb0900 going to sleep for 11 seconds 00000100:00100000:0.0:1780997147.185510:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126910336 00000100:00100000:0.0:1780997147.185514:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126910336 00000100:00100000:0.0:1780997147.185541:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1780997147.185548:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb1f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126910336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.187439:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb1f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126910336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1882us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997147.187459:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1780997147.187582:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780997147.188570:0:87102:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1780997147.188914:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1780997147.188944:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1780997147.188958:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956ec00/0x30fd811c0305a6e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6ea expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.188971:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff96888956ec00/0x30fd811c0305a6e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6ea expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997147.188980:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1780997147.188983:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff968886f5e000 from 1 10000000:01000000:0.0:1780997147.188986:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1780997147.189023:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305a6f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.189031:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305a6f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.189040:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305a6f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997147.189062:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.189121:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997147.189172:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997147.189786:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126910464 00000100:00100000:1.0:1780997147.189794:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126910464 00000100:00100000:1.0:1780997147.189847:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1780997147.189857:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb1f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126910464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997147.189871:0:87015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997147.189888:0:87015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96888956ea00/0x30fd811c0305a6f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a6f1 expref: -99 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.189913:0:87015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96888956ea00/0x30fd811c0305a6f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a6f1 expref: 14 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.189924:0:87015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96888956ea00/0x30fd811c0305a6f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a6f1 expref: 14 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.189933:0:87015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956ea00, rc 0) 00000100:00100000:1.0:1780997147.189980:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb1f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507126910464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997147.189987:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1780997147.190078:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997147.190094:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305a6f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6f8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.190115:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305a6f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a6f8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997147.190132:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1780997147.190136:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305a6f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6f8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.190144:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305a6f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6f8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997147.190151:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1780997147.190154:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff968886f5e000 from 7 10000000:01000000:0.0:1780997147.190157:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780997147.190178:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305a6ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.190185:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305a6ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.190193:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305a6ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997147.190208:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.190239:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997147.190267:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997147.190338:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126910592 00000100:00100000:1.0:1780997147.190343:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126910592 00000100:00100000:1.0:1780997147.190371:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1780997147.190377:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb1f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507126910592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997147.190385:0:87016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997147.190393:0:87016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96888956e000/0x30fd811c0305a706 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a6ff expref: -99 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.190406:0:87016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96888956e000/0x30fd811c0305a706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a6ff expref: 15 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.190424:0:87016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96888956e000/0x30fd811c0305a706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a6ff expref: 15 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.190431:0:87016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956e000, rc 0) 00000100:00100000:1.0:1780997147.190455:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb1f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126910592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997147.190461:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1780997147.190521:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997147.190530:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305a6ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a706 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.190546:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305a6ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a706 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997147.190595:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.190764:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997147.190780:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997147.191231:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126910720 00000100:00100000:1.0:1780997147.191237:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126910720 00000100:00100000:1.0:1780997147.191290:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1780997147.191297:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb1f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126910720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.191406:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb1f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126910720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997147.191412:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1780997147.191445:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.191478:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.191520:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.191535:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888eb0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997147.191546:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126910848 00000100:00100000:1.0:1780997147.191549:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126910848 00000100:00100000:1.0:1780997147.191572:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1780997147.191578:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb1f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126910848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.192928:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb1f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126910848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1345us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997147.192940:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1780997147.193107:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780997147.194339:0:87104:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1780997147.195786:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1780997147.195822:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780997147.195834:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305a6ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a706 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.195847:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305a6ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a706 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997147.195867:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780997147.195871:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689bfa99000 from 52 10000000:01000000:2.0:1780997147.195873:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780997147.195915:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305a70d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.195923:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305a70d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.195933:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305a70d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997147.195957:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.196014:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997147.196054:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997147.196244:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126910976 00000100:00100000:1.0:1780997147.196252:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126910976 00000100:00100000:1.0:1780997147.196350:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1780997147.196359:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126910976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997147.196371:0:87015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997147.196382:0:87015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96888956e200/0x30fd811c0305a714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a70d expref: -99 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.196403:0:87015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96888956e200/0x30fd811c0305a714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a70d expref: 16 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.196412:0:87015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96888956e200/0x30fd811c0305a714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a70d expref: 16 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.196420:0:87015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956e200, rc 0) 00000100:00100000:1.0:1780997147.198911:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126910976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2543us (2886us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997147.198924:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1780997147.199482:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126910976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997147.199519:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305a70d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a714 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.199532:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305a70d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a714 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997147.200398:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.200457:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997147.201101:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5e600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997147.201256:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126911104 00000100:00100000:1.0:1780997147.201265:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126911104 00000100:00100000:1.0:1780997147.201357:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1780997147.201366:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126911104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.201502:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126911104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997147.201509:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1780997147.201726:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.201781:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.201827:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997147.201851:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18ba9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997147.201955:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126911232 00000100:00100000:0.0:1780997147.201960:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126911232 00000100:00100000:0.0:1780997147.201997:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1780997147.202008:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126911232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.202108:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126911232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997147.202115:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1780997147.202213:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780997147.203522:0:87105:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1780997147.205429:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1780997147.205467:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780997147.205488:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305a70d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a714 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.205500:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305a70d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a714 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997147.205510:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1780997147.205513:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1780997147.205516:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1780997147.205557:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305a71b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.205564:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305a71b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.205575:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305a71b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997147.205672:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.205809:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997147.208858:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997147.209800:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126911360 00000100:00100000:1.0:1780997147.209814:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126911360 00000100:00100000:1.0:1780997147.209885:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1780997147.209908:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126911360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997147.209929:0:87016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997147.209947:0:87016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96888956f000/0x30fd811c0305a722 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a71b expref: -99 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.209979:0:87016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96888956f000/0x30fd811c0305a722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a71b expref: 17 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.209990:0:87016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96888956f000/0x30fd811c0305a722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a71b expref: 17 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.210001:0:87016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956f000, rc 0) 00000100:00100000:3.0:1780997147.210879:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997147.210901:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305a71b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a722 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997147.210912:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305a71b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a722 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997147.210993:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.218735:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126911360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 8820us (12914us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997147.218757:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1780997147.220134:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997147.220199:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689ba542840 going to sleep for 11 seconds 00000100:00100000:3.0:1780997147.221848:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126911488 00000100:00100000:3.0:1780997147.221862:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126911488 00000100:00100000:3.0:1780997147.222220:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1780997147.222232:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126911488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997147.222461:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126911488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997147.222469:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1780997147.222821:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.222878:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.222934:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997147.222963:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126911616 00000100:00100000:2.0:1780997147.222967:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126911616 00000100:00100000:2.0:1780997147.223000:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1780997147.223009:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126911616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.223203:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bae40 going to sleep for 11 seconds 00000100:00100000:2.0:1780997147.228020:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126911616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5002us (5074us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.228039:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1780997147.234613:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997147.244918:0:87107:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1780997147.246071:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1780997147.246102:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1780997147.246115:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305a71b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a722 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.246127:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305a71b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a722 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997147.246135:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1780997147.246138:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9689bfa99000 from 7 10000000:01000000:1.0:1780997147.246140:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1780997147.246181:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956f800/0x30fd811c0305a729 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.246200:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff96888956f800/0x30fd811c0305a729 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.246212:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff96888956f800/0x30fd811c0305a729 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997147.246237:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.246325:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.246361:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888eb0900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997147.246594:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126911744 00000100:00100000:3.0:1780997147.246616:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126911744 00000100:00100000:3.0:1780997147.246794:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1780997147.246808:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126911744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997147.246825:0:87021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997147.246839:0:87021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305a730 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a729 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997147.246865:0:87021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305a730 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a729 expref: 18 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997147.246876:0:87021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305a730 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a729 expref: 18 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997147.246885:0:87021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3a00, rc 0) 00000100:00100000:3.0:1780997147.246930:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126911744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997147.246938:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1780997147.249311:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997147.249340:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff96888956f800/0x30fd811c0305a729 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a730 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.249353:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff96888956f800/0x30fd811c0305a729 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a730 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997147.249442:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.249503:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.249539:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888eb0900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997147.250574:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126911872 00000100:00100000:3.0:1780997147.250583:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126911872 00000100:00100000:3.0:1780997147.250821:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1780997147.250833:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126911872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997147.250992:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126911872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997147.251018:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1780997147.251475:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126911872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.251521:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.251569:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.251592:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888eb0900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997147.255905:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126912000 00000100:00100000:3.0:1780997147.255921:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126912000 00000100:00100000:3.0:1780997147.255987:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1780997147.255998:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126912000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997147.256177:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126912000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (4606us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997147.256186:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1780997147.260204:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780997147.265605:0:87108:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1780997147.265910:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1780997147.265950:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1780997147.265963:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956f800/0x30fd811c0305a729 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a730 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.265974:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff96888956f800/0x30fd811c0305a729 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a730 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997147.265984:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780997147.265987:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968990f90000 from 52 10000000:01000000:1.0:1780997147.265990:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780997147.266032:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956f400/0x30fd811c0305a737 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.266040:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff96888956f400/0x30fd811c0305a737 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.266052:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff96888956f400/0x30fd811c0305a737 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997147.266083:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.266145:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.266187:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888eb0900 going to sleep for 11 seconds 00000100:00100000:0.0:1780997147.266308:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126912128 00000100:00100000:0.0:1780997147.266315:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126912128 00000100:00100000:0.0:1780997147.266358:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1780997147.266368:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126912128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997147.266383:0:87017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997147.266396:0:87017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff02600/0x30fd811c0305a73e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a737 expref: -99 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.266421:0:87017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02600/0x30fd811c0305a73e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a737 expref: 19 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.266439:0:87017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff02600/0x30fd811c0305a73e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a737 expref: 19 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.266447:0:87017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02600, rc 0) 00000100:00100000:0.0:1780997147.266496:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126912128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997147.266505:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1780997147.266633:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997147.266647:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff96888956f400/0x30fd811c0305a737 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a73e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.266656:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff96888956f400/0x30fd811c0305a737 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a73e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997147.266842:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.266871:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997147.266895:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689869fa780 going to sleep for 11 seconds 00000100:00100000:1.0:1780997147.266980:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126912256 00000100:00100000:1.0:1780997147.266985:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126912256 00000100:00100000:1.0:1780997147.267017:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1780997147.267024:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126912256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.267128:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126912256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997147.267136:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1780997147.267232:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.267258:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.267318:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997147.267334:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689869fa780 going to sleep for 11 seconds 00000100:00100000:0.0:1780997147.267385:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126912384 00000100:00100000:0.0:1780997147.267390:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126912384 00000100:00100000:0.0:1780997147.267420:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1780997147.267426:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126912384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.267493:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126912384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997147.267499:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1780997147.267663:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997147.268959:0:87109:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1780997147.270834:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1780997147.270876:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780997147.270888:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956f400/0x30fd811c0305a737 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a73e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.270900:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff96888956f400/0x30fd811c0305a737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a73e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997147.271144:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1780997147.271148:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1780997147.271151:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1780997147.271200:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305a745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.271210:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305a745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.271222:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305a745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997147.271249:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.271515:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997147.271559:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689869fa300 going to sleep for 11 seconds 00000100:00100000:1.0:1780997147.271616:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126912512 00000100:00100000:1.0:1780997147.271624:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126912512 00000100:00100000:1.0:1780997147.271779:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1780997147.271793:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126912512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997147.271812:0:87015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997147.271827:0:87015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96888956e800/0x30fd811c0305a74c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a745 expref: -99 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.271856:0:87015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96888956e800/0x30fd811c0305a74c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a745 expref: 20 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.271866:0:87015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96888956e800/0x30fd811c0305a74c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a745 expref: 20 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.271877:0:87015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956e800, rc 0) 00000100:00100000:1.0:1780997147.271929:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126912512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.272072:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997147.272088:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305a745 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a74c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.272096:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305a745 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a74c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997147.272172:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.272200:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997147.272225:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689869fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1780997147.272320:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126912640 00000100:00100000:0.0:1780997147.272325:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126912640 00000100:00100000:1.0:1780997147.272488:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1780997147.272793:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1780997147.272804:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126912640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.272998:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126912640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.273005:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1780997147.273057:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.273090:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.273135:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997147.273200:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5e240 going to sleep for 11 seconds 00000100:00100000:3.0:1780997147.273232:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126912768 00000100:00100000:3.0:1780997147.273237:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126912768 00000100:00100000:0.0:1780997147.273844:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1780997147.273856:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126912768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.274729:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126912768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 874us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997147.274756:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1780997147.275330:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997147.277203:0:87110:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1780997147.278844:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1780997147.278890:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1780997147.278906:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305a745 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a74c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.278921:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305a745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a74c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997147.278932:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1780997147.278936:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff968990f90000 from 7 10000000:01000000:0.0:1780997147.278939:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780997147.278981:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305a753 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.278990:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305a753 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.279001:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305a753 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997147.279031:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997147.279101:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997147.279144:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a6b5e600 going to sleep for 11 seconds 00000100:00100000:2.0:1780997147.279156:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126912896 00000100:00100000:2.0:1780997147.279166:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126912896 00000100:00100000:2.0:1780997147.279227:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1780997147.279238:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126912896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997147.279254:0:87016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997147.279296:0:87016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455400/0x30fd811c0305a75a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a753 expref: -99 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.279328:0:87016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455400/0x30fd811c0305a75a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a753 expref: 21 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.279341:0:87016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455400/0x30fd811c0305a75a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a753 expref: 21 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.279351:0:87016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455400, rc 0) 00000100:00100000:2.0:1780997147.280157:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126912896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 918us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.280179:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1780997147.281051:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126912896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997147.281076:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305a753 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a75a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.281089:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305a753 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a75a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997147.281452:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126913024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.281502:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.281541:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888eb0240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997147.281890:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126913024 00000100:00100000:2.0:1780997147.281899:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126913024 00000100:00100000:2.0:1780997147.281950:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1780997147.281959:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126913024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.282093:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126913024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.282102:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1780997147.282345:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126913024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.282381:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126913152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.282427:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.282459:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888eb0240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997147.282496:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126913152 00000100:00100000:2.0:1780997147.282501:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126913152 00000100:00100000:2.0:1780997147.282540:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1780997147.282548:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126913152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.282630:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126913152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.282637:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1780997147.282659:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126913152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997147.283765:0:87111:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1780997147.284004:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1780997147.284036:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1780997147.284045:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305a753 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a75a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.284056:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305a753 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a75a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997147.284065:0:6348:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1780997147.284068:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9689b6283380 from 1 10000000:01000000:1.0:1780997147.284070:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1780997147.284107:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956e400/0x30fd811c0305a761 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.284116:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff96888956e400/0x30fd811c0305a761 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.284126:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff96888956e400/0x30fd811c0305a761 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997147.284148:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126913280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.284200:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.284329:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888eb0240 going to sleep for 11 seconds 00000100:00100000:0.0:1780997147.284383:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126913280 00000100:00100000:0.0:1780997147.284392:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126913280 00000100:00100000:0.0:1780997147.284766:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1780997147.284777:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126913280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997147.284788:0:87021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997147.284801:0:87021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff03e00/0x30fd811c0305a768 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a761 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.284828:0:87021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03e00/0x30fd811c0305a768 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a761 expref: 22 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.284838:0:87021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff03e00/0x30fd811c0305a768 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a761 expref: 22 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997147.284847:0:87021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03e00, rc 0) 00000100:00100000:0.0:1780997147.284954:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126913280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997147.284962:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1780997147.285018:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126913280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997147.285031:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff96888956e400/0x30fd811c0305a761 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a768 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.285041:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff96888956e400/0x30fd811c0305a761 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a768 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997147.285058:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1780997147.285069:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956e400/0x30fd811c0305a761 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a768 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.285076:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff96888956e400/0x30fd811c0305a761 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a768 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997147.285082:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1780997147.285084:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9689b6283380 from 1 10000000:01000000:1.0:1780997147.285086:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1780997147.285102:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956ee00/0x30fd811c0305a76f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.285108:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff96888956ee00/0x30fd811c0305a76f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.285115:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff96888956ee00/0x30fd811c0305a76f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997147.285126:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126913408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.285151:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997147.285203:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888eb0240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997147.285231:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126913408 00000100:00100000:2.0:1780997147.285235:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126913408 00000100:00100000:2.0:1780997147.285405:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1780997147.285414:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126913408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997147.285421:0:87016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997147.285430:0:87016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455000/0x30fd811c0305a776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305a76f expref: -99 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.285444:0:87016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455000/0x30fd811c0305a776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305a76f expref: 23 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.285452:0:87016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455000/0x30fd811c0305a776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305a76f expref: 23 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.285464:0:87016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455000, rc 0) 00000100:00100000:2.0:1780997147.285506:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126913408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.285511:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1780997147.285565:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126913408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997147.285576:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff96888956ee00/0x30fd811c0305a76f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a776 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997147.285583:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff96888956ee00/0x30fd811c0305a76f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a776 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997147.285634:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126913536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997147.285658:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997147.285836:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c900 going to sleep for 11 seconds 00000100:00100000:1.0:1780997147.285899:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126913536 00000100:00100000:1.0:1780997147.285903:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126913536 00000100:00100000:1.0:1780997147.285937:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1780997147.285944:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688876b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126913536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.286027:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688876b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126913536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (367us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780997147.286034:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1780997147.286065:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126913536:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1780997147.286099:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1780997147.286105:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956ee00/0x30fd811c0305a76f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a776 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.286112:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff96888956ee00/0x30fd811c0305a76f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a776 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997147.376941:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997147.464490:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997147.464590:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110375296 00000100:00100000:1.0:1780997147.464601:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110375296 00000100:00100000:1.0:1780997147.464717:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:1.0:1780997147.464728:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888762c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+4:41993:x1867507110375296:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997147.464753:0:87017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997147.465062:0:87017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96888956fa00/0x30fd811c0305a77d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c1e expref: -99 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.465099:0:87017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96888956fa00/0x30fd811c0305a77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c1e expref: 5 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.465111:0:87017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96888956fa00/0x30fd811c0305a77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c1e expref: 5 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997147.465121:0:87017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956fa00, rc 0) 00000100:00100000:1.0:1780997147.465197:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888762c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110375296:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 471us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997147.465204:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:2.0:1780997147.473795:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997147.473852:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110375424 00000100:00100000:3.0:1780997147.473862:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110375424 00000100:00100000:3.0:1780997147.473925:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:3.0:1780997147.473948:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110375424:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780997147.473994:0:87016:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1780997147.474013:0:87016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780997147.474018:0:87016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1780997147.474021:0:87016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1780997147.474024:0:87016:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1780997147.474027:0:87016:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:3.0:1780997147.480639:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110375424:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 Request processed in 6679us (6840us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997147.480653:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:2.0:1780997147.486071:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997147.487051:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110375552 00000100:00100000:3.0:1780997147.487063:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110375552 00000100:00100000:3.0:1780997147.487128:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:3.0:1780997147.487138:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+5:41993:x1867507110375552:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997147.487155:0:87021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997147.487174:0:87021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb2200/0x30fd811c0305a784 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c25 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997147.487205:0:87021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb2200/0x30fd811c0305a784 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c25 expref: 6 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997147.487216:0:87021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb2200/0x30fd811c0305a784 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c25 expref: 6 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997147.487226:0:87021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2200, rc 0) 00000100:00100000:3.0:1780997147.487672:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+6:41993:x1867507110375552:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 532us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997147.487686:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:2.0:1780997147.493516:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997147.493609:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110375680 00000100:00100000:3.0:1780997147.493637:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110375680 00000100:00100000:3.0:1780997147.493712:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:3.0:1780997147.493724:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b798fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+6:41993:x1867507110375680:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997147.494168:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b798fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110375680:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 445us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997147.494178:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:2.0:1780997147.509851:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997147.511163:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110375808 00000100:00100000:0.0:1780997147.511181:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110375808 00000100:00100000:3.0:1780997147.511593:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:3.0:1780997147.511612:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b798d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110375808:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.512029:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b798d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110375808:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 421us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.512038:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:2.0:1780997147.516025:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997147.516341:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110375936 00000100:00100000:3.0:1780997147.516352:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110375936 00000100:00100000:3.0:1780997147.516413:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:3.0:1780997147.516424:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+7:41993:x1867507110375936:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997147.516442:0:87016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997147.516459:0:87016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb3400/0x30fd811c0305a78b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c2c expref: -99 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997147.516619:0:87016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb3400/0x30fd811c0305a78b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c2c expref: 8 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997147.516635:0:87016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb3400/0x30fd811c0305a78b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c2c expref: 8 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997147.516646:0:87016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3400, rc 0) 00000100:00100000:3.0:1780997147.516718:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110375936:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 294us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997147.516726:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:0.0:1780997147.522525:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997147.522595:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110376064 00000100:00100000:2.0:1780997147.522609:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110376064 00000100:00100000:2.0:1780997147.522672:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:2.0:1780997147.522692:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110376064:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997147.522860:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110376064:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 170us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.522869:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:2.0:1780997147.525188:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997147.525302:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110376192 00000100:00100000:1.0:1780997147.525314:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110376192 00000100:00100000:1.0:1780997147.525375:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:1.0:1780997147.525402:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110376192:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.525552:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110376192:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 152us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997147.525561:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:0.0:1780997147.533715:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997147.534084:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110376320 00000100:00100000:2.0:1780997147.534095:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110376320 00000100:00100000:2.0:1780997147.534157:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:2.0:1780997147.534168:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+8:41993:x1867507110376320:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997147.534198:0:87021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997147.534217:0:87021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba454a00/0x30fd811c0305a792 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c33 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.534247:0:87021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454a00/0x30fd811c0305a792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c33 expref: 9 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.534257:0:87021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba454a00/0x30fd811c0305a792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c33 expref: 9 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997147.534266:0:87021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454a00, rc 0) 00000100:00100000:2.0:1780997147.534364:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:41993:x1867507110376320:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 198us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997147.534372:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:0.0:1780997147.547888:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997147.548066:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110376448 00000100:00100000:1.0:1780997147.548076:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110376448 00000100:00100000:1.0:1780997147.548136:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:1.0:1780997147.548147:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+9:41993:x1867507110376448:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997147.548325:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bc603cc-b633-43af-a003-872c004686c8+9:41993:x1867507110376448:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 179us (447us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780997147.548334:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00010000:00010000:0.0:1780997148.391004:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997149.416979:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997150.437456:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1780997150.682159:0:87277:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1780997151.141566:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126913664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997151.141655:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997151.141801:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126913664 00000100:00100000:0.0:1780997151.141808:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126913664 00000100:00100000:0.0:1780997151.141869:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:0.0:1780997151.141892:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126913664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997151.141922:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997151.141968:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126913664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997151.141975:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00080000:2.0:1780997151.142040:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997151.142078:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126913664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997151.142773:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126913792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997151.142809:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997151.142949:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126913792 00000100:00100000:3.0:1780997151.142955:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126913792 00000100:00100000:3.0:1780997151.143034:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:3.0:1780997151.143041:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126913792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997151.143060:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997151.143098:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126913792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997151.143104:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00080000:2.0:1780997151.147004:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997151.147086:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126913792:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1780997151.462432:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997151.492039:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997151.492113:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997151.492142:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997151.492168:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997151.492197:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110376704 00000100:00100000:3.0:1780997151.492206:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110376704 00000100:00100000:3.0:1780997151.492255:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1257 00000100:00100000:3.0:1780997151.492264:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110376704:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997151.492352:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110376704:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 90us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997151.492360:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1257 00000100:00100000:3.0:1780997151.492382:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110376832 00000100:00100000:3.0:1780997151.492384:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110376832 00000100:00100000:3.0:1780997151.492407:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110376960 00000100:00100000:3.0:1780997151.492409:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110376960 00000100:00100000:3.0:1780997151.492426:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2578 00000100:00100000:3.0:1780997151.492431:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110376832:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997151.492455:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110376832:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 23us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997151.492471:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2578 00000100:00100000:3.0:1780997151.492483:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2579 00000100:00100000:3.0:1780997151.492489:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110376960:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997151.492513:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110376960:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997151.492519:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2579 00000100:00100000:2.0:1780997151.494242:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110376576 00000100:00100000:2.0:1780997151.494257:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110376576 00000100:00100000:2.0:1780997151.494399:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:2.0:1780997151.494409:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110376576:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997151.494490:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110376576:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 84us (2460us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997151.494498:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00080000:2.0:1780997151.494535:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997151.494540:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997151.494543:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:0.0:1780997151.536570:0:87329:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780997151.536820:0:87329:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1780997151.654075:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997151.654083:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997151.654087:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997151.654095:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3673 00000100:00080000:1.0:1780997151.654099:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997151.654107:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997151.654131:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988613800 x1867507126914048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997151.654157:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997151.654169:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997151.654172:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997151.654175:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3673 00000100:00080000:1.0:1780997151.654183:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997151.654187:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997151.654200:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988613b80 x1867507126914304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997151.654224:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997151.654228:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997151.654230:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997151.654233:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3673 00000100:00080000:1.0:1780997151.654236:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997151.654239:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997151.654250:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988611c00 x1867507126914560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997151.654317:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997151.654321:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997151.654323:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997151.654327:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3673 00000100:00080000:1.0:1780997151.654329:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997151.654332:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997151.654345:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988613480 x1867507126914944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997151.654373:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1780997151.654375:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997151.654377:0:13646:0:(import.c:65:import_set_state_nolock()) ffff968983330800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997151.654381:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff968983330800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997151.654400:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f12680 x1867507126915456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997151.654433:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126913920:0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.654508:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.654551:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126914816:0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.654578:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.654603:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1780997151.654610:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126914176:0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.654636:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.654655:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126915072:0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.654677:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.654706:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126914048:0@lo:38:kworker.0 00000100:00100000:1.0:1780997151.654744:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.654763:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126914304:0@lo:38:kworker.0 00000100:00100000:1.0:1780997151.654787:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.654803:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126914560:0@lo:38:kworker.0 00000100:00100000:1.0:1780997151.654822:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.654836:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126914944:0@lo:38:kworker.0 00000100:00100000:1.0:1780997151.654853:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.654865:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126915456:0@lo:38:kworker.0 00000100:00100000:1.0:1780997151.654885:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.654923:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126914432:0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.654945:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.654958:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126915200:0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.654989:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.655006:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1780997151.655012:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126914688:0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.655030:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.655044:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126915328:0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.655064:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.655092:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126913920 00000100:00100000:1.0:1780997151.655099:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126913920 00000100:00100000:1.0:1780997151.655430:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1780997151.655439:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b798d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126913920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.655486:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b798d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126913920:12345-0@lo:400:kworker.0 Request processed in 49us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997151.655492:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1780997151.655523:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126914816 00000100:00100000:1.0:1780997151.655526:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126914816 00000100:00100000:1.0:1780997151.655548:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126915200 00000100:00100000:1.0:1780997151.655551:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126915200 00000100:00100000:1.0:1780997151.655576:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126914688 00000100:00100000:1.0:1780997151.655579:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126914688 00000100:00100000:1.0:1780997151.655600:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126915328 00000100:00100000:1.0:1780997151.655603:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126915328 00000100:00100000:1.0:1780997151.655624:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:3.0:1780997151.655825:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:3.0:1780997151.655835:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126915200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997151.655879:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126915200:12345-0@lo:400:kworker.0 Request processed in 46us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997151.655885:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:3.0:1780997151.655898:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1780997151.655903:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126914688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997151.655928:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126914688:12345-0@lo:400:kworker.0 Request processed in 25us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997151.655933:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1780997151.655943:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:3.0:1780997151.655948:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126915328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997151.655972:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126915328:12345-0@lo:400:kworker.0 Request processed in 24us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997151.655977:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1780997151.656866:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126914816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.656919:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126914816:12345-0@lo:400:kworker.0 Request processed in 1288us (2339us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997151.656927:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1780997151.656952:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126914176 00000100:00100000:1.0:1780997151.656957:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126914176 00000100:00100000:1.0:1780997151.656987:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126914048 00000100:00100000:1.0:1780997151.656990:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126914048 00000100:00100000:1.0:1780997151.656999:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126914304 00000100:00100000:1.0:1780997151.657001:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126914304 00000100:00100000:1.0:1780997151.657008:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126914944 00000100:00100000:1.0:1780997151.657010:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126914944 00000100:00100000:1.0:1780997151.657017:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126915456 00000100:00100000:1.0:1780997151.657019:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126915456 00000100:00100000:1.0:1780997151.657026:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126914432 00000100:00100000:1.0:1780997151.657029:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126914432 00000100:00100000:1.0:1780997151.657045:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1780997151.657051:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126914176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.657083:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126914176:12345-0@lo:400:kworker.0 Request processed in 33us (2446us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997151.657089:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1780997151.657099:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:1.0:1780997151.657104:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126914432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.657127:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126914432:12345-0@lo:400:kworker.0 Request processed in 23us (2181us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997151.657132:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:1.0:1780997151.657142:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1780997151.657145:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126914048:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780997151.657166:0:65272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3679 last 0 00000020:00000080:1.0:1780997151.657207:0:65272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x30fd811c0305a799 00000004:00100000:1.0:1780997151.657221:0:65272:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780997151.657374:0:65272:0:(import.c:65:import_set_state_nolock()) ffff96888b414800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997151.657420:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3495:x1867507126914048:12345-0@lo:38:kworker.0 Request processed in 272us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997151.657434:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1780997151.657449:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1780997151.657452:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126914304:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780997151.657464:0:65272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3679 last 0 00000020:00000080:1.0:1780997151.657484:0:65272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x30fd811c0305a7a0 00000004:00100000:1.0:1780997151.657490:0:65272:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780997151.657505:0:65272:0:(import.c:65:import_set_state_nolock()) ffff96888b417800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997151.657679:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997151.657694:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126915584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997151.657745:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997151.657778:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126915072 00000100:00100000:0.0:1780997151.657782:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126915072 00000100:00100000:0.0:1780997151.657811:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126914560 00000100:00100000:0.0:1780997151.657815:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126914560 00000100:00100000:0.0:1780997151.657824:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126915584 00000100:00100000:0.0:1780997151.657826:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126915584 00000100:00100000:0.0:1780997151.657837:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:0.0:1780997151.657843:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3496:x1867507126915072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997151.657877:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3496:x1867507126915072:12345-0@lo:400:kworker.0 Request processed in 34us (3199us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997151.657883:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00000100:00100000:0.0:1780997151.657895:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985 00000100:00100000:0.0:1780997151.657899:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126914560:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1780997151.657922:0:8242:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9689869ef800, cookie 0x30fd811c0305a603 00010000:00080000:0.0:1780997151.657927:0:8242:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411355 exp ffff9689869ef800 cur 3679 last 1780997146 00000004:00100000:0.0:1780997151.657937:0:8242:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780997151.657959:0:8242:0:(import.c:65:import_set_state_nolock()) ffff9689886b0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997151.658003:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126914560:12345-0@lo:38:kworker.0 Request processed in 102us (3179us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997151.658010:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985 00000100:00100000:0.0:1780997151.658022:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986 00000100:00100000:0.0:1780997151.658028:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126915584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780997151.658050:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780997151.658083:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126915584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997151.658103:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986 00000100:00100000:0.0:1780997151.658147:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126915584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997151.658762:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1780997151.658769:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126914944:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1780997151.658784:0:63584:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3679 last 0 00000020:00000080:0.0:1780997151.658808:0:63584:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x30fd811c0305a7a7 00000004:00100000:0.0:1780997151.658816:0:63584:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780997151.658833:0:63584:0:(import.c:65:import_set_state_nolock()) ffff9689bc968800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997151.658870:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3495:x1867507126914944:12345-0@lo:38:kworker.0 Request processed in 99us (4014us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997151.658876:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1780997151.658891:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:0.0:1780997151.658895:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126915456:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1780997151.658906:0:63584:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3679 last 0 00000020:00000080:0.0:1780997151.658927:0:63584:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x30fd811c0305a7ae 00000004:00100000:0.0:1780997151.658932:0:63584:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780997151.658951:0:63584:0:(import.c:65:import_set_state_nolock()) ffff9689bc96b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997151.658978:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1867507126915456:12345-0@lo:38:kworker.0 Request processed in 82us (4091us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997151.658984:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00010000:00080000:3.0:1780997151.660319:0:87043:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1780997151.660330:0:87043:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 107374182408 00000020:00080000:3.0:1780997151.660336:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.660344:0:87043:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00010000:00080000:3.0:1780997151.660348:0:87043:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:3.0:1780997151.660350:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.660363:0:87043:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110366208 t107374182408 from 192.168.206.51@tcp req@ffff9689a5d83800 x1867507110366208/t0(107374182408) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:477/0 lens 528/0 e 0 to 0 dl 1780997157 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997151.664910:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3495:x1867507126914304:12345-0@lo:38:kworker.0 Request processed in 7450us (10116us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997151.664935:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00080000:1.0:1780997151.664990:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997151.664995:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997151.664998:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997151.665045:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126914688:0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.665061:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126915328:0@lo:400:kworker.0 00000100:00100000:1.0:1780997151.665073:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126914432:0@lo:400:kworker.0 00000004:00080000:3.0:1780997151.665086:0:87043:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4656us 00000100:00100000:1.0:1780997151.665086:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126915200:0@lo:400:kworker.0 00010000:00080000:1.0:1780997151.665137:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff968988613800 x1867507126914048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997151.665151:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00080000:1.0:1780997151.666066:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff968988613800 x1867507126914048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997176 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997151.666077:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1780997151.666095:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780997151.666100:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1780997151.666106:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126914048:0@lo:38:kworker.0 00010000:00080000:1.0:1780997151.666127:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff968988613b80 x1867507126914304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997151.666138:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00100000:2.0:1780997151.666368:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126914176:0@lo:400:kworker.0 00000100:00100000:2.0:1780997151.666383:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126915072:0@lo:400:kworker.0 00000100:00100000:2.0:1780997151.666395:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126913920:0@lo:400:kworker.0 00000100:00100000:2.0:1780997151.666406:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126914816:0@lo:400:kworker.0 00000100:00080000:1.0:1780997151.667047:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff968988613b80 x1867507126914304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997176 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997151.667056:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1780997151.667061:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780997151.667064:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1780997151.667068:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126914304:0@lo:38:kworker.0 00000100:00080000:1.0:1780997151.667088:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:1.0:1780997151.667096:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1780997151.667100:0:3495:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1780997151.667103:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:1.0:1780997151.667106:0:3495:0:(recover.c:53:ptlrpc_replay_next()) import ffff9689ae566000 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:1.0:1780997151.667109:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1780997151.667489:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126914560:0@lo:38:kworker.0 00010000:00080000:1.0:1780997151.667507:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff968988613480 x1867507126914944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997151.667517:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00010000:00080000:2.0:1780997151.668500:0:87343:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1780997151.668506:0:87343:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1780997151.668512:0:87343:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1780997151.669028:0:87343:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:1.0:1780997151.675165:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff968988613480 x1867507126914944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997176 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997151.675200:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1780997151.675207:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780997151.675212:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1780997151.675219:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126914944:0@lo:38:kworker.0 00010000:00080000:1.0:1780997151.675257:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689b7f12680 x1867507126915456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997151.675302:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:1.0:1780997151.675313:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1780997151.675317:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1780997151.675320:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968983330800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1780997151.675324:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126915456:0@lo:38:kworker.0 00000100:00100000:1.0:1780997151.675378:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126915712:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1780997151.675445:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997151.677381:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126915712 00000100:00100000:2.0:1780997151.677394:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126915712 00000100:00100000:2.0:1780997151.677456:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987 00000100:00100000:2.0:1780997151.677466:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126915712:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1780997151.677488:0:8242:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff9689b7f12680 x1867507126915712/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:482/0 lens 224/0 e 0 to 0 dl 1780997162 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997151.677499:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126915712:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 36us (2055us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780997151.677505:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987 00010000:00010000:1.0:1780997151.693515:0:87043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96888956e600/0x30fd811c0305a7b5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.693538:0:87043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96888956e600/0x30fd811c0305a7b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.693555:0:87043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96888956e600/0x30fd811c0305a7b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.693568:0:87043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f600/0x30fd811c0305a7bc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.693575:0:87043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f600/0x30fd811c0305a7bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.693594:0:87043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f600/0x30fd811c0305a7bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.694769:0:87043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96888956e600/0x30fd811c0305a7b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.694786:0:87043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96888956e600/0x30fd811c0305a7b5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.694792:0:87043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96888956e600/0x30fd811c0305a7b5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.694798:0:87043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997151.694803:0:87043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96888956e600/0x30fd811c0305a7b5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.694811:0:87043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96888956e600/0x30fd811c0305a7b5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.694828:0:87043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898962fd00) 00010000:00010000:2.0:1780997151.694831:0:87043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997151.694836:0:87043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96888956e600/0x30fd811c0305a7b5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.694842:0:87043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96888956e600/0x30fd811c0305a7b5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997151.694861:0:87043:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e3c160b reply state 00000000ce27f43d transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f600/0x30fd811c0305a7bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.694873:0:87043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f600/0x30fd811c0305a7bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.694880:0:87043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898962f400) 00010000:00010000:2.0:1780997151.694882:0:87043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997151.694893:0:87043:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1780997151.695009:0:87043:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1780997151.695030:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997151.695033:0:87043:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:2.0:1780997151.695037:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997151.695039:0:87043:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000001:00080000:0.0:1780997151.696677:0:87010:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182408 is committed 00010000:00010000:1.0:1780997151.696782:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f600/0x30fd811c0305a7bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.696795:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f600/0x30fd811c0305a7bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.696803:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f600/0x30fd811c0305a7bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.696809:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997151.696813:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f600/0x30fd811c0305a7bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.696821:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f600/0x30fd811c0305a7bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.696834:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff96898962f400) 00010000:00010000:1.0:1780997151.696837:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997151.696841:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f600/0x30fd811c0305a7bc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.696846:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f600/0x30fd811c0305a7bc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997151.702050:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997151.704057:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110366720 00000100:00100000:1.0:1780997151.704083:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110366720 00000100:00100000:1.0:1780997151.704171:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1284 00000100:00100000:1.0:1780997151.704183:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110366720:12345-192.168.206.51@tcp:36:rm.0 00010000:00080000:1.0:1780997151.704218:0:63584:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182409, replaying 00000100:00100000:1.0:1780997151.704244:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110366720:12345-192.168.206.51@tcp:36:rm.0 Request processed in 63us (2204us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997151.704256:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1284 00000020:00080000:3.0:1780997151.704468:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.704472:0:87043:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182409, next_transno: 107374182409 00010000:00080000:3.0:1780997151.704477:0:87043:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182409) 00000020:00080000:3.0:1780997151.704480:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.704497:0:87043:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110366720 t107374182409 from 192.168.206.51@tcp req@ffff9689a5dbd500 x1867507110366720/t0(107374182409) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:482/0 lens 512/0 e 0 to 0 dl 1780997162 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1780997151.704618:0:87043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.704643:0:87043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.704658:0:87043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.704669:0:87043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a7ca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.704675:0:87043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a7ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.704681:0:87043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a7ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.704808:0:87043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a7d1 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.704820:0:87043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a7d1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.704830:0:87043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a7d1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.705115:0:87043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a7d1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.705123:0:87043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a7d1 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.705130:0:87043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a7d1 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.705135:0:87043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997151.705140:0:87043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a7d1 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.705147:0:87043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a7d1 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.705159:0:87043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9689836c9b00) 00010000:00010000:3.0:1780997151.705163:0:87043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1780997151.705167:0:87043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a7d1 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.706568:0:87043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a7d1 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.706624:0:87043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.706634:0:87043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7c3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.706643:0:87043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.706649:0:87043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997151.706653:0:87043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.706660:0:87043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7c3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.706671:0:87043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689836c9800) 00010000:00010000:3.0:1780997151.706674:0:87043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997151.706677:0:87043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.706683:0:87043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997151.706695:0:87043:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029df970f reply state 0000000066ade783 transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a7ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.706706:0:87043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a7ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.706713:0:87043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689836c9600) 00010000:00010000:3.0:1780997151.706848:0:87043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997151.706852:0:87043:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1780997151.706955:0:87043:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1780997151.706988:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.706991:0:87043:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000020:00080000:3.0:1780997151.706995:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.706997:0:87043:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000100:00100000:1.0:1780997151.715831:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997151.721139:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110368128 00000100:00100000:1.0:1780997151.721151:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110368128 00000100:00100000:1.0:1780997151.721262:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1285 00000100:00100000:1.0:1780997151.721287:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2393:x1867507110368128:12345-192.168.206.51@tcp:36:dd.0 00010000:00080000:1.0:1780997151.721305:0:80049:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 107374182410, current: 107374182412, replaying 00000100:00100000:1.0:1780997151.721327:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2393:x1867507110368128:12345-192.168.206.51@tcp:36:dd.0 Request processed in 56us (5507us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997151.721334:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1285 00000020:00080000:3.0:1780997151.721387:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.721392:0:87043:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182412, next_transno: 107374182410 00010000:00080000:3.0:1780997151.721397:0:87043:0:(ldlm_lib.c:2245:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182410, ql: 1, comp: 1, conn: 2, next: 107374182412, next_update 0 last_committed: 107374182408) 00000020:00080000:3.0:1780997151.721401:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.721411:0:87043:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110368128 t107374182412 from 192.168.206.51@tcp req@ffff9689b7f11880 x1867507110368128/t0(107374182412) o36->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:482/0 lens 488/0 e 0 to 0 dl 1780997162 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1780997151.721756:0:87043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7d8 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.721777:0:87043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7d8 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.721789:0:87043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7d8 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1780997151.721841:0:87043:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 107374182412 00000004:00010000:3.0:1780997151.721861:0:87043:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045335469 reply state 00000000e17f7e24 transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7d8 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.721874:0:87043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7d8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.721894:0:87043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689836c9800) 00010000:00010000:3.0:1780997151.721897:0:87043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997151.721901:0:87043:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1780997151.722055:0:87043:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1780997151.722062:0:87043:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:3.0:1780997151.722075:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.722077:0:87043:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000020:00080000:3.0:1780997151.722080:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.722082:0:87043:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000100:00100000:0.0:1780997151.733059:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997151.733340:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110368512 00000100:00100000:1.0:1780997151.733351:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110368512 00000100:00100000:1.0:1780997151.733448:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1286 00000100:00100000:1.0:1780997151.733459:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:2393:x1867507110368512:12345-192.168.206.51@tcp:101:dd.0 00010000:00080000:1.0:1780997151.733481:0:63418:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 107374182413, current: 107374182413, replaying 00000100:00100000:1.0:1780997151.733501:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:2393:x1867507110368512:12345-192.168.206.51@tcp:101:dd.0 Request processed in 45us (453us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997151.733509:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1286 00000020:00080000:3.0:1780997151.733749:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.733754:0:87043:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182413, next_transno: 107374182413 00010000:00080000:3.0:1780997151.733758:0:87043:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182413) 00000020:00080000:3.0:1780997151.733761:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.733771:0:87043:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110368512 t107374182413 from 192.168.206.51@tcp req@ffff9689a5dbc000 x1867507110368512/t0(107374182413) o101->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:482/0 lens 640/0 e 0 to 0 dl 1780997162 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1780997151.733795:0:87043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997151.733816:0:87043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a7df lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8bed expref: -99 pid: 87043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.733871:0:87043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305a7e6 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.733885:0:87043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305a7e6 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.733897:0:87043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305a7e6 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780997151.734054:0:87043:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x283:0x0], count =127 00000004:00080000:3.0:1780997151.734059:0:87043:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000400:0x283:0x0]+127 in llog 00000004:00080000:3.0:1780997151.734097:0:87043:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000400:0x302:0x0], index 0: 0 00000004:00080000:3.0:1780997151.734104:0:87043:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x303:0x0], index 1: 0 00010000:00010000:3.0:1780997151.734201:0:87043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305a7e6 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bed expref: 14 pid: 87043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.734211:0:87043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689836c9800) 00010000:00010000:3.0:1780997151.734214:0:87043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1780997151.734228:0:87043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2400/0x30fd811c0305a7df lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bed expref: 14 pid: 87043 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.734242:0:87043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305a7e6 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bed expref: 13 pid: 87043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.734308:0:87043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689836c9800) 00010000:00010000:3.0:1780997151.734311:0:87043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1780997151.734314:0:87043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3000, rc 0) 00010000:00080000:3.0:1780997151.734377:0:87043:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1780997151.734392:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.734395:0:87043:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000020:00080000:3.0:1780997151.734399:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.734401:0:87043:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000100:00100000:3.0:1780997151.741688:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997151.741851:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110377088 00000100:00100000:0.0:1780997151.741862:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110377088 00000100:00100000:0.0:1780997151.741922:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1260 00000100:00100000:0.0:1780997151.741933:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:2393:x1867507110377088:12345-192.168.206.51@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1780997151.741957:0:63419:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff9689854b7b80 x1867507110377088/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:482/0 lens 224/0 e 0 to 0 dl 1780997162 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997151.741981:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:2393:x1867507110377088:12345-192.168.206.51@tcp:400:ldlm_lock_repla.0 Request processed in 51us (304us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997151.741988:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1260 00000020:00080000:3.0:1780997151.742470:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.742475:0:87043:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182414 00010000:00080000:3.0:1780997151.742492:0:87043:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1780997151.742495:0:87043:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997151.742503:0:87043:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1780997151.742506:0:87043:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1780997151.742613:0:87043:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:0.0:1780997151.744822:0:87010:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000001:00100000:0.0:1780997151.744833:0:87010:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1780997151.744857:0:87010:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182413 is committed 00010000:00010000:2.0:1780997151.744940:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a7ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.744953:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a7ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.744961:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a7ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.744967:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997151.744972:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a7ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.744980:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a7ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.744997:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a7ca lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.745003:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305a7ca lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.745025:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7d8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.745031:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7d8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.745044:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7d8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.745061:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997151.745064:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7d8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.745071:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7d8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.745080:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7d8 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.745086:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305a7d8 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87043 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780997151.745221:0:87043:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1780997151.745257:0:87043:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1780997151.745308:0:87043:0:(ldlm_lib.c:2924:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9689b7f12680 x1867507126915712/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:482/0 lens 224/0 e 0 to 0 dl 1780997162 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1780997151.745444:0:87043:0:(ldlm_lib.c:2924:target_recovery_thread()) @@@ processing final ping from 192.168.206.51@tcp: req@ffff9689854b7b80 x1867507110377088/t0(0) o400->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:482/0 lens 224/0 e 0 to 0 dl 1780997162 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1780997151.745504:0:87043:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:06, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1780997151.747322:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1780997151.747336:0:3495:0:(client.c:3253:ptlrpc_resend_req()) @@@ going to resend req@ffff9689bff6f800 x1867507126915712/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997167 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997151.747358:0:3495:0:(client.c:3262:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9689bff6f800 x1867507126915712/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997167 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997151.747364:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780997151.747374:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1780997151.747391:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126915712:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1780997151.747601:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997151.747614:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126915840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997151.747669:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997151.747717:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126915840 00000100:00100000:2.0:1780997151.747732:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126915840 00000100:00100000:2.0:1780997151.747774:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988 00000100:00100000:2.0:1780997151.747784:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126915840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780997151.747817:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445261312 avail 1299021824 00000100:00100000:2.0:1780997151.747859:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126915840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997151.747866:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988 00000100:00100000:2.0:1780997151.747904:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126915840:0@lo:41:osp-pre-0-1.0 00000004:00000080:1.0:1780997151.767175:0:87043:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8c8c764be10 00100000:10000000:1.0:1780997151.767188:0:87043:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1780997151.767587:0:87031:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x303:0x0] 00000100:00100000:1.0:1780997151.767639:0:87031:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87031:1867507126915968:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1780997151.767702:0:87031:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.767743:0:87031:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689845e73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997151.767772:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126915968 00000100:00100000:1.0:1780997151.767779:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126915968 00000100:00100000:1.0:1780997151.767830:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5943 00000100:00100000:1.0:1780997151.767839:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:87031:x1867507126915968:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1780997151.767864:0:25171:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -30 00002000:02000040:1.0:1780997151.767868:0:25171:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:772 to 0x2c0000401:801) 00000004:00080000:3.0:1780997151.771751:0:87029:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x302:0x0] 00000100:00100000:3.0:1780997151.771812:0:87029:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87029:1867507126916096:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1780997151.771872:0:87029:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997151.771904:0:87029:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689ba5423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997151.771959:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126916096 00000100:00100000:0.0:1780997151.771966:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126916096 00000100:00100000:3.0:1780997151.772032:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5944 00000100:00100000:3.0:1780997151.772042:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:87029:x1867507126916096:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1780997151.772081:0:25179:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -31 00002000:02000040:3.0:1780997151.772087:0:25179:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:771 to 0x280000400:801) 00002000:00010000:0.0:1780997151.773449:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.773461:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305a7ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.773478:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.773480:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.773484:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305a7ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.773498:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305a7ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.773508:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305a7ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.773515:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305a7ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.773541:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997151.773621:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997151.773628:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305a7ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.773641:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.773709:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305a7ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.773728:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305a7ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.773757:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305a7ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.773764:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305a7ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.773783:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.773785:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.773787:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997151.773810:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.773816:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305a7f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.773824:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.773826:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.773835:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305a7f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.773845:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305a7f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.773852:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305a7f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.773859:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305a7f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.773876:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997151.774842:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.774850:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305a7fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.774860:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.774862:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.774865:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305a7fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.774875:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305a7fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.774883:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305a7fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.774902:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305a7fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.774917:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1780997151.774926:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780997151.774931:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305a7f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.774950:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997151.774954:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305a7f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.774963:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305a7f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.774975:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305a7f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.774983:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305a7f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.774998:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997151.775002:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305a7fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775030:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997151.775034:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305a7fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775042:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305a7fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775053:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305a7fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775060:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305a7fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775073:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.775075:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.775077:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997151.775127:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.775132:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305a802 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775140:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.775141:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997151.775142:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.775145:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305a802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775152:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305a802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775166:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305a802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775172:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305a802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775184:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997151.775191:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997151.775194:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305a802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775200:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997151.775203:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305a802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775210:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305a802 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775219:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305a802 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775225:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305a802 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775237:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.775243:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.775245:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997151.775321:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.775326:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305a809 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775334:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.775336:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.775338:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305a809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775347:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305a809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775355:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305a809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775362:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305a809 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775373:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997151.775378:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997151.775383:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305a809 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775390:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.775394:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305a809 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775402:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305a809 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997151.775408:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997151.775413:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305a809 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775413:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c0305a810 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775421:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305a809 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775422:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.775424:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.775427:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c0305a810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775445:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c0305a810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775446:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.775448:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.775450:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.775453:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c0305a810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775461:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c0305a810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775480:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997151.775519:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.775524:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6c5a1f/0x30fd811c0305a817 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775532:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.775534:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.775537:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e6c5a1f/0x30fd811c0305a817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775540:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997151.775544:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c0305a810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775546:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e6c5a1f/0x30fd811c0305a817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775552:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997151.775554:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6c5a1f/0x30fd811c0305a817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775555:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c0305a810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775562:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e6c5a1f/0x30fd811c0305a817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775564:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c0305a810 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775574:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c0305a810 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775580:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997151.775581:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053eae3be/0x30fd811c0305a810 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775594:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997151.775598:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e6c5a1f/0x30fd811c0305a817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775604:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954c00 already unused, calling callback (ffffffffc0ecc850) 00002000:00010000:0.0:1780997151.775614:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997151.775615:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6c5a1f/0x30fd811c0305a817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775619:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c0305a81e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775623:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6c5a1f/0x30fd811c0305a817 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775626:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.775627:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.775630:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c0305a81e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775634:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e6c5a1f/0x30fd811c0305a817 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775639:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c0305a81e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775641:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e6c5a1f/0x30fd811c0305a817 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775653:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.775655:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.775655:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c0305a81e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775656:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.775662:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.775662:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c0305a81e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775684:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997151.775719:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.775734:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305a825 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775742:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.775744:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.775752:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305a825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775762:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305a825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775769:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305a825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775776:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305a825 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775786:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1780997151.775824:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.775829:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c0305a82c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775837:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.775838:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.775841:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c0305a82c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775850:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c0305a82c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775857:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c0305a82c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775904:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780997151.775904:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c0305a82c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775908:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c0305a81e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775915:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.775918:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c0305a81e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775925:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c0305a81e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775935:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c0305a81e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1780997151.775939:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1780997151.775955:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcdc61f6/0x30fd811c0305a81e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.775956:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780997151.775969:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997151.775972:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305a825 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775978:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.775981:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305a825 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775989:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305a825 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997151.775990:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.775995:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c0305a833 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.775999:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305a825 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776003:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776004:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997151.776007:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305a825 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776008:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c0305a833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776016:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c0305a833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776025:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c0305a833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776031:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997151.776032:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c0305a833 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776034:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c0305a82c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776041:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997151.776044:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997151.776079:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.776085:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c0305a83a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776097:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776099:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776102:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c0305a83a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776111:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c0305a83a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776118:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c0305a83a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776125:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c0305a83a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776134:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780997151.776156:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c0305a82c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776166:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c0305a82c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997151.776169:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.776173:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d06fab/0x30fd811c0305a841 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776176:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c0305a82c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776181:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776182:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997151.776184:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5ef6e45/0x30fd811c0305a82c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776185:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d06fab/0x30fd811c0305a841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776194:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7d06fab/0x30fd811c0305a841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776197:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997151.776200:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c0305a833 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776207:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.776210:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c0305a833 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776212:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d06fab/0x30fd811c0305a841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776218:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c0305a833 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776220:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d06fab/0x30fd811c0305a841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776227:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c0305a833 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776228:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780997151.776233:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012a578e3/0x30fd811c0305a833 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776249:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997151.776252:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c0305a83a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776259:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954600 already unused, calling callback (ffffffffc0ecc850) 00002000:00010000:0.0:1780997151.776259:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997151.776262:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c0305a83a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776263:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c0305a848 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776289:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776290:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997151.776293:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c0305a83a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776294:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c0305a848 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776303:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c0305a848 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776304:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c0305a83a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776312:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c0305a848 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776313:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082399e8a/0x30fd811c0305a83a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776320:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c0305a848 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776324:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997151.776327:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7d06fab/0x30fd811c0305a841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776327:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997151.776333:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.776335:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7d06fab/0x30fd811c0305a841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997151.776366:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.776371:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c0305a84f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776378:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776379:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776382:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c0305a84f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776391:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c0305a84f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776399:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c0305a84f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776406:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c0305a84f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776413:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780997151.776420:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7d06fab/0x30fd811c0305a841 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776431:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7d06fab/0x30fd811c0305a841 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776439:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7d06fab/0x30fd811c0305a841 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997151.776442:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.776447:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d92b8cf3/0x30fd811c0305a856 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776451:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780997151.776453:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997151.776454:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c0305a848 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776455:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776458:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d92b8cf3/0x30fd811c0305a856 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776461:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.776464:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c0305a848 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776466:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d92b8cf3/0x30fd811c0305a856 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776471:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c0305a848 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776479:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d92b8cf3/0x30fd811c0305a856 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776481:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c0305a848 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776487:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d92b8cf3/0x30fd811c0305a856 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776488:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006994f072/0x30fd811c0305a848 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776495:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780997151.776508:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997151.776511:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c0305a84f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776518:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.776520:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c0305a84f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997151.776525:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997151.776528:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c0305a84f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776529:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c0305a85d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776536:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776538:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997151.776539:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c0305a84f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776541:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c0305a85d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776546:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f894b54b/0x30fd811c0305a84f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776550:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c0305a85d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776556:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997151.776558:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c0305a85d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776559:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d92b8cf3/0x30fd811c0305a856 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776566:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997151.776566:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c0305a85d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776570:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d92b8cf3/0x30fd811c0305a856 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776574:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997151.776586:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d92b8cf3/0x30fd811c0305a856 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776596:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d92b8cf3/0x30fd811c0305a856 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776603:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d92b8cf3/0x30fd811c0305a856 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997151.776608:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.776612:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c0305a864 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776615:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997151.776618:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c0305a85d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776619:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776621:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997151.776624:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997151.776624:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c0305a864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776627:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c0305a85d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776633:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c0305a864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776635:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c0305a85d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776640:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c0305a864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776644:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c0305a85d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776647:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c0305a864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776655:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997151.776685:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.776690:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c0305a86b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776698:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776699:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776702:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c0305a86b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776711:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c0305a86b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776715:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f96b946b/0x30fd811c0305a85d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776734:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c0305a86b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776742:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c0305a86b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776750:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997151.776750:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997151.776753:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c0305a864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776759:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.776762:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c0305a864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776769:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c0305a864 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776779:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c0305a864 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997151.776786:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997151.776787:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050a9a176/0x30fd811c0305a864 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776790:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c0305a872 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776797:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997151.776798:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997151.776799:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997151.776801:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c0305a86b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776802:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c0305a872 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776808:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.776812:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c0305a86b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776812:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c0305a872 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776820:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c0305a872 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776828:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c0305a872 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776830:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c0305a86b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776837:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997151.776840:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c0305a86b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776848:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a359055f/0x30fd811c0305a86b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776860:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997151.776863:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c0305a872 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776870:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955600 already unused, calling callback (ffffffffc0ecc850) 00002000:00010000:0.0:1780997151.776872:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997151.776873:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c0305a872 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776877:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c0305a879 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776880:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c0305a872 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776885:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776886:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776889:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c0305a879 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776890:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c0305a872 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776898:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddfcce40/0x30fd811c0305a872 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776899:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c0305a879 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776906:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c0305a879 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776914:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c0305a879 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776919:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.776921:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.776922:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997151.776923:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997151.776926:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c0305a879 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776932:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.776935:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c0305a879 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776943:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c0305a879 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997151.776948:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997151.776952:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c0305a879 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776953:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305a880 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776960:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb8d4bac/0x30fd811c0305a879 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776960:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776962:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.776965:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305a880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776970:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.776972:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.776973:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305a880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.776974:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.776986:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305a880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.776992:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305a880 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777005:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997151.777039:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.777044:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e71b4671/0x30fd811c0305a887 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777052:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777053:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777055:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e71b4671/0x30fd811c0305a887 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777064:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e71b4671/0x30fd811c0305a887 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777072:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e71b4671/0x30fd811c0305a887 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777079:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e71b4671/0x30fd811c0305a887 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777087:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1780997151.777134:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.777139:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305a88e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777146:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777148:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777151:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305a88e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777159:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305a88e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777167:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305a88e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777174:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305a88e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777182:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1780997151.777214:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.777219:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305a895 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777226:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777227:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777230:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305a895 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777239:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305a895 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777253:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305a895 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777260:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305a895 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777289:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1780997151.777326:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.777331:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305a89c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777339:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777341:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777344:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305a89c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777353:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305a89c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777360:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305a89c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777366:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305a89c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777373:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1780997151.777413:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.777418:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305a8a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777425:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777427:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777430:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305a8a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777438:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305a8a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777445:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305a8a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777451:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305a8a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777459:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1780997151.777476:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1780997151.777481:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305a880 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997151.777493:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.777497:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305a8aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.777499:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4efc00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.777502:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305a880 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777504:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777506:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777509:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305a8aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.777510:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305a880 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777518:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305a8aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.777522:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305a880 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.777529:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305a880 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777530:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305a8aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777538:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305a8aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.777542:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1780997151.777545:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e71b4671/0x30fd811c0305a887 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777545:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1780997151.777552:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4eec00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.777555:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e71b4671/0x30fd811c0305a887 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.777562:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e71b4671/0x30fd811c0305a887 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.777570:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e71b4671/0x30fd811c0305a887 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997151.777577:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.777582:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051f1abb3/0x30fd811c0305a8b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777588:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777590:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777593:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051f1abb3/0x30fd811c0305a8b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777601:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051f1abb3/0x30fd811c0305a8b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777609:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051f1abb3/0x30fd811c0305a8b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777616:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051f1abb3/0x30fd811c0305a8b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777626:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1780997151.777670:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997151.777675:0:25171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305a8b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777683:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777685:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997151.777687:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305a8b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777697:0:25171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305a8b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777704:0:25171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305a8b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777711:0:25171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305a8b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.777901:0:25171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00080000:0.0:1780997151.777932:0:25171:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:771 00010000:00010000:1.0:1780997151.777982:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e71b4671/0x30fd811c0305a887 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778000:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1780997151.778003:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305a88e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778009:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.778012:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305a88e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997151.778018:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:87031:x1867507126915968:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10178us (10313us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997151.778027:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5943 00010000:00010000:1.0:1780997151.778091:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305a88e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778103:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305a88e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778110:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305a88e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778121:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1780997151.778124:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305a895 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778129:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ef600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.778137:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305a895 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778145:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305a895 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778153:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305a895 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778159:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305a895 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778170:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1780997151.778172:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305a89c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778178:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4eee00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.778181:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305a89c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778187:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305a89c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778194:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305a89c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778200:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305a89c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778212:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1780997151.778216:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305a8a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778222:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4efa00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.778225:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305a8a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778231:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305a8a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778239:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305a8a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778245:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305a8a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778253:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780997151.778256:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305a8aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778260:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.778263:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305a8aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778298:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305a8aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778308:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305a8aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778315:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305a8aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.778324:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997151.778327:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997151.778328:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051f1abb3/0x30fd811c0305a8b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.778330:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305a8b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.778336:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4efe00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.778337:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.778340:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305a8b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.778346:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f1abb3/0x30fd811c0305a8b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.778354:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f1abb3/0x30fd811c0305a8b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.778364:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051f1abb3/0x30fd811c0305a8b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.778371:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051f1abb3/0x30fd811c0305a8b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997151.778384:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.778386:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.778387:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997151.778393:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.779175:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305a8b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.779189:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305a8b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.779195:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305a8b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.779223:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.779225:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.779227:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997151.779285:0:87031:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87031:1867507126915968:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1780997151.779301:0:87031:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x321:0x0] from OST, last_created [0x2c0000401:0x321:0x0]last_used is [0x2c0000401:0x303:0x0] 00000100:00100000:1.0:1780997151.779865:0:87031:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87031:1867507126916352:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1780997151.779913:0:87031:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997151.779930:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126916224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997151.779938:0:87031:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689845e73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997151.779962:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126916352 00000100:00100000:0.0:1780997151.779963:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997151.779968:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126916352 00000100:00100000:0.0:1780997151.779994:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126916224 00000100:00100000:0.0:1780997151.779998:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126916224 00000100:00100000:1.0:1780997151.780006:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5945 00000100:00100000:1.0:1780997151.780013:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:87031:x1867507126916352:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1780997151.780020:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:0.0:1780997151.780026:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126916224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780997151.780045:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997151.780084:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126916224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997151.780090:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000100:00100000:0.0:1780997151.780132:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126916224:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1780997151.780323:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1780997151.780755:0:25182:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 802 00000100:00100000:0.0:1780997151.784375:0:87031:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87031:1867507126916352:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1780997151.784394:0:87031:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x321:0x0]-[0x2c0000401:0x341:0x0] 00000100:00100000:1.0:1780997151.784541:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:87031:x1867507126916352:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4323us (4422us total) trans 4294969453 rc 0/0 00000100:00100000:1.0:1780997151.784553:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5945 00002000:00010000:3.0:1780997151.785562:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.785574:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305a8bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.785590:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.785591:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.785597:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305a8bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.785611:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305a8bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.785621:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305a8bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.785644:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305a8bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.785670:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997151.785801:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997151.785808:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305a8bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.785816:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.785820:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305a8bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.785839:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305a8bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.785856:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305a8bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.785863:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305a8bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.785880:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.785882:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.785884:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.786643:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.786662:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a8c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786672:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.786673:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.786676:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786685:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786693:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786699:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a8c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786715:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.786734:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.786739:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a8c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786760:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.786764:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a8c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786773:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a8c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786784:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a8c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786792:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a8c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786805:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.786806:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.786808:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.786867:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.786872:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a8cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786880:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.786881:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.786884:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a8cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786892:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a8cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786907:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a8cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786913:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a8cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786926:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.786934:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.786939:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a8cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786946:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.786950:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a8cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786957:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a8cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786968:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a8cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786975:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a8cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.786986:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.786992:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.786994:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.787043:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.787049:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a8d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787056:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.787058:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.787061:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787070:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787078:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787085:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787097:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.787104:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.787108:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787113:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.787117:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787135:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787146:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a8d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787152:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a8d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787165:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.787166:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.787168:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.787207:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.787212:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a8db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787219:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.787221:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.787224:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787232:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787240:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787259:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a8db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787295:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.787302:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.787306:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a8db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787313:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.787317:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a8db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787325:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a8db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787335:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a8db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787354:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a8db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787367:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.787369:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.787370:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.787419:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.787431:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305a8e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787439:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.787441:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.787444:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305a8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787453:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305a8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787461:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305a8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787468:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305a8e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787479:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.787484:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.787488:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305a8e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787494:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.787497:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305a8e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787505:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305a8e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787523:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305a8e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787531:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305a8e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787542:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.787543:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.787544:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.787575:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.787580:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305a8e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787587:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.787589:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.787592:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305a8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787600:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305a8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787608:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305a8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787616:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305a8e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787635:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.787641:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.787645:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305a8e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787652:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.787655:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305a8e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787663:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305a8e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787673:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305a8e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787679:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305a8e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787690:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.787692:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.787694:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.787735:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.787741:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305a8f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787748:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.787754:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.787757:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305a8f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787767:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305a8f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787775:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305a8f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787782:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305a8f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787792:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.787798:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.787801:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305a8f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787807:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.787810:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305a8f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787818:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305a8f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787827:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305a8f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787843:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305a8f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787856:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.787858:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.787859:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.787891:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.787896:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c0305a8f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787903:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.787904:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.787907:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c0305a8f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787916:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c0305a8f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787924:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c0305a8f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787932:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c0305a8f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787942:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.787947:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.787955:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c0305a8f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787962:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.787965:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c0305a8f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787973:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c0305a8f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787982:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c0305a8f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.787990:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071ef3172/0x30fd811c0305a8f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788002:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.788003:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.788005:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.788037:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.788041:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c0305a8fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788049:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788050:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788054:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c0305a8fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788072:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c0305a8fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788080:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c0305a8fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788087:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c0305a8fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788098:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.788105:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.788108:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c0305a8fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788114:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.788118:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c0305a8fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788125:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c0305a8fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788135:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c0305a8fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788142:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000411b5788/0x30fd811c0305a8fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788162:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.788164:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.788165:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.788203:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.788207:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305a905 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788215:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788216:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788219:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305a905 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788227:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305a905 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788234:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305a905 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788241:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305a905 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788263:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997151.788289:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997151.788294:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305a905 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.788301:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997151.788304:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305a905 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.788311:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305a905 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.788321:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305a905 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.788328:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305a905 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.788340:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997151.788341:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997151.788343:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.788435:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.788441:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c0305a90c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788457:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788459:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788462:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c0305a90c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788471:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c0305a90c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788479:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c0305a90c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788486:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c0305a90c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788505:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997151.788537:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.788542:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305a913 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788549:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788550:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788553:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305a913 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788562:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305a913 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788579:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305a913 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788587:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305a913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788606:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1780997151.788636:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.788641:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c0305a91a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788648:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788650:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788653:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c0305a91a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788662:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c0305a91a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788670:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c0305a91a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788677:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c0305a91a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788689:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1780997151.788699:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780997151.788703:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c0305a90c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788710:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.788713:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c0305a90c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788734:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c0305a90c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788744:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c0305a90c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.788748:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997151.788752:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000692db9b2/0x30fd811c0305a90c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.788753:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305a913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.788760:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997151.788763:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305a913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788766:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.788769:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c0305a91a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788775:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.788779:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c0305a91a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.788781:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305a913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788786:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c0305a91a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.788792:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305a913 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.788799:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305a913 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788803:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c0305a91a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788810:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005df4776f/0x30fd811c0305a91a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.788810:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997151.788812:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997151.788813:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.788820:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.788822:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.788823:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.788845:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.788863:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.788868:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c0305a921 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788876:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788878:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788881:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c0305a921 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788889:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c0305a921 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788896:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c0305a921 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788902:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c0305a921 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788930:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997151.788963:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.788967:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305a928 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788975:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788976:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.788979:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305a928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788988:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305a928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.788996:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305a928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789004:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305a928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789021:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1780997151.789050:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.789055:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c0305a92f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789061:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.789063:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.789071:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c0305a92f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789080:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c0305a92f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789087:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c0305a92f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789095:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c0305a92f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789107:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1780997151.789115:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780997151.789119:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c0305a921 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789126:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.789130:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c0305a921 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789137:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c0305a921 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789147:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c0305a921 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.789151:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997151.789155:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305a928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.789163:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.789165:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e8e7bac/0x30fd811c0305a921 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.789167:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305a928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.789175:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305a928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789178:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.789181:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c0305a92f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.789185:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305a928 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789187:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.789190:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c0305a92f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.789198:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305a928 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789199:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c0305a92f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789208:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c0305a92f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.789210:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.789211:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.789213:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.789215:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054aaa812/0x30fd811c0305a92f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789224:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.789226:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.789227:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.789286:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.789291:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305a936 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789303:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.789305:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.789308:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305a936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789317:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305a936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789324:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305a936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789332:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305a936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789346:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997151.789383:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.789387:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305a93d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789393:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.789395:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.789397:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305a93d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789406:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305a93d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789424:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305a93d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789431:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305a93d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789444:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997151.789452:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997151.789456:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305a936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789462:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.789465:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305a936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789473:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305a936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789483:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305a936 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789490:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305a936 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789502:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.789511:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305a93d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789517:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.789520:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305a93d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789527:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305a93d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789536:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305a93d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789541:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305a93d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789551:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.789552:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.789554:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.789595:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.789600:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305a944 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789607:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.789608:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.789611:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305a944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789630:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305a944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789638:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305a944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789646:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305a944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789659:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.789666:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.789670:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305a944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789676:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.789680:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305a944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789688:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305a944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789698:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305a944 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.789705:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305a944 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.790248:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997151.791495:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.791561:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.791564:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.791566:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.791685:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.791693:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c0305a94b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791708:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.791710:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.791714:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c0305a94b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791734:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c0305a94b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791745:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c0305a94b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791753:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c0305a94b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791778:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997151.791816:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.791821:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305a952 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791839:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.791840:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.791843:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305a952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791853:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305a952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791861:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305a952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791868:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305a952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791887:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780997151.791895:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997151.791901:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c0305a94b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.791910:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.791914:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c0305a94b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997151.791925:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.791930:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a959 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791937:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.791939:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.791942:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791950:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.791950:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997151.791955:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305a952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.791963:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997151.791967:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305a952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791968:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791976:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.791976:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305a952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.791989:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997151.791991:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305a952 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.792004:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305a952 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.792024:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997151.792028:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.792034:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997151.792037:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.792044:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.792054:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a959 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.792062:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305a959 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997151.792074:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997151.792076:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997151.792078:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997151.792083:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.792241:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c0305a94b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.792255:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c0305a94b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.792262:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001077654e/0x30fd811c0305a94b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.792768:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.792776:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.792778:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1780997151.793071:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1780997151.793964:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.793975:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a960 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.793990:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.793992:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.793995:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a960 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794005:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a960 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794014:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a960 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794033:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a960 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794051:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.794067:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.794072:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a960 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794079:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.794083:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a960 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794091:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794107:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a960 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794115:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305a960 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794134:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.794136:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.794138:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.794240:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.794245:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a967 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794253:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.794255:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.794258:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a967 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794297:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a967 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794305:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a967 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794312:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794327:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.794334:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.794339:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794359:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.794362:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794369:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794380:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a967 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794388:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305a967 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794407:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.794408:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.794410:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.794453:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.794458:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a96e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794466:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.794467:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.794470:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a96e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794479:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a96e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794487:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a96e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794493:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a96e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794508:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997151.794543:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.794547:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a975 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794563:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.794564:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.794567:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a975 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794576:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a975 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794582:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a975 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794589:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a975 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794607:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780997151.794611:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997151.794617:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a96e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.794624:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.794627:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a96e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.794635:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a96e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997151.794645:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997151.794645:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a96e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794650:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a97c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.794653:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305a96e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.794666:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.794669:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.794670:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997151.794670:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a975 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794674:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a97c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.794677:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.794680:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a975 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794683:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a97c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.794700:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a975 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794701:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a97c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794708:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a97c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.794711:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a975 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.794718:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305a975 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794730:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.794738:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.794741:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a97c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794747:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.794750:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a97c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794756:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a97c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794767:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a97c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794773:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faf0d599/0x30fd811c0305a97c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794786:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.794793:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.794795:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.794836:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.794841:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a983 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794848:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.794849:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.794852:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794859:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794867:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794874:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794886:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.794891:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997151.794892:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.794893:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.794895:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.794895:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.794902:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980030000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.794905:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794922:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794932:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a983 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794939:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c64a5bd/0x30fd811c0305a983 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.794951:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.794953:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.794954:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.794990:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.794995:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a98a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795002:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.795003:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.795006:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a98a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795015:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a98a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795022:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a98a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795039:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a98a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795051:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997151.795057:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997151.795060:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a98a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795066:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997151.795070:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a98a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795078:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a98a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795088:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a98a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795096:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a393e723/0x30fd811c0305a98a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795108:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.795110:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997151.795111:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997151.795151:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997151.795161:0:25179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a991 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795168:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.795170:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997151.795172:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795181:0:25179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795189:0:25179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795196:0:25179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997151.795213:0:25179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1780997151.795242:0:25179:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:770 00010000:00010000:1.0:1780997151.795242:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997151.795246:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.795253:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997151.795255:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.795262:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.795289:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a991 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.795306:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305a991 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997151.795319:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.795320:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997151.795322:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997151.795350:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:87029:x1867507126916096:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23306us (23472us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997151.795359:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5944 00000100:00100000:3.0:1780997151.795415:0:87029:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87029:1867507126916096:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1780997151.795432:0:87029:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x321:0x0] from OST, last_created [0x280000400:0x321:0x0]last_used is [0x280000400:0x302:0x0] 00000100:00100000:3.0:1780997151.795514:0:87029:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87029:1867507126916608:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1780997151.795548:0:87029:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997151.795577:0:87029:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997151.795595:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126916480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780997151.795620:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997151.795657:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126916608 00000100:00100000:3.0:1780997151.795663:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126916608 00000100:00100000:3.0:1780997151.795708:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5946 00000100:00100000:3.0:1780997151.795716:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:87029:x1867507126916608:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1780997151.795766:0:25170:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 802 00000100:00100000:3.0:1780997151.798508:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:87029:x1867507126916608:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2786us (2952us total) trans 4294969454 rc 0/0 00000100:00100000:3.0:1780997151.798520:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5946 00000100:00100000:1.0:1780997151.798541:0:87029:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87029:1867507126916608:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1780997151.798556:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126916480 00000004:00080000:1.0:1780997151.798557:0:87029:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x321:0x0]-[0x280000400:0x341:0x0] 00000100:00100000:3.0:1780997151.798562:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126916480 00000100:00100000:3.0:1780997151.798641:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:3.0:1780997151.798658:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126916480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780997151.798678:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997151.798716:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126916480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (3095us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997151.798732:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00100000:1.0:1780997151.802844:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126916480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1780997151.802882:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1780997152.174403:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000004:2.0:1780997152.338231:0:87382:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1780997152.338521:0:87382:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1780997152.485450:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997153.509548:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997154.255723:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997154.255816:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110377216 00000100:00100000:0.0:1780997154.255828:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110377216 00000100:00100000:0.0:1780997154.255975:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1287 00000100:00100000:0.0:1780997154.255986:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:69161:x1867507110377216:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1780997154.256010:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997154.256041:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee800/0x30fd811c0305a998 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c3a expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997154.256113:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305a99f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997154.256128:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305a99f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997154.256143:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305a99f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997154.256200:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780997154.256204:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997154.256241:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305a99f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997154.256308:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee800/0x30fd811c0305a998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c3a expref: 9 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997154.256361:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305a99f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c3a expref: 8 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997154.256369:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88e200) 00010000:00010000:0.0:1780997154.256372:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780997154.256375:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ee600, rc 0) 00000100:00100000:0.0:1780997154.256487:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69161:x1867507110377216:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 503us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997154.256495:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1287 00000100:00080000:1.0:1780997154.257594:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780997154.265400:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997154.265507:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110377344 00000100:00100000:0.0:1780997154.265519:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110377344 00000100:00100000:0.0:1780997154.265587:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1288 00000100:00100000:0.0:1780997154.265598:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69161:x1867507110377344:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:0.0:1780997154.265642:0:65272:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445261312 avail 1299021824 00000100:00100000:0.0:1780997154.265731:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69161:x1867507110377344:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 136us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997154.265740:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1288 00000100:00100000:3.0:1780997154.275519:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997154.275770:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110377472 00000100:00100000:0.0:1780997154.275782:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110377472 00000100:00100000:0.0:1780997154.275930:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1289 00000100:00100000:0.0:1780997154.275942:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:69161:x1867507110377472:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:0.0:1780997154.275987:0:63419:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780997154.276085:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:69161:x1867507110377472:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 145us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997154.276094:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1289 00000100:00080000:1.0:1780997154.277454:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997154.279963:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997154.280120:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110377600 00000100:00100000:0.0:1780997154.280129:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110377600 00000100:00100000:0.0:1780997154.280201:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2068 00000100:00100000:0.0:1780997154.280212:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:69161:x1867507110377600:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1780997154.280243:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997154.280333:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:69161:x1867507110377600:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 123us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997154.280341:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2068 00000100:00080000:1.0:1780997154.281034:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997154.282888:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997154.284686:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110377728 00000100:00100000:1.0:1780997154.284701:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110377728 00000100:00100000:1.0:1780997154.284843:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2069 00000100:00100000:1.0:1780997154.284855:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:69161:x1867507110377728:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:1.0:1780997154.284887:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997154.284969:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:69161:x1867507110377728:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 117us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997154.284978:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2069 00000100:00080000:2.0:1780997154.289808:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1780997154.533922:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997155.557601:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997156.262530:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126916736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997156.262602:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997156.262658:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997156.262664:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126916864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997156.262687:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997156.262830:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126916736 00000100:00100000:3.0:1780997156.262838:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126916736 00000100:00100000:3.0:1780997156.262892:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126916864 00000100:00100000:3.0:1780997156.262895:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126916864 00000100:00100000:3.0:1780997156.262959:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:3.0:1780997156.262968:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126916736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997156.262995:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997156.263043:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126916736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997156.263050:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00100000:3.0:1780997156.263066:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071 00000100:00100000:3.0:1780997156.263072:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126916864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997156.263086:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997156.263111:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126916864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997156.263117:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071 00000100:00080000:2.0:1780997156.263351:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997156.263356:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997156.263389:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126916864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997156.263402:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126916736:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1780997156.581741:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997156.612663:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997156.612718:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997156.612756:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997156.612779:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997156.612801:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997156.612836:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110378368 00000100:00100000:3.0:1780997156.612846:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110378368 00000100:00100000:3.0:1780997156.612914:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110378240 00000100:00100000:3.0:1780997156.612918:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110378240 00000100:00100000:3.0:1780997156.612942:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2584 00000100:00100000:3.0:1780997156.612953:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110378368:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997156.613037:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110378368:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 85us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997156.613045:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2584 00000100:00100000:3.0:1780997156.613079:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2585 00000100:00100000:3.0:1780997156.613085:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110378240:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997156.613112:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110378240:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997156.613118:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2585 00000100:00100000:2.0:1780997156.613157:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110377856 00000100:00100000:2.0:1780997156.613163:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110377856 00000100:00100000:2.0:1780997156.613200:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:2.0:1780997156.613207:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110377856:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997156.613242:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110377856:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997156.613248:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:0.0:1780997156.613295:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110378112 00000100:00100000:0.0:1780997156.613300:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110378112 00000100:00100000:2.0:1780997156.613314:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110377984 00000100:00100000:2.0:1780997156.613319:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110377984 00000100:00100000:0.0:1780997156.613342:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1261 00000100:00100000:0.0:1780997156.613353:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110378112:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997156.613357:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1262 00000100:00100000:2.0:1780997156.613368:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2394:x1867507110377984:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:3.0:1780997156.613912:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780997156.613917:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997156.613920:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780997156.613922:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997156.614442:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110378112:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1089us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997156.614452:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1261 00000100:00100000:2.0:1780997156.616093:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2394:x1867507110377984:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 2716us (3302us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997156.616123:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1262 00000100:00100000:3.0:1780997156.773639:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780997156.773662:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126916992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997156.773744:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997156.774094:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126917376:0@lo:400:kworker.0 00000100:00100000:1.0:1780997156.774129:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126917504:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.774130:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997156.774157:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126917888:0@lo:400:kworker.0 00000100:00100000:1.0:1780997156.774192:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997156.774198:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997156.774218:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126918016:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.774224:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126918400:0@lo:400:kworker.0 00000100:00100000:1.0:1780997156.774247:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997156.774289:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126917376 00000100:00100000:1.0:1780997156.774297:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126918528:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.774298:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126917376 00000100:00100000:1.0:1780997156.774325:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997156.774345:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1780997156.774353:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126917120:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.774358:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126917504 00000100:00100000:0.0:1780997156.774363:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126917504 00000100:00100000:0.0:1780997156.774388:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126918528 00000100:00100000:1.0:1780997156.774392:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997156.774393:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126918528 00000100:00100000:1.0:1780997156.774430:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126917632:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.774431:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1780997156.774444:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126917376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997156.774458:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997156.774471:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126918144:0@lo:400:kworker.0 00000100:00100000:1.0:1780997156.774503:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997156.774507:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126917376:12345-0@lo:400:kworker.0 Request processed in 64us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997156.774517:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:1.0:1780997156.774530:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126917888 00000100:00100000:1.0:1780997156.774535:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126917888 00000100:00100000:0.0:1780997156.774544:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126917632 00000100:00100000:0.0:1780997156.774550:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126917632 00000100:00100000:1.0:1780997156.774566:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126918016 00000100:00100000:1.0:1780997156.774570:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126918016 00000100:00100000:0.0:1780997156.774578:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126918144 00000100:00100000:0.0:1780997156.774583:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126918144 00000100:00100000:1.0:1780997156.774601:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:0.0:1780997156.774606:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1780997156.774612:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126917888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.774618:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507126917504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.774659:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507126917504:12345-0@lo:400:kworker.0 Request processed in 45us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997156.774667:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1780997156.774674:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126917888:12345-0@lo:400:kworker.0 Request processed in 65us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997156.774682:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:1.0:1780997156.774684:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:0.0:1780997156.774704:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126918528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997156.774712:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:1.0:1780997156.774722:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126918016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.774739:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126918528:12345-0@lo:400:kworker.0 Request processed in 49us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997156.774746:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:1.0:1780997156.774763:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126918016:12345-0@lo:400:kworker.0 Request processed in 41us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997156.774764:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1780997156.774774:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126917632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997156.774788:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00100000:0.0:1780997156.774811:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126917632:12345-0@lo:400:kworker.0 Request processed in 37us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997156.774812:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126917120 00000100:00100000:1.0:1780997156.774818:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126917120 00000100:00100000:0.0:1780997156.774822:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1780997156.774839:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1780997156.774846:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126918144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997156.774852:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1780997156.774863:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126917120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.774891:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126918144:12345-0@lo:400:kworker.0 Request processed in 45us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997156.774897:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1780997156.774921:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126917120:12345-0@lo:400:kworker.0 Request processed in 60us (530us total) trans 0 rc 0/0 00000100:00080000:0.0:1780997156.774927:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997156.774931:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1780997156.774933:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997156.774945:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997156.774968:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126918400 00000100:00100000:1.0:1780997156.774972:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126918400 00000100:00100000:0.0:1780997156.774989:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126917376:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.775002:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126917888:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.775015:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1780997156.775022:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126917248:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.775045:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997156.775062:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126917760:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.775083:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997156.775098:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126918272:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.775123:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997156.775148:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126917248 00000100:00100000:0.0:1780997156.775152:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126917248 00000100:00100000:1.0:1780997156.775206:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126918272 00000100:00100000:1.0:1780997156.775211:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126918272 00000100:00100000:2.0:1780997156.775302:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126916992 00000100:00100000:2.0:1780997156.775308:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126916992 00000100:00100000:2.0:1780997156.775340:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126917760 00000100:00100000:2.0:1780997156.775343:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126917760 00000100:00100000:2.0:1780997156.775360:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989 00000100:00100000:2.0:1780997156.775365:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126916992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780997156.775391:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1780997156.775428:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126916992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997156.775434:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989 00000100:00100000:2.0:1780997156.775446:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00100000:2.0:1780997156.775451:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126917760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997156.775481:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126917760:12345-0@lo:400:kworker.0 Request processed in 30us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997156.775487:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00000100:00100000:2.0:1780997156.775562:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126918656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997156.775588:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997156.775624:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126916992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997156.775646:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126918656 00000100:00100000:2.0:1780997156.775649:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126918656 00000100:00100000:2.0:1780997156.775668:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00100000:2.0:1780997156.775675:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126918656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780997156.775690:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445261312 avail 1299021824 00000100:00100000:2.0:1780997156.775732:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3499:x1867507126918656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997156.775745:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991 00000100:00100000:2.0:1780997156.775775:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126918656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997156.775812:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:0.0:1780997156.776513:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1780997156.776526:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126917248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.776567:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126917248:12345-0@lo:400:kworker.0 Request processed in 46us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997156.776573:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1780997156.776610:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126917248:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.776621:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126917760:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.776712:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126917120:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.776724:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126917632:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.776734:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126918144:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.776745:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126917504:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.776756:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126918016:0@lo:400:kworker.0 00000100:00100000:0.0:1780997156.776768:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126918528:0@lo:400:kworker.0 00000100:00100000:2.0:1780997156.776900:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126918400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997156.776951:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126918400:12345-0@lo:400:kworker.0 Request processed in 1133us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997156.776959:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:0.0:1780997156.777069:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126918400:0@lo:400:kworker.0 00000100:00080000:3.0:1780997156.777122:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780997156.777129:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780997156.777132:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997156.777141:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:1.0:1780997156.777150:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126918272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997156.777202:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126918272:12345-0@lo:400:kworker.0 Request processed in 53us (2077us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997156.777210:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:0.0:1780997156.777222:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126918272:0@lo:400:kworker.0 00000100:00100000:1.0:1780997157.286422:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126918784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997157.286492:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997157.286610:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126918784 00000100:00100000:3.0:1780997157.286620:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126918784 00000100:00100000:3.0:1780997157.286677:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:3.0:1780997157.286687:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126918784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780997157.286722:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997157.286771:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126918784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997157.286778:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00100000:3.0:1780997157.286825:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126918784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997157.294255:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126918912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997157.294347:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997157.294401:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126918912 00000100:00100000:1.0:1780997157.294409:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126918912 00000100:00100000:1.0:1780997157.294455:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:1.0:1780997157.294465:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126918912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780997157.294488:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997157.294547:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126918912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997157.294555:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00100000:1.0:1780997157.294605:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126918912:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1780997157.295378:0:9294:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969453 is committed 00000001:00080000:3.0:1780997157.297326:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969454 is committed 00000001:02000400:0.0:1780997157.575866:0:87479:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:2.0:1780997157.610424:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997158.630463:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1780997159.047245:0:87527:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1780997159.664335:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997160.677567:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997160.830743:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997160.830852:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110378496 00000100:00100000:2.0:1780997160.830863:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110378496 00000100:00100000:2.0:1780997160.830950:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1290 00000100:00100000:2.0:1780997160.830962:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69607:x1867507110378496:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:2.0:1780997160.831009:0:80049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445261312 avail 1299021824 00000100:00100000:2.0:1780997160.831088:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69607:x1867507110378496:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 129us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997160.831097:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1290 00000100:00080000:3.0:1780997160.832379:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997160.834245:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997160.834502:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110378624 00000100:00100000:2.0:1780997160.834512:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110378624 00000100:00100000:2.0:1780997160.834775:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1291 00000100:00100000:2.0:1780997160.834785:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:69607:x1867507110378624:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:2.0:1780997160.834821:0:65272:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1780997160.834901:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:69607:x1867507110378624:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 118us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997160.834908:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1291 00000100:00080000:3.0:1780997160.839413:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997160.839819:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997160.839936:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110378752 00000100:00100000:0.0:1780997160.839947:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110378752 00000100:00100000:0.0:1780997160.840020:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2074 00000100:00100000:0.0:1780997160.840034:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:69607:x1867507110378752:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1780997160.840072:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997160.840146:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:69607:x1867507110378752:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 116us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997160.840154:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2074 00000100:00100000:1.0:1780997160.842307:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997160.842559:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110378880 00000100:00100000:0.0:1780997160.842568:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110378880 00000100:00100000:0.0:1780997160.842743:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2075 00000100:00100000:0.0:1780997160.842769:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:69607:x1867507110378880:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1780997160.842800:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997160.842867:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:69607:x1867507110378880:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 101us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997160.842873:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2075 00000100:00080000:2.0:1780997160.845851:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997160.845878:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997160.899944:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997160.900120:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110379136 00000100:00100000:0.0:1780997160.900130:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110379136 00000100:00100000:0.0:1780997160.900191:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1292 00000100:00100000:0.0:1780997160.900198:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a679a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69624:x1867507110379136:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1780997160.900217:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997160.900236:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c41 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900345:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900359:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900370:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900384:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900391:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900397:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900506:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9ad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900514:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9ad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900709:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900716:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900721:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ef600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997160.900726:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900733:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9ad lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900745:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88e200) 00010000:00010000:0.0:1780997160.900747:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997160.900752:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9ad lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900758:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900770:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900776:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900788:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900793:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4eee00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997160.900795:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900800:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900806:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9689bc9ea300) 00010000:00010000:0.0:1780997160.900808:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997160.900811:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900815:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900848:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c41 expref: 9 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900857:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88e200) 00010000:00010000:0.0:1780997160.900859:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780997160.900862:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c41 expref: 9 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.900872:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ee400, rc 0) 00000100:00100000:0.0:1780997160.901082:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a679a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69624:x1867507110379136:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 883us (1149us total) trans 0 rc 301/301 00000100:00100000:0.0:1780997160.901095:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1292 00000100:00100000:3.0:1780997160.921311:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997160.921422:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110379264 00000100:00100000:0.0:1780997160.921433:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110379264 00000100:00100000:0.0:1780997160.921508:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1293 00000100:00100000:0.0:1780997160.921529:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69624:x1867507110379264:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1780997160.921618:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921634:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921646:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921661:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921677:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921684:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921760:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9c9 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921770:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9c9 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921777:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9c9 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997160.921840:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:0.0:1780997160.921844:0:63418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997160.921856:0:63418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9c9 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921869:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921876:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921895:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921903:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921908:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997160.921913:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921920:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9bb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921933:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88e200) 00010000:00010000:0.0:1780997160.921937:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997160.921941:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9bb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921948:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305a9bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921975:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921983:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921989:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.921995:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4eee00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997160.921999:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.922005:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.922013:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9689bc9ea300) 00010000:00010000:0.0:1780997160.922015:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997160.922018:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.922024:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305a9c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.922037:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9c9 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.922043:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9c9 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.922049:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9c9 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.922060:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ef600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997160.922063:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9c9 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.922070:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9c9 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.922096:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689836c9800) 00010000:00010000:0.0:1780997160.922100:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997160.922103:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9c9 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.922109:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9c9 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997160.922192:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69624:x1867507110379264:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 673us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997160.922200:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1293 00000100:00100000:1.0:1780997160.943266:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997160.943435:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110379520 00000100:00100000:2.0:1780997160.943446:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110379520 00000100:00100000:2.0:1780997160.943504:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1294 00000100:00100000:2.0:1780997160.943515:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69627:x1867507110379520:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780997160.943546:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997160.943568:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305a9d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c48 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943647:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455600/0x30fd811c0305a9d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943661:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455600/0x30fd811c0305a9d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943681:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455600/0x30fd811c0305a9d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943697:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305a9de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943705:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305a9de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943712:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305a9de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943803:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455600/0x30fd811c0305a9d7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943810:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455600/0x30fd811c0305a9d7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943836:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455600/0x30fd811c0305a9d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943843:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455600/0x30fd811c0305a9d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943849:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997160.943853:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455600/0x30fd811c0305a9d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943860:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455600/0x30fd811c0305a9d7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943870:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88e200) 00010000:00010000:2.0:1780997160.943873:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997160.943878:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455600/0x30fd811c0305a9d7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943884:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455600/0x30fd811c0305a9d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943902:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305a9de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943908:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305a9de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943913:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305a9de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943918:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997160.943926:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305a9de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943932:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305a9de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943940:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff96898b4c3d00) 00010000:00010000:2.0:1780997160.943942:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997160.943944:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305a9de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943949:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305a9de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943982:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305a9d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c48 expref: 9 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.943992:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88e200) 00010000:00010000:2.0:1780997160.943994:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780997160.943997:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305a9d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c48 expref: 9 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.944007:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454c00, rc 0) 00000100:00100000:2.0:1780997160.944076:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69627:x1867507110379520:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 563us (818us total) trans 0 rc 301/301 00000100:00100000:2.0:1780997160.944083:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1294 00000100:00100000:3.0:1780997160.947199:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997160.947306:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110379648 00000100:00100000:2.0:1780997160.947317:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110379648 00000100:00100000:2.0:1780997160.947374:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1295 00000100:00100000:2.0:1780997160.947384:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69627:x1867507110379648:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1780997160.947471:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a9e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947489:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a9e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947500:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a9e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947515:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842c00/0x30fd811c0305a9ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947534:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842c00/0x30fd811c0305a9ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947541:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842c00/0x30fd811c0305a9ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947792:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842800/0x30fd811c0305a9f3 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947801:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842800/0x30fd811c0305a9f3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947808:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842800/0x30fd811c0305a9f3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997160.947849:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:2.0:1780997160.947853:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780997160.947866:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842800/0x30fd811c0305a9f3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947879:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a9e5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947892:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a9e5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947898:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a9e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947904:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a9e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947910:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997160.947914:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a9e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947922:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a9e5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947934:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88e200) 00010000:00010000:2.0:1780997160.947937:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997160.947941:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a9e5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947947:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455e00/0x30fd811c0305a9e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947961:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842c00/0x30fd811c0305a9ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947966:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842c00/0x30fd811c0305a9ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947971:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842c00/0x30fd811c0305a9ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947981:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997160.947984:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842c00/0x30fd811c0305a9ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947990:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842c00/0x30fd811c0305a9ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.947997:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff96898b4c3000) 00010000:00010000:2.0:1780997160.948000:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997160.948002:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842c00/0x30fd811c0305a9ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.948008:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842c00/0x30fd811c0305a9ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.948023:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842800/0x30fd811c0305a9f3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.948029:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842800/0x30fd811c0305a9f3 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.948034:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842800/0x30fd811c0305a9f3 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.948039:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997160.948042:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842800/0x30fd811c0305a9f3 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.948047:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842800/0x30fd811c0305a9f3 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.948066:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689836c9800) 00010000:00010000:2.0:1780997160.948069:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997160.948078:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842800/0x30fd811c0305a9f3 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997160.948083:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842800/0x30fd811c0305a9f3 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997160.948163:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69627:x1867507110379648:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 779us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997160.948171:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1295 00000100:00100000:3.0:1780997160.975237:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997160.975495:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110379904 00000100:00100000:0.0:1780997160.975507:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110379904 00000100:00100000:0.0:1780997160.975591:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1296 00000100:00100000:0.0:1780997160.975611:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:69633:x1867507110379904:12345-192.168.206.51@tcp:101:md5sum.0 00010000:00010000:0.0:1780997160.975648:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997160.975680:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c4f expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.975769:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305aa01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.975806:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305aa01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.975818:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305aa01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.975835:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305aa08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.975844:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305aa08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.975850:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305aa08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.975970:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4efa00/0x30fd811c0305aa0f lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.975979:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4efa00/0x30fd811c0305aa0f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.975986:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4efa00/0x30fd811c0305aa0f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997160.975996:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00010000:00010000:0.0:1780997160.976094:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305aa01 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976102:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305aa01 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976109:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305aa01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976122:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305aa01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976128:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4eee00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997160.976132:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305aa01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976140:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305aa01 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976153:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88e200) 00010000:00010000:0.0:1780997160.976156:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997160.976161:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305aa01 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976167:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4eee00/0x30fd811c0305aa01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976181:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305aa08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976187:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305aa08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976192:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305aa08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976197:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997160.976200:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305aa08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976215:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305aa08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976223:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9689bc9ea300) 00010000:00010000:0.0:1780997160.976226:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997160.976229:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305aa08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976234:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee400/0x30fd811c0305aa08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976350:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef600/0x30fd811c0305a9fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c4f expref: 11 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976365:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4efa00/0x30fd811c0305aa0f lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c4f expref: 10 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997160.976373:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689836c9800) 00010000:00010000:0.0:1780997160.976376:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780997160.976378:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4efa00, rc 0) 00000100:00100000:0.0:1780997160.976445:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:69633:x1867507110379904:12345-192.168.206.51@tcp:101:md5sum.0 Request processed in 836us (1217us total) trans 111669149697 rc 0/0 00000100:00100000:0.0:1780997160.976452:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1296 00000100:00100000:1.0:1780997161.003036:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997161.003142:0:24144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110380032 00000100:00100000:0.0:1780997161.003152:0:24144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110380032 00002000:00100000:0.0:1780997161.003204:0:24144:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x302:0x0] (0->32767) req@ffff9689b11a8380 x1867507110380032/t0(0) o3->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:492/0 lens 488/0 e 0 to 0 dl 1780997172 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997161.003237:0:24144:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b11a8380 with x1867507110380032 ext(0->32767) 00002000:00010000:0.0:1780997161.003243:0:24144:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9689b11a8380 00000100:00100000:0.0:1780997161.003314:0:24144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1005 00000100:00100000:0.0:1780997161.003323:0:24144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110380032:12345-192.168.206.51@tcp:3:md5sum.0 00000100:00100000:0.0:1780997161.011153:0:24144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110380032:12345-192.168.206.51@tcp:3:md5sum.0 Request processed in 7819us (8114us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997161.011168:0:24144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1005 00002000:00100000:0.0:1780997161.011183:0:24144:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x302:0x0] (0->32767) req@ffff9689b11a8380 x1867507110380032/t0(0) o3->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:492/0 lens 488/440 e 0 to 0 dl 1780997172 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997161.011193:0:24144:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b11a8380 with x1867507110380032 ext(0->32767) 00002000:00010000:0.0:1780997161.011199:0:24144:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9689b11a8380 00000100:00100000:1.0:1780997161.036095:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997161.036141:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997161.036889:0:24143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110380160 00000100:00100000:3.0:1780997161.036899:0:24143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110380160 00002000:00100000:3.0:1780997161.036945:0:24143:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x302:0x0] (32768->1048575) req@ffff9689adeddc00 x1867507110380160/t0(0) o3->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:492/0 lens 488/0 e 0 to 0 dl 1780997172 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780997161.036957:0:24143:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adeddc00 with x1867507110380160 ext(32768->1048575) 00002000:00010000:3.0:1780997161.036962:0:24143:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9689adeddc00 00000100:00100000:3.0:1780997161.037004:0:24143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110380288 00000100:00100000:3.0:1780997161.037008:0:24143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110380288 00002000:00100000:3.0:1780997161.037024:0:24143:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x302:0x0] (1048576->2097151) req@ffff9689bfb0d180 x1867507110380288/t0(0) o3->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:492/0 lens 488/0 e 0 to 0 dl 1780997172 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780997161.037031:0:24143:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb0d180 with x1867507110380288 ext(1048576->2097151) 00002000:00010000:3.0:1780997161.037035:0:24143:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb0d180 00000100:00100000:3.0:1780997161.037062:0:24143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1006 00000100:00100000:3.0:1780997161.037072:0:24143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adeddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2396:x1867507110380160:12345-192.168.206.51@tcp:3:md5sum.0 00000100:00100000:1.0:1780997161.037689:0:23854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1007 00000100:00100000:1.0:1780997161.037701:0:23854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110380288:12345-192.168.206.51@tcp:3:md5sum.0 00000100:00100000:0.0:1780997161.054428:0:24143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adeddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2396:x1867507110380160:12345-192.168.206.51@tcp:3:md5sum.0 Request processed in 17197us (18180us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997161.054443:0:24143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1006 00002000:00100000:0.0:1780997161.054458:0:24143:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x302:0x0] (32768->1048575) req@ffff9689adeddc00 x1867507110380160/t0(0) o3->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:492/0 lens 488/440 e 0 to 0 dl 1780997172 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997161.054468:0:24143:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adeddc00 with x1867507110380160 ext(32768->1048575) 00002000:00010000:0.0:1780997161.054475:0:24143:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9689adeddc00 00000100:00100000:1.0:1780997161.095416:0:23854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2396:x1867507110380288:12345-192.168.206.51@tcp:3:md5sum.0 Request processed in 57707us (59264us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1780997161.095431:0:23854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1007 00002000:00100000:1.0:1780997161.095443:0:23854:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x302:0x0] (1048576->2097151) req@ffff9689bfb0d180 x1867507110380288/t0(0) o3->285c134c-d3a6-4c01-bb4d-8148c50d5f95@192.168.206.51@tcp:492/0 lens 488/440 e 0 to 0 dl 1780997172 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997161.095454:0:23854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb0d180 with x1867507110380288 ext(1048576->2097151) 00002000:00010000:1.0:1780997161.095460:0:23854:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb0d180 00000100:00100000:1.0:1780997161.118101:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997161.121464:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110380544 00000100:00100000:2.0:1780997161.121480:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110380544 00000100:00100000:2.0:1780997161.121743:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 228 00000100:00100000:2.0:1780997161.121756:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889fe5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:69633:x1867507110380544:12345-192.168.206.51@tcp:35:md5sum.0 00000001:00080000:2.0:1780997161.122190:0:63420:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 111669149698 00000100:00100000:2.0:1780997161.122344:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889fe5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:69633:x1867507110380544:12345-192.168.206.51@tcp:35:md5sum.0 Request processed in 590us (4257us total) trans 111669149699 rc 0/0 00000100:00100000:2.0:1780997161.122352:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 228 00000020:00080000:2.0:1780997161.122363:0:63420:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1780997161.383178:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126919040:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997161.383293:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997161.383388:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126919040 00000100:00100000:3.0:1780997161.383399:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126919040 00000100:00100000:3.0:1780997161.383463:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:3.0:1780997161.383474:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126919040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997161.383496:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00080000:0.0:1780997161.383932:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997161.384023:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126919168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997161.384058:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997161.384094:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126919168 00000100:00100000:1.0:1780997161.384108:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126919168 00000100:00100000:1.0:1780997161.384141:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00100000:1.0:1780997161.384148:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126919168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997161.384162:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997161.384198:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126919168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997161.384206:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00100000:1.0:1780997161.384256:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126919168:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1780997161.384356:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997161.389337:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126919040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5851us (6052us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997161.389354:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00100000:2.0:1780997161.389387:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126919040:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1780997161.703112:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997161.741950:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997161.742002:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997161.742043:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997161.742055:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110380672 00000100:00100000:2.0:1780997161.742065:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110380672 00000100:00100000:3.0:1780997161.742074:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997161.742099:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997161.742119:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110380928 00000100:00100000:3.0:1780997161.742123:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110380928 00000100:00100000:2.0:1780997161.742128:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:2.0:1780997161.742137:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110380672:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997161.742152:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110380800 00000100:00100000:3.0:1780997161.742154:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110380800 00000100:00100000:1.0:1780997161.742175:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110381184 00000100:00100000:3.0:1780997161.742181:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1269 00000100:00100000:1.0:1780997161.742183:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110381184 00000100:00100000:3.0:1780997161.742190:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110380928:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997161.742218:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2394:x1867507110380672:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 81us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997161.742221:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110381056 00000100:00100000:1.0:1780997161.742226:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110381056 00000100:00100000:3.0:1780997161.742228:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110380928:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 40us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997161.742228:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:3.0:1780997161.742235:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1269 00000100:00100000:3.0:1780997161.742253:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1270 00000100:00100000:1.0:1780997161.742259:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2590 00000100:00100000:3.0:1780997161.742264:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2394:x1867507110380800:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997161.742308:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110381184:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997161.742338:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:2394:x1867507110380800:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 77us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997161.742345:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1270 00000100:00100000:0.0:1780997161.742455:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2591 00000100:00100000:0.0:1780997161.742467:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110381056:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997161.747233:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2394:x1867507110381184:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 4950us (5174us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997161.747250:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2590 00000100:00100000:0.0:1780997161.747902:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2394:x1867507110381056:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 5435us (5798us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997161.747924:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2591 00000100:00100000:0.0:1780997161.894053:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1780997161.894077:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126919296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997161.894146:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997161.894193:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126919424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997161.894221:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997161.894309:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126919296 00000100:00100000:2.0:1780997161.894319:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126919296 00000100:00100000:2.0:1780997161.894380:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126919424 00000100:00100000:2.0:1780997161.894384:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126919424 00000100:00100000:2.0:1780997161.894410:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992 00000100:00100000:2.0:1780997161.894419:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126919296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780997161.894458:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445261312 avail 1299021824 00000100:00100000:2.0:1780997161.894520:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126919296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997161.894531:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00000100:00100000:2.0:1780997161.894555:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993 00000100:00100000:2.0:1780997161.894564:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126919424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780997161.894584:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1780997161.894614:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126919808:0@lo:400:kworker.0 00000100:00100000:2.0:1780997161.894620:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126919424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997161.894629:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00000100:00100000:1.0:1780997161.894654:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997161.894660:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126919680:0@lo:400:kworker.0 00000100:00100000:1.0:1780997161.894689:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126920320:0@lo:400:kworker.0 00000100:00100000:1.0:1780997161.894717:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997161.894736:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b0bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126920832:0@lo:400:kworker.0 00000100:00100000:1.0:1780997161.894762:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997161.894777:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507126919936:0@lo:400:kworker.0 00000100:00100000:0.0:1780997161.894813:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126919552:0@lo:400:kworker.0 00000100:00100000:1.0:1780997161.894823:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126919808 00000100:00100000:3.0:1780997161.894829:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997161.894829:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126919808 00000100:00100000:1.0:1780997161.894884:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126920832 00000100:00100000:1.0:1780997161.894888:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126920832 00000100:00100000:1.0:1780997161.894903:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126919936 00000100:00100000:1.0:1780997161.894906:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126919936 00000100:00100000:1.0:1780997161.894925:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1780997161.894932:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126919808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997161.897683:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126920448:0@lo:400:kworker.0 00000100:00100000:3.0:1780997161.897744:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997161.897798:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126920320 00000100:00100000:3.0:1780997161.897804:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126920320 00000100:00100000:3.0:1780997161.897900:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1780997161.897910:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126920320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997161.897969:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126920320:12345-0@lo:400:kworker.0 Request processed in 60us (3250us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997161.897977:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1780997161.898366:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126920448 00000100:00100000:3.0:1780997161.898371:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126920448 00000100:00100000:3.0:1780997161.898395:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1780997161.898402:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126920832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997161.898443:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126920832:12345-0@lo:400:kworker.0 Request processed in 41us (3680us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997161.898449:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1780997161.898464:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1780997161.898470:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507126919936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997161.898650:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507126919936:12345-0@lo:400:kworker.0 Request processed in 180us (3822us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997161.898657:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1780997161.898678:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:3.0:1780997161.898684:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126920448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997161.898710:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126920448:12345-0@lo:400:kworker.0 Request processed in 26us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997161.898715:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:3.0:1780997161.898753:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507126919936:0@lo:400:kworker.0 00000100:00100000:3.0:1780997161.898763:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126920448:0@lo:400:kworker.0 00000100:00100000:3.0:1780997161.898807:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126920320:0@lo:400:kworker.0 00000100:00100000:3.0:1780997161.898821:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b0bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126920832:0@lo:400:kworker.0 00000100:00100000:0.0:1780997161.899655:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997161.899774:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126920064:0@lo:400:kworker.0 00000100:00100000:0.0:1780997161.899819:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997161.899841:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126920576:0@lo:400:kworker.0 00000100:00100000:0.0:1780997161.899871:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997161.899913:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126920064 00000100:00100000:0.0:1780997161.899919:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126919296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780997161.899921:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126920064 00000100:00100000:0.0:1780997161.899943:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126919424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997161.899984:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126919552 00000100:00100000:0.0:1780997161.899989:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126919552 00000100:00100000:0.0:1780997161.900023:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1780997161.900030:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aeb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126919552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997161.900067:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aeb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126919552:12345-0@lo:400:kworker.0 Request processed in 37us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997161.900073:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1780997161.900113:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126919552:0@lo:400:kworker.0 00000100:00080000:0.0:1780997161.900144:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780997161.900160:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997161.900225:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1780997161.900235:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126920064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997161.900262:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126920576 00000100:00100000:0.0:1780997161.900300:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126920064:12345-0@lo:400:kworker.0 Request processed in 67us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997161.900306:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126920576 00000100:00100000:0.0:1780997161.900309:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00080000:0.0:1780997161.900332:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997161.900349:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:0.0:1780997161.900358:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126920064:0@lo:400:kworker.0 00000100:00100000:3.0:1780997161.900360:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126920576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997161.900513:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997161.900538:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126920192:0@lo:400:kworker.0 00000100:00100000:2.0:1780997161.900564:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997161.900591:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126920192 00000100:00100000:2.0:1780997161.900601:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126920192 00000100:00100000:2.0:1780997161.900627:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:2.0:1780997161.900633:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126920192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997161.900678:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126920192:12345-0@lo:400:kworker.0 Request processed in 45us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997161.900684:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:2.0:1780997161.900725:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126920192:0@lo:400:kworker.0 00000100:00100000:2.0:1780997161.900732:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b0bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126920704:0@lo:400:kworker.0 00000100:00100000:2.0:1780997161.900754:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997161.900777:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126920704 00000100:00100000:2.0:1780997161.900781:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126920704 00000100:00100000:2.0:1780997161.900813:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1780997161.900820:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126920704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997161.900850:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126920704:12345-0@lo:400:kworker.0 Request processed in 31us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997161.900856:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00080000:2.0:1780997161.900870:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997161.900884:0:3498:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 2 00000100:00100000:2.0:1780997161.900895:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b0bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126920704:0@lo:400:kworker.0 00000100:00100000:0.0:1780997161.901065:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126919680 00000100:00100000:0.0:1780997161.901069:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126919680 00000100:00100000:0.0:1780997161.901106:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1780997161.901112:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507126919680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997161.901145:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507126919680:12345-0@lo:400:kworker.0 Request processed in 34us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997161.901151:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00080000:2.0:1780997161.901220:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780997161.901240:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126919680:0@lo:400:kworker.0 00000100:00100000:3.0:1780997161.901747:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126920576:12345-0@lo:400:kworker.0 Request processed in 1388us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997161.901757:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:1.0:1780997161.902014:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126919808:12345-0@lo:400:kworker.0 Request processed in 7080us (7358us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997161.902023:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1780997161.902647:0:3497:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 2 00000100:00100000:0.0:1780997161.902675:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126920576:0@lo:400:kworker.0 00000100:00100000:3.0:1780997161.902722:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126919808:0@lo:400:kworker.0 00000100:00100000:3.0:1780997162.405956:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126920960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780997162.406029:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997162.406177:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126921088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780997162.406207:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997162.406240:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126920960 00000100:00100000:0.0:1780997162.406248:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126920960 00000100:00100000:0.0:1780997162.406313:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126921088 00000100:00100000:0.0:1780997162.406317:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126921088 00000100:00100000:0.0:1780997162.406340:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:0.0:1780997162.406348:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126920960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780997162.406369:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997162.406420:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126920960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997162.406427:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00100000:0.0:1780997162.406446:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:0.0:1780997162.406451:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126921088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780997162.406461:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997162.406490:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126921088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997162.406496:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00100000:0.0:1780997162.406544:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126921088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780997162.406574:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126920960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1780997162.727543:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997163.750298:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997164.773808:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997165.798832:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997166.502415:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126921216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997166.502904:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997166.502958:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997166.502965:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126921344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997166.502992:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997166.503079:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126921216 00000100:00100000:2.0:1780997166.503088:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126921216 00000100:00100000:2.0:1780997166.503144:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126921344 00000100:00100000:2.0:1780997166.503147:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126921344 00000100:00100000:2.0:1780997166.503169:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:2.0:1780997166.503178:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126921216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997166.503218:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997166.503264:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126921216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997166.503292:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:2.0:1780997166.503310:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:2.0:1780997166.503316:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126921344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780997166.503329:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997166.503373:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126921344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997166.503379:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00100000:2.0:1780997166.503598:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126921344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997166.503618:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126921216:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1780997166.503974:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997166.503980:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1780997166.504580:0:87010:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00010000:00010000:1.0:1780997166.821479:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997166.856827:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997166.856923:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110381312 00000100:00100000:2.0:1780997166.856933:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110381312 00000100:00100000:2.0:1780997166.856990:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:2.0:1780997166.857000:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110381312:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997166.857070:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+9:2395:x1867507110381312:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 72us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997166.857077:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:3.0:1780997166.861391:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997166.861434:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997166.861514:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997166.861544:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997166.861594:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110381568 00000100:00100000:2.0:1780997166.861604:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110381568 00000100:00100000:2.0:1780997166.861673:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110381440 00000100:00100000:2.0:1780997166.861676:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110381440 00000100:00100000:2.0:1780997166.861696:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1277 00000100:00100000:2.0:1780997166.861705:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110381568:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997166.861798:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110381568:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 93us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997166.861806:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1277 00000100:00100000:2.0:1780997166.861823:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1278 00000100:00100000:2.0:1780997166.861829:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:2395:x1867507110381440:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997166.861853:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:2395:x1867507110381440:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997166.861859:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1278 00000100:00080000:2.0:1780997166.861881:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780997166.861885:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997166.868872:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110381824 00000100:00100000:1.0:1780997166.868891:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110381824 00000100:00100000:1.0:1780997166.869004:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110381696 00000100:00100000:1.0:1780997166.869009:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110381696 00000100:00100000:1.0:1780997166.869051:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2596 00000100:00100000:1.0:1780997166.869061:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110381824:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997166.869154:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2395:x1867507110381824:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 94us (7718us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997166.869162:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2596 00000100:00100000:1.0:1780997166.869196:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2597 00000100:00100000:1.0:1780997166.869202:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110381696:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997166.869228:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2395:x1867507110381696:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (7683us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997166.869234:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2597 00000100:00080000:2.0:1780997166.871787:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997166.871796:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997167.013588:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997167.013608:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126921472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997167.013680:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997167.013804:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126921472 00000100:00100000:2.0:1780997167.013810:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126921472 00000100:00100000:2.0:1780997167.013849:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994 00000100:00100000:2.0:1780997167.013857:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126921472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780997167.013889:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1780997167.013930:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126921472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997167.013937:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00000100:00100000:1.0:1780997167.014013:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997167.014024:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126921600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997167.014054:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997167.014227:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126921856:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.014293:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997167.014310:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126922368:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.014331:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997167.014363:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1780997167.014369:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aded7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126921728:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.014399:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997167.014424:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126922240:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.014445:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997167.014460:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126922752:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.014480:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997167.014505:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126921728 00000100:00100000:3.0:1780997167.014509:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126921728 00000100:00100000:3.0:1780997167.014537:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1780997167.014544:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126921728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.014579:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126921728:12345-0@lo:400:kworker.0 Request processed in 35us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997167.014584:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1780997167.014612:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126921856 00000100:00100000:3.0:1780997167.014616:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126921856 00000100:00100000:3.0:1780997167.014657:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126922368 00000100:00100000:3.0:1780997167.014660:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126922368 00000100:00100000:3.0:1780997167.014677:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126922240 00000100:00100000:3.0:1780997167.014679:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126922240 00000100:00100000:3.0:1780997167.014690:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126922752 00000100:00100000:3.0:1780997167.014692:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126922752 00000100:00100000:3.0:1780997167.014704:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1780997167.014710:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126921856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.014740:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126921856:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997167.014746:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1780997167.014757:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1780997167.014770:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126922368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.014797:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126922368:12345-0@lo:400:kworker.0 Request processed in 28us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997167.014802:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1780997167.014814:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:3.0:1780997167.014819:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126922240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.014847:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126922240:12345-0@lo:400:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997167.014853:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:3.0:1780997167.014863:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1780997167.014868:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126922752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.014893:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126922752:12345-0@lo:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997167.014899:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1780997167.014925:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126921984:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.014948:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997167.014965:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126922496:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.014987:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997167.015004:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1780997167.015009:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507126922112:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.015030:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997167.015047:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126922624:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.015070:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997167.015092:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126921984 00000100:00100000:3.0:1780997167.015095:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126921984 00000100:00100000:3.0:1780997167.015125:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126922112 00000100:00100000:3.0:1780997167.015127:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126922112 00000100:00100000:3.0:1780997167.015141:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:3.0:1780997167.015147:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126921984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.015180:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126921984:12345-0@lo:400:kworker.0 Request processed in 32us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997167.015185:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:3.0:1780997167.015197:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1780997167.015203:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507126922112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.015229:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507126922112:12345-0@lo:400:kworker.0 Request processed in 27us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997167.015235:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1780997167.015290:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507126922112:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.015303:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126921984:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.015330:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aded7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126921728:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.015338:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126922240:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.015345:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126922752:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.015353:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126921856:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.015361:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126922368:0@lo:400:kworker.0 00000100:00100000:2.0:1780997167.015506:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126921600 00000100:00100000:2.0:1780997167.015512:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126921600 00000100:00100000:2.0:1780997167.015546:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00100000:2.0:1780997167.015552:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126921600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780997167.015574:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445261312 avail 1299021824 00000100:00100000:2.0:1780997167.015620:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126921600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997167.015646:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00000100:00100000:2.0:1780997167.015671:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126922496 00000100:00100000:2.0:1780997167.015675:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126922496 00000100:00100000:2.0:1780997167.015698:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126922624 00000100:00100000:2.0:1780997167.015700:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126922624 00000100:00100000:2.0:1780997167.015715:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1780997167.015720:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126922496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997167.015752:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126922496:12345-0@lo:400:kworker.0 Request processed in 32us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997167.015758:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1780997167.015768:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:2.0:1780997167.015773:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126922624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997167.015797:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126922624:12345-0@lo:400:kworker.0 Request processed in 23us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997167.015802:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00080000:2.0:1780997167.015816:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997167.015820:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997167.015822:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997167.015824:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780997167.016026:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126922624:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.016036:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126922496:0@lo:400:kworker.0 00000100:00100000:3.0:1780997167.016052:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126921600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997167.016154:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126921472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997167.534882:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126923008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997167.534979:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997167.535042:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126922880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780997167.535071:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997167.535119:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126923008 00000100:00100000:2.0:1780997167.535128:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126923008 00000100:00100000:2.0:1780997167.535180:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126922880 00000100:00100000:2.0:1780997167.535183:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126922880 00000100:00100000:2.0:1780997167.535239:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082 00000100:00100000:2.0:1780997167.535249:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126923008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780997167.535300:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997167.535354:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126923008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997167.535362:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082 00000100:00100000:2.0:1780997167.535381:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:2.0:1780997167.535387:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126922880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780997167.535402:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997167.535431:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126922880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997167.535437:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00100000:2.0:1780997167.535484:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126923008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997167.535498:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126922880:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1780997167.846374:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1780997168.323896:0:87722:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 05:26:06 (1780997166) 00000100:00100000:1.0:1780997168.405969:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997168.409701:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110382080 00000100:00100000:2.0:1780997168.409719:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110382080 00000100:00100000:2.0:1780997168.409823:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1297 00000100:00100000:2.0:1780997168.409834:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:70215:x1867507110382080:12345-192.168.206.51@tcp:36:mkdir.0 00000100:00100000:2.0:1780997168.409970:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID:65272:1867507126923136:0@lo:900:mdt00_004.0 00000100:00100000:2.0:1780997168.410040:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997168.410074:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689ba64dd80 going to sleep for 11 seconds 00000100:00080000:3.0:1780997168.410309:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997168.410329:0:63428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126923136 00000100:00100000:3.0:1780997168.410333:0:63428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126923136 00000100:00100000:3.0:1780997168.410359:0:63428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1780997168.410367:0:63428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:65272:x1867507126923136:12345-0@lo:900:mdt00_004.0 00000100:00100000:3.0:1780997168.410424:0:63428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:65272:x1867507126923136:12345-0@lo:900:mdt00_004.0 Request processed in 58us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997168.410433:0:63428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1780997168.412531:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID:65272:1867507126923136:0@lo:900:mdt00_004.0 00000100:00100000:2.0:1780997168.412648:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126923264:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1780997168.412713:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997168.412865:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126923264 00000100:00100000:3.0:1780997168.412874:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126923264 00000100:00100000:3.0:1780997168.412925:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00100000:3.0:1780997168.412935:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:65272:x1867507126923264:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1780997168.413013:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:65272:x1867507126923264:12345-0@lo:1000:mdt00_004.0 Request processed in 80us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997168.413021:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996 00000100:00100000:2.0:1780997168.413644:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f540 going to sleep for 11 seconds 00000100:00100000:2.0:1780997168.413667:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126923264:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1780997168.413733:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126923392:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1780997168.413778:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997168.413800:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997168.413950:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126923392 00000100:00100000:3.0:1780997168.413956:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126923392 00000100:00100000:3.0:1780997168.413995:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00100000:3.0:1780997168.414003:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:65272:x1867507126923392:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1780997168.414073:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:65272:x1867507126923392:12345-0@lo:1000:mdt00_004.0 Request processed in 71us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997168.414080:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997 00000100:00100000:0.0:1780997168.414173:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126923392:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780997168.414214:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126923520:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780997168.414244:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997168.414265:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984a80cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997168.414346:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126923520 00000100:00100000:3.0:1780997168.414350:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126923520 00000100:00100000:3.0:1780997168.414372:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998 00000100:00100000:3.0:1780997168.414378:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:65272:x1867507126923520:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1780997168.414462:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:65272:x1867507126923520:12345-0@lo:1000:mdt00_004.0 Request processed in 84us (217us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780997168.414470:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998 00000100:00100000:3.0:1780997168.414507:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126923520:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1780997168.414576:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.414586:0:65272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.414596:0:65272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997168.414608:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126923648:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1780997168.414643:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997168.414657:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689845e7000 going to sleep for 11 seconds 00000100:00100000:3.0:1780997168.414668:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126923648 00000100:00100000:3.0:1780997168.414671:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126923648 00000100:00100000:3.0:1780997168.414694:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999 00000100:00100000:3.0:1780997168.414701:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:65272:x1867507126923648:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1780997168.414711:0:80061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997168.414725:0:80061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c0305aa24 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30fd811c0305aa1d expref: -99 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.414752:0:80061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305a99f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c3a expref: 8 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.414952:0:80061:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c0305aa24 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305aa1d expref: 7 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.414987:0:80061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305a99f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c3a expref: 8 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.415001:0:80061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305a99f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c3a expref: 8 pid: 63417 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997168.415013:0:80061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:80061:1867507126923776:192.168.206.51@tcp:104: 00000100:00100000:3.0:1780997168.415078:0:80061:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689845e7780 going to sleep for 11 seconds 00000100:00100000:3.0:1780997168.417728:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997168.417907:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110382208 00000100:00100000:2.0:1780997168.417915:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110382208 00010000:00010000:2.0:1780997168.417964:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305a99f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c3a expref: 9 pid: 63417 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997168.418001:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2560 00000100:00100000:2.0:1780997168.418010:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aded7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:2395:x1867507110382208:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780997168.418023:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997168.418029:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305a99f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c3a expref: 9 pid: 63417 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.418041:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305a99f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c3a expref: 9 pid: 63417 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.418064:0:25183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88e200) 00010000:00010000:2.0:1780997168.418071:0:25183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c0305aa24 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305aa1d expref: 7 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.418083:0:25183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c0305aa24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x30fd811c0305aa1d expref: 7 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.418092:0:25183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c0305aa24 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x30fd811c0305aa1d expref: 7 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.418142:0:25183:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c0305aa24 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305aa1d expref: 7 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997168.418157:0:25183:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:25183:1867507126923904:0@lo:105: 00000100:00100000:2.0:1780997168.418200:0:25183:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997168.418238:0:25183:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f480 going to sleep for 11 seconds 00000100:00080000:3.0:1780997168.418298:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780997168.420879:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126923904 00000100:00100000:2.0:1780997168.420893:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126923904 00000100:00100000:2.0:1780997168.421001:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1780997168.421013:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:25183:x1867507126923904:12345-0@lo:105: 00010000:00010000:2.0:1780997168.421029:0:6334:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.421041:0:6334:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.421050:0:6334:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.421060:0:6334:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.421068:0:6334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.421079:0:6334:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.421110:0:6334:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff968983ce3400) 00000100:00100000:2.0:1780997168.421915:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:25183:x1867507126923904:12345-0@lo:105: Request processed in 902us (3711us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997168.421925:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00010000:3.0:1780997168.422817:0:80061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305a99f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c3a expref: 9 pid: 63417 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997168.422834:0:80061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:80061:1867507126923776:192.168.206.51@tcp:104: 00010000:00010000:3.0:1780997168.422859:0:80061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c0305aa24 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305aa1d expref: 7 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.422869:0:80061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88e200) 00010000:00010000:3.0:1780997168.422871:0:80061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997168.422874:0:80061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3200, rc 0) 00000100:00100000:3.0:1780997168.422932:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:65272:x1867507126923648:12345-0@lo:101:mdt00_004.0 Request processed in 8231us (8288us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997168.422939:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999 00000100:00100000:1.0:1780997168.423583:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126923648:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1780997168.423603:0:65272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780997168.423622:0:65272:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1780997168.423676:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.423683:0:65272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.423692:0:65272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997168.423715:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924032:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1780997168.423772:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997168.423799:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888756d80 going to sleep for 11 seconds 00000100:00100000:1.0:1780997168.423826:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126924032 00000100:00100000:1.0:1780997168.423831:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126924032 00000100:00100000:1.0:1780997168.423868:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000 00000100:00100000:1.0:1780997168.423876:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:65272:x1867507126924032:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1780997168.423890:0:8242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997168.423905:0:8242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c0305aa32 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30fd811c0305aa2b expref: -99 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.423928:0:8242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c0305aa32 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305aa2b expref: 8 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.423941:0:8242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c0305aa32 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305aa2b expref: 8 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.423949:0:8242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff96898962ff00) 00010000:00010000:1.0:1780997168.423951:0:8242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997168.423954:0:8242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954200, rc 0) 00000100:00100000:1.0:1780997168.423985:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65272:x1867507126924032:12345-0@lo:101:mdt00_004.0 Request processed in 110us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997168.423991:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00000100:00100000:1.0:1780997168.424023:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924032:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1780997168.424033:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305aa32 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.424043:0:65272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305aa32 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780997168.424057:0:65272:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1780997168.424096:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924160:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997168.424124:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997168.424141:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688887563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997168.424385:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126924160 00000100:00100000:1.0:1780997168.424390:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126924160 00000100:00100000:1.0:1780997168.424414:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001 00000100:00100000:1.0:1780997168.424420:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65272:x1867507126924160:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997168.424475:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65272:x1867507126924160:12345-0@lo:1000:mdt00_004.0 Request processed in 54us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997168.424482:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00000100:00100000:1.0:1780997168.424506:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924160:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997168.424540:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924288:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997168.424635:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997168.424650:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688887563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997168.424661:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126924288 00000100:00100000:1.0:1780997168.424665:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126924288 00000100:00100000:1.0:1780997168.424685:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00100000:1.0:1780997168.424692:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65272:x1867507126924288:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997168.424844:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65272:x1867507126924288:12345-0@lo:1000:mdt00_004.0 Request processed in 151us (217us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780997168.424851:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00000100:00100000:1.0:1780997168.424879:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924288:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997168.424950:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924416:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997168.424975:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997168.424989:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688887563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997168.424999:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126924416 00000100:00100000:1.0:1780997168.425008:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126924416 00000100:00100000:1.0:1780997168.425029:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:1.0:1780997168.425035:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65272:x1867507126924416:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997168.425079:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65272:x1867507126924416:12345-0@lo:1000:mdt00_004.0 Request processed in 44us (103us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780997168.425086:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00000100:00100000:1.0:1780997168.425109:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924416:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997168.425383:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924544:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997168.425410:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997168.425437:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688887563c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997168.425568:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126924544 00000100:00100000:3.0:1780997168.425573:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126924544 00000100:00100000:3.0:1780997168.425617:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:3.0:1780997168.425635:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65272:x1867507126924544:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1780997168.425702:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65272:x1867507126924544:12345-0@lo:1000:mdt00_004.0 Request processed in 79us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997168.425709:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00000100:00100000:0.0:1780997168.425904:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924544:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780997168.425952:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924672:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780997168.425980:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997168.426012:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1780997168.426065:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126924672 00000100:00100000:1.0:1780997168.426069:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126924672 00000100:00100000:1.0:1780997168.426102:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:1.0:1780997168.426108:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65272:x1867507126924672:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997168.426292:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65272:x1867507126924672:12345-0@lo:1000:mdt00_004.0 Request processed in 161us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997168.426300:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00000100:00100000:0.0:1780997168.426369:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924672:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780997168.426411:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924800:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780997168.426434:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997168.426454:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997168.426493:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126924800 00000100:00100000:1.0:1780997168.426497:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126924800 00000100:00100000:1.0:1780997168.426524:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00100000:1.0:1780997168.426530:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65272:x1867507126924800:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997168.426701:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65272:x1867507126924800:12345-0@lo:1000:mdt00_004.0 Request processed in 170us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997168.426708:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00000100:00100000:0.0:1780997168.426781:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65272:1867507126924800:0@lo:1000:mdt00_004.0 00000040:00080000:0.0:1780997168.427508:0:65272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].3, 1000 off38072 00000040:00080000:0.0:1780997168.427583:0:65272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].2, 1152 off36272 00000004:00080000:0.0:1780997168.427591:0:65272:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff96888851ccc0 with version 12 00000004:00080000:1.0:1780997168.427740:0:72369:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff968889e33300 version 12 rpc_version 12 00000020:00100000:1.0:1780997168.427780:0:72369:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1780997168.427801:0:72369:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9688895f8e00 x1867507126925056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997168.427823:0:72369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f8e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126925056:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1780997168.427870:0:72369:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997168.427891:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888756a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997168.428024:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126925056 00000100:00100000:3.0:1780997168.428030:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126925056 00000100:00100000:3.0:1780997168.428069:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00100000:3.0:1780997168.428076:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:72369:x1867507126925056:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1780997168.429248:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:72369:x1867507126925056:12345-0@lo:1000:osp_up0-1.0 Request processed in 1168us (1373us total) trans 111669149700 rc 0/0 00000100:00100000:3.0:1780997168.429258:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00000100:00100000:1.0:1780997168.429477:0:72369:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f8e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126925056:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1780997168.429662:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4efc00/0x30fd811c0305aa39 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997168.429681:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4efc00/0x30fd811c0305aa39 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997168.429697:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4efc00/0x30fd811c0305aa39 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997168.429717:0:65272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000869d3c0e reply state 000000000a6a8f4b transno 81604378733 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4efc00/0x30fd811c0305aa39 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997168.429729:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4efc00/0x30fd811c0305aa39 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997168.429737:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898d864100) 00010000:00010000:0.0:1780997168.429740:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997168.429746:0:65272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1780997168.429753:0:65272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00000004:00080000:0.0:1780997168.429840:0:65272:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1780997168.429852:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997168.429869:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997168.429876:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997168.429901:0:65272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1780997168.429908:0:65272:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1780997168.429913:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305aa32 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997168.429919:0:65272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305aa32 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997168.430022:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:70215:x1867507110382080:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 20189us (24059us total) trans 81604378733 rc 0/0 00000100:00100000:0.0:1780997168.430031:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1297 00000100:00100000:0.0:1780997168.430522:0:25183:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:25183:1867507126923904:0@lo:105: 00010000:00010000:0.0:1780997168.430539:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997168.430580:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aded7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2395:x1867507110382208:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 12571us (12864us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997168.430588:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2560 00010000:00010000:3.0:1780997168.430984:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997168.430991:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.431000:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3400 already unused, calling callback (ffffffffc1b42ee0) 00010000:00010000:3.0:1780997168.431006:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997168.431014:0:6340:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.431049:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.431055:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1780997168.431103:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1780997168.431120:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.431137:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff968983ce3400/0x30fd811c0305aa1d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305aa24 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.431166:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997168.431168:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997168.431170:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997168.438536:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126925184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997168.438615:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997168.439817:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126925184 00000100:00100000:0.0:1780997168.439829:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126925184 00000100:00100000:0.0:1780997168.439892:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1780997168.439903:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3497:x1867507126925184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997168.439927:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997168.439952:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3200/0x30fd811c0305aa24 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305aa1d expref: 9 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997168.439968:0:6336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689ad88e200) 00010000:00010000:0.0:1780997168.439978:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997168.440039:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3497:x1867507126925184:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997168.440048:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1780997168.440161:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126925184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997168.445982:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997168.449171:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110382336 00000100:00100000:1.0:1780997168.449191:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110382336 00000100:00100000:1.0:1780997168.449267:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1298 00000100:00100000:1.0:1780997168.449299:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:70216:x1867507110382336:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780997168.449324:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997168.449350:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954e00/0x30fd811c0305aa40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c56 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.449430:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c0305aa47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.449447:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c0305aa47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.449462:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c0305aa47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997168.449513:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780997168.449518:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780997168.449557:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c0305aa47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.449584:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954e00/0x30fd811c0305aa40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c56 expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.449602:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c0305aa47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c56 expref: 9 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.449610:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898962f900) 00010000:00010000:1.0:1780997168.449613:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780997168.449616:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954600, rc 0) 00000100:00100000:1.0:1780997168.449704:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:70216:x1867507110382336:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 408us (3739us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997168.449713:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1298 00000100:00100000:2.0:1780997168.452697:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997168.452777:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110382464 00000100:00100000:3.0:1780997168.452787:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110382464 00000100:00100000:3.0:1780997168.452849:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1299 00000100:00100000:3.0:1780997168.452859:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:70216:x1867507110382464:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1780997168.452882:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997168.452905:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c0305aa4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c5d expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.452969:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305aa55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.452984:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305aa55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.452995:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305aa55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.453007:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.453017:0:80049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c0305aa32 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305aa2b expref: 7 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.453036:0:80049:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.453073:0:80049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c0305aa32 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305aa2b expref: 7 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997168.453091:0:80049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80049:1867507126925312:0@lo:104: 00000100:00100000:3.0:1780997168.453140:0:80049:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997168.453183:0:80049:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689845e7780 going to sleep for 11 seconds 00000100:00100000:0.0:1780997168.453422:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126925312 00000100:00100000:0.0:1780997168.453427:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126925312 00000100:00100000:0.0:1780997168.453461:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1780997168.453468:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:80049:x1867507126925312:12345-0@lo:104: 00010000:00010000:0.0:1780997168.453480:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x30fd811c0305aa32 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997168.453528:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1780997168.453535:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:80049:x1867507126925312:12345-0@lo:104: Request processed in 68us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997168.453542:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00010000:3.0:1780997168.453670:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997168.453676:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x30fd811c0305aa32 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.453685:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954c00 already unused, calling callback (ffffffffc1b42ee0) 00010000:00010000:3.0:1780997168.453691:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x30fd811c0305aa32 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997168.453700:0:6339:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x30fd811c0305aa32 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.453727:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305aa32 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.453734:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997168.453826:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305aa32 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.453834:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954c00/0x30fd811c0305aa2b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305aa32 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.453859:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997168.453860:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997168.453862:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997168.453976:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780997168.453989:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126925440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997168.454024:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997168.454059:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126925440 00000100:00100000:3.0:1780997168.454064:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126925440 00010000:00010000:3.0:1780997168.454080:0:6338:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c0305aa32 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x30fd811c0305aa2b expref: 8 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997168.454103:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1780997168.454110:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3496:x1867507126925440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997168.454119:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780997168.454715:0:80049:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80049:1867507126925312:0@lo:104: 00010000:00010000:3.0:1780997168.454736:0:80049:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1780997168.456518:0:87010:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149700 is committed 00010000:00010000:2.0:1780997168.456636:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954200/0x30fd811c0305aa32 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305aa2b expref: 7 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.456655:0:6338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff96898962ff00) 00010000:00010000:2.0:1780997168.456659:0:6338:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.456668:0:6338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.456675:0:6338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.456707:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997168.456790:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126925440:12345-0@lo:103:ldlm_bl.0 Request processed in 2679us (2763us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997168.456800:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1780997168.456887:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126925440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997168.456915:0:80049:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.456922:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997168.457040:0:80049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5688700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:80049:1867507126925568:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1780997168.457087:0:80049:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997168.457117:0:80049:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689845e7240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997168.457163:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126925568 00000100:00100000:2.0:1780997168.457170:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126925568 00000100:00100000:2.0:1780997168.457210:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00100000:2.0:1780997168.457219:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:80049:x1867507126925568:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1780997168.457318:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:80049:x1867507126925568:12345-0@lo:1000:mdt00_005.0 Request processed in 99us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997168.457325:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00000100:00100000:3.0:1780997168.457606:0:80049:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5688700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:80049:1867507126925568:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1780997168.457668:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c0305aa63 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457680:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c0305aa63 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457690:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c0305aa63 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997168.457716:0:80049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c0305aa63 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457728:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305aa55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457734:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305aa55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457740:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305aa55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457746:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997168.457751:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305aa55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457770:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305aa55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457781:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898962f900) 00010000:00010000:3.0:1780997168.457792:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997168.457797:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305aa55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457803:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2800/0x30fd811c0305aa55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457818:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457823:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457829:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457833:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997168.457836:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457841:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457847:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff96898962ff00) 00010000:00010000:3.0:1780997168.457850:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997168.457854:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457860:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2e00/0x30fd811c0305aa5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457899:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce3400/0x30fd811c0305aa4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c5d expref: 11 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457925:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c0305aa63 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c5d expref: 10 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.457933:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898d235d00) 00010000:00010000:3.0:1780997168.457935:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1780997168.457938:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2c00, rc 0) 00000100:00100000:3.0:1780997168.457996:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:70216:x1867507110382464:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 5139us (5307us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997168.458004:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1299 00000100:00100000:1.0:1780997168.462810:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997168.466667:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110382592 00000100:00100000:3.0:1780997168.466683:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110382592 00000100:00100000:2.0:1780997168.466833:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1300 00000100:00100000:2.0:1780997168.466844:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:70216:x1867507110382592:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780997168.466871:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997168.466891:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842400/0x30fd811c0305aa6a lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c64 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.466956:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842600/0x30fd811c0305aa71 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.466972:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842600/0x30fd811c0305aa71 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.466985:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842600/0x30fd811c0305aa71 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997168.467035:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00000004:00200000:2.0:1780997168.467039:0:63419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1780997168.467074:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842400/0x30fd811c0305aa6a lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c64 expref: 10 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.467091:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842600/0x30fd811c0305aa71 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c64 expref: 9 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.467100:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898d864100) 00010000:00010000:2.0:1780997168.467103:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1780997168.467118:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc842600, rc 0) 00000100:00100000:2.0:1780997168.467186:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:70216:x1867507110382592:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 343us (4384us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997168.467194:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1300 00000100:00100000:2.0:1780997168.472232:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997168.472467:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110382720 00000100:00100000:1.0:1780997168.472478:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110382720 00000100:00100000:1.0:1780997168.472530:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1301 00000100:00100000:1.0:1780997168.472538:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:70216:x1867507110382720:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780997168.472568:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997168.472588:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aa78 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c6b expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472659:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305aa7f lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472673:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305aa7f lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472696:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305aa7f lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472710:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955c00/0x30fd811c0305aa86 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472717:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955c00/0x30fd811c0305aa86 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472724:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955c00/0x30fd811c0305aa86 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472879:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305aa7f lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472887:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305aa7f lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472893:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305aa7f lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472900:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305aa7f lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472906:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997168.472910:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305aa7f lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472917:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305aa7f lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472930:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898d864100) 00010000:00010000:1.0:1780997168.472938:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997168.472943:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305aa7f lrc: 3/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472950:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305aa7f lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472960:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955c00/0x30fd811c0305aa86 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472966:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888955c00/0x30fd811c0305aa86 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472972:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888955c00/0x30fd811c0305aa86 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472977:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997168.472979:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955c00/0x30fd811c0305aa86 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472985:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955c00/0x30fd811c0305aa86 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.472991:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xf7117594 (ffff96898962fc00) 00010000:00010000:1.0:1780997168.472993:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997168.472995:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888955c00/0x30fd811c0305aa86 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.473000:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955c00/0x30fd811c0305aa86 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.473028:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aa78 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c6b expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.473043:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898d864100) 00010000:00010000:1.0:1780997168.473045:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997168.473049:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aa78 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c6b expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.473057:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954e00, rc 0) 00000100:00100000:1.0:1780997168.473113:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:70216:x1867507110382720:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 576us (891us total) trans 0 rc 301/301 00000100:00100000:1.0:1780997168.473120:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1301 00000100:00100000:0.0:1780997168.478245:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997168.478462:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110382848 00000100:00100000:1.0:1780997168.478474:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110382848 00000100:00100000:1.0:1780997168.478529:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1302 00000100:00100000:1.0:1780997168.478539:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:70216:x1867507110382848:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780997168.478571:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997168.478596:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955400/0x30fd811c0305aa8d lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c72 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478704:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aa94 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478722:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aa94 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478737:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aa94 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478754:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aa9b lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478780:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aa9b lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478787:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aa9b lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478831:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aa94 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478839:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aa94 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478845:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aa94 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478851:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aa94 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478857:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997168.478861:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aa94 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478868:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aa94 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478880:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898d864100) 00010000:00010000:1.0:1780997168.478895:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997168.478900:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aa94 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478907:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aa94 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478937:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aa9b lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478944:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aa9b lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478950:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aa9b lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478956:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997168.478959:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aa9b lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478966:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aa9b lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478974:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xf7117594 (ffff96898962f800) 00010000:00010000:1.0:1780997168.478976:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997168.478978:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aa9b lrc: 2/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.478983:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aa9b lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.479016:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955400/0x30fd811c0305aa8d lrc: 1/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c72 expref: 10 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.479025:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898d864100) 00010000:00010000:1.0:1780997168.479027:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997168.479038:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955400/0x30fd811c0305aa8d lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c72 expref: 10 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.479048:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955400, rc 0) 00000100:00100000:1.0:1780997168.479128:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:70216:x1867507110382848:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 590us (894us total) trans 0 rc 301/301 00000100:00100000:1.0:1780997168.479136:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1302 00000100:00100000:0.0:1780997168.482387:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997168.482575:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110382976 00000100:00100000:3.0:1780997168.482585:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110382976 00000100:00100000:3.0:1780997168.482655:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1303 00000100:00100000:3.0:1780997168.482666:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+9:70216:x1867507110382976:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1780997168.482690:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997168.482717:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3400/0x30fd811c0305aaa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c79 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.482865:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305aaa9 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.482879:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305aaa9 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.482890:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305aaa9 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997168.483098:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00000004:00200000:3.0:1780997168.483102:0:63419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780997168.483125:0:63419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305aaa9 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.483154:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3400/0x30fd811c0305aaa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c79 expref: 11 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.483177:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305aaa9 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c79 expref: 10 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.483186:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898d864100) 00010000:00010000:3.0:1780997168.483188:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1780997168.483192:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2e00, rc 0) 00000100:00100000:3.0:1780997168.483347:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:70216:x1867507110382976:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 682us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997168.483354:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1303 00000100:00100000:2.0:1780997168.502989:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997168.503141:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110383232 00000100:00100000:1.0:1780997168.503152:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110383232 00000100:00100000:1.0:1780997168.503216:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1304 00000100:00100000:1.0:1780997168.503227:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:70216:x1867507110383232:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780997168.503247:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997168.503299:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955400/0x30fd811c0305aab0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c80 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997168.503402:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1780997168.503494:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955400/0x30fd811c0305aab0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c80 expref: 12 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.503507:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898962f800) 00010000:00010000:1.0:1780997168.503510:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780997168.503515:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955400/0x30fd811c0305aab0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c80 expref: 12 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.503533:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955400, rc 0) 00000100:00100000:1.0:1780997168.503598:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:70216:x1867507110383232:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 374us (618us total) trans 81604378734 rc 301/301 00000100:00100000:1.0:1780997168.503606:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1304 00000100:00100000:2.0:1780997168.508103:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997168.508207:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110383488 00000100:00100000:1.0:1780997168.508218:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110383488 00000100:00100000:1.0:1780997168.508299:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1305 00000100:00100000:1.0:1780997168.508309:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:70216:x1867507110383488:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:1.0:1780997168.508374:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997168.508402:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305aaa9 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c79 expref: 11 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.508426:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898d864100) 00010000:00010000:1.0:1780997168.508432:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780997168.508492:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aabe lrc: 3/0,1 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.508507:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aabe lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.508519:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aabe lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.508534:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aac5 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.508542:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aac5 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.508549:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aac5 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509084:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aacc lrc: 3/0,1 mode: --/PW res: [0x240006991:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509106:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aacc lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509114:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aacc lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997168.509133:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e245fcfb reply state 0000000012e51eae transno 81604378735 ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aacc lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509144:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aacc lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509151:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898962f300) 00010000:00010000:1.0:1780997168.509154:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997168.509156:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1780997168.509162:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xd:0x0]: returning size 4096 00010000:00010000:1.0:1780997168.509170:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aabe lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509176:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aabe lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509182:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aabe lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509187:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aabe lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509194:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997168.509199:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aabe lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509218:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aabe lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509228:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898d864100) 00010000:00010000:1.0:1780997168.509231:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997168.509235:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aabe lrc: 3/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509242:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305aabe lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997168.509255:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e245fcfb reply state 0000000012e51eae transno 81604378735 ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aac5 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509262:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aac5 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.509290:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xf7117594 (ffff96898962fc00) 00010000:00010000:1.0:1780997168.509293:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997168.509295:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1780997168.509388:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:70216:x1867507110383488:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 1080us (1293us total) trans 81604378735 rc 0/0 00000100:00100000:1.0:1780997168.509397:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1305 00000100:00100000:3.0:1780997168.511969:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997168.512042:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110383744 00000100:00100000:2.0:1780997168.512052:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110383744 00000100:00100000:2.0:1780997168.512106:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:2.0:1780997168.512117:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+12:70216:x1867507110383744:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1780997168.512359:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:70216:x1867507110383744:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 244us (398us total) trans 81604378736 rc 0/0 00000100:00100000:2.0:1780997168.512368:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:1.0:1780997168.576014:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997168.576064:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997168.576094:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110384000 00000100:00100000:1.0:1780997168.576104:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110384000 00000100:00100000:1.0:1780997168.576159:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110383872 00000100:00100000:1.0:1780997168.576163:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110383872 00000100:00100000:1.0:1780997168.576188:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 681 00000100:00100000:1.0:1780997168.576207:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5bc603cc-b633-43af-a003-872c004686c8+10:2396:x1867507110384000:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780997168.576223:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997168.576257:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96888956fa00/0x30fd811c0305a77d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c1e expref: 10 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.576288:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997168.576342:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5bc603cc-b633-43af-a003-872c004686c8+9:2396:x1867507110384000:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 137us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997168.576350:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 681 00000100:00100000:1.0:1780997168.576368:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 682 00000100:00100000:1.0:1780997168.576375:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5bc603cc-b633-43af-a003-872c004686c8+8:2397:x1867507110383872:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780997168.576382:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997168.576391:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2200/0x30fd811c0305a784 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c25 expref: 8 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.576400:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997168.576417:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5bc603cc-b633-43af-a003-872c004686c8+7:2397:x1867507110383872:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 43us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997168.576424:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 682 00000100:00100000:1.0:1780997168.576465:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997168.576526:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997168.576585:0:6337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110384128 00000100:00100000:1.0:1780997168.576589:0:6337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110384128 00000100:00100000:1.0:1780997168.576617:0:6337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 683 00000100:00100000:1.0:1780997168.576635:0:6337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bc603cc-b633-43af-a003-872c004686c8+7:2397:x1867507110384128:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780997168.576644:0:6337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997168.576659:0:6337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb3400/0x30fd811c0305a78b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c2c expref: 7 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.576670:0:6337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997168.576698:0:6337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bc603cc-b633-43af-a003-872c004686c8+6:2397:x1867507110384128:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 74us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997168.576704:0:6337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 683 00000100:00100000:1.0:1780997168.576726:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110384512 00000100:00100000:1.0:1780997168.576729:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110384512 00000100:00100000:1.0:1780997168.579045:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5947 00000100:00100000:1.0:1780997168.579063:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+7:2393:x1867507110384512:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:1.0:1780997168.579098:0:9596:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a3b7 00000020:00010000:1.0:1780997168.579107:0:9596:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9688888d0800: total 0 00000100:00080000:1.0:1780997168.579112:0:9596:0:(import.c:65:import_set_state_nolock()) ffff9688888d3000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1780997168.579173:0:9596:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:1.0:1780997168.579337:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:285c134c-d3a6-4c01-bb4d-8148c50d5f95+5:2393:x1867507110384512:12345-192.168.206.51@tcp:9:umount.0 Request processed in 281us (2810us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997168.579345:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5947 00000100:00080000:1.0:1780997168.579417:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:1.0:1780997168.579431:0:37626:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9688888d0800: total 0 00010000:00010000:1.0:1780997168.579459:0:37626:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9688888d0800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1780997168.579516:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305a4f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bf4 expref: 4 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.579548:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040f23cc/0x30fd811c0305a507 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c02 expref: 3 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.579564:0:37626:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9688888d0800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1780997168.579584:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997168.579587:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997168.579588:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997168.586726:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997168.587427:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110384768 00000100:00100000:2.0:1780997168.587439:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110384768 00000100:00100000:2.0:1780997168.587512:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5948 00000100:00100000:2.0:1780997168.587524:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:285c134c-d3a6-4c01-bb4d-8148c50d5f95+6:2393:x1867507110384768:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:2.0:1780997168.587554:0:25171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a3b0 00000100:00080000:3.0:1780997168.587562:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:2.0:1780997168.587563:0:25171:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9688888d7800: total 0 00000100:00080000:2.0:1780997168.587571:0:25171:0:(import.c:65:import_set_state_nolock()) ffff9688888d6800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1780997168.587594:0:14480:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9688888d7800: total 0 00010000:00010000:3.0:1780997168.587599:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1780997168.587622:0:25171:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969454 00010000:00010000:3.0:1780997168.587666:0:14480:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9688888d7800, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1780997168.587703:0:14480:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:3.0:1780997168.587707:0:14480:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb mtime from disk: 1780997114 -> 1780997115 00002000:00010000:3.0:1780997168.587709:0:14480:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb atime from disk: 0 -> 1780997115 00002000:00010000:3.0:1780997168.587712:0:14480:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb ctime from disk: 1780997114 -> 1780997115 00002000:00010000:3.0:1780997168.587714:0:14480:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:3.0:1780997168.587755:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912e0680/0x30fd811c0305a500 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bfb expref: 4 pid: 8232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997168.587780:0:14480:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9688888d7800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1780997168.587795:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997168.587797:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997168.587798:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997168.589072:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:285c134c-d3a6-4c01-bb4d-8148c50d5f95+2:2393:x1867507110384768:12345-192.168.206.51@tcp:9:umount.0 Request processed in 1542us (2351us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997168.589084:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5948 00000100:00100000:1.0:1780997168.613591:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997168.613641:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110385280 00000100:00100000:1.0:1780997168.613651:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110385280 00000100:00100000:1.0:1780997168.613718:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1306 00000100:00100000:1.0:1780997168.613731:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+10:2393:x1867507110385280:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:1.0:1780997168.613779:0:63419:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a5fc 00000020:00010000:1.0:1780997168.613794:0:63419:0:(genops.c:1942:obd_stale_export_put()) Put export ffff968985081000: total 0 00000100:00080000:1.0:1780997168.613799:0:63419:0:(import.c:65:import_set_state_nolock()) ffff96888a013800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1780997168.613824:0:63419:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149700 00000100:00100000:1.0:1780997168.614002:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:285c134c-d3a6-4c01-bb4d-8148c50d5f95+8:2393:x1867507110385280:12345-192.168.206.51@tcp:39:umount.0 Request processed in 273us (423us total) trans 111669149701 rc 0/0 00000100:00100000:1.0:1780997168.614010:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1306 00000020:00010000:1.0:1780997168.614038:0:6340:0:(genops.c:1928:obd_stale_export_get()) Get export ffff968985081000: total 0 00010000:00010000:1.0:1780997168.614096:0:6340:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff968985081000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1780997168.614131:0:6340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689836c9800) 00010000:00010000:1.0:1780997168.614135:0:6340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997168.614143:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4efa00/0x30fd811c0305aa0f lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c4f expref: 7 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.614165:0:6340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898d235d00) 00010000:00010000:1.0:1780997168.614167:0:6340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780997168.614172:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968983ce2c00/0x30fd811c0305aa63 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c5d expref: 6 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.614194:0:6340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9689836c9800) 00010000:00010000:1.0:1780997168.614210:0:6340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1780997168.614216:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305a7e6 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8bed expref: 5 pid: 87043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.614235:0:6340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898962f900) 00010000:00010000:1.0:1780997168.614238:0:6340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780997168.614242:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954600/0x30fd811c0305aa47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c56 expref: 4 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.614258:0:6340:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff968985081000, canceled 4 locks, left on hash table 0. 00010000:00010000:1.0:1780997168.614299:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997168.614302:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997168.614304:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997168.630263:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997168.631190:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110385536 00000100:00100000:3.0:1780997168.631202:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110385536 00000100:00100000:3.0:1780997168.631326:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1307 00000100:00100000:3.0:1780997168.631337:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+13:2393:x1867507110385536:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:3.0:1780997168.631375:0:63417:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03055353 00000020:00010000:3.0:1780997168.631391:0:63417:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689869ee800: total 0 00000100:00080000:3.0:1780997168.631396:0:63417:0:(import.c:65:import_set_state_nolock()) ffff968983331000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780997168.631435:0:63417:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378736 00000100:00100000:3.0:1780997168.631606:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:285c134c-d3a6-4c01-bb4d-8148c50d5f95+11:2393:x1867507110385536:12345-192.168.206.51@tcp:39:umount.0 Request processed in 271us (1352us total) trans 81604378737 rc 0/0 00000100:00100000:3.0:1780997168.631614:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1307 00000020:00010000:1.0:1780997168.631688:0:6339:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689869ee800: total 0 00010000:00010000:1.0:1780997168.631745:0:6339:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689869ee800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1780997168.631782:0:6339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898d864100) 00010000:00010000:1.0:1780997168.631786:0:6339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1780997168.631794:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842600/0x30fd811c0305aa71 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c64 expref: 10 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.631812:0:6339:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689869ee800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1780997168.631826:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997168.631828:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997168.631829:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997168.631844:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4efc00/0x30fd811c0305aa39 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.631851:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4efc00/0x30fd811c0305aa39 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.631877:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4efc00/0x30fd811c0305aa39 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.631900:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4efc00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997168.631905:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4efc00/0x30fd811c0305aa39 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.631913:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4efc00/0x30fd811c0305aa39 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.631931:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898d864100) 00010000:00010000:1.0:1780997168.631934:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997168.631938:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4efc00/0x30fd811c0305aa39 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.631944:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4efc00/0x30fd811c0305aa39 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636612:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aac5 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636648:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aac5 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636656:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aac5 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636662:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997168.636666:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aac5 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636673:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aac5 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636689:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xf7117594 (ffff96898962fc00) 00010000:00010000:2.0:1780997168.636692:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997168.636697:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aac5 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636703:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305aac5 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636724:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aacc lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636730:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aacc lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636735:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aacc lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636740:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997168.636748:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aacc lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636755:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aacc lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636763:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898962f300) 00010000:00010000:2.0:1780997168.636765:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997168.636768:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aacc lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997168.636774:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305aacc lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997168.670171:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997168.670318:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110385792 00000100:00100000:2.0:1780997168.670329:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110385792 00000100:00100000:2.0:1780997168.670398:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:2.0:1780997168.670412:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+6:2393:x1867507110385792:12345-192.168.206.51@tcp:251:umount.0 00000020:00000080:0.0:1780997168.670542:0:87021:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a6b2 00000020:00010000:0.0:1780997168.670552:0:87021:0:(genops.c:1942:obd_stale_export_put()) Put export ffff968994767800: total 0 00000100:00080000:0.0:1780997168.670558:0:87021:0:(import.c:65:import_set_state_nolock()) ffff968994764000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1780997168.670661:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5bc603cc-b633-43af-a003-872c004686c8+3:2393:x1867507110385792:12345-192.168.206.51@tcp:251:umount.0 Request processed in 252us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997168.670669:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000020:00010000:1.0:1780997168.670944:0:37626:0:(genops.c:1928:obd_stale_export_get()) Get export ffff968994767800: total 0 00010000:00010000:1.0:1780997168.671001:0:37626:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff968994767800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1780997168.671035:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba454a00/0x30fd811c0305a792 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c33 expref: 2 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997168.671048:0:37626:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff968994767800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1780997168.671057:0:37626:0:(genops.c:906:class_export_put()) final put ffff968994767800/5bc603cc-b633-43af-a003-872c004686c8 00010000:00010000:1.0:1780997168.671077:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997168.671079:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997168.671082:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780997168.671218:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff968994767800/5bc603cc-b633-43af-a003-872c004686c8 for MGS 00000020:00000080:0.0:1780997168.671263:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968994764000 for MGS 00010000:00010000:3.0:1780997168.869536:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997169.662175:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997169.662320:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110385920 00000100:00100000:3.0:1780997169.662332:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110385920 00000100:00100000:3.0:1780997169.662382:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1780997169.662392:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2393:x1867507110385920:12345-192.168.206.51@tcp:250:mount.lustre.0 00010000:00080000:3.0:1780997169.662425:0:87017:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp t0 exp 0000000000000000 cur 3697 last 0 00000020:00000080:3.0:1780997169.662455:0:87017:0:(genops.c:1406:class_connect()) connect: client cf5d474c-5b3a-4e23-b534-5ea64925b132, cookie 0x30fd811c0305aad3 00000100:00080000:2.0:1780997169.662920:0:87017:0:(import.c:65:import_set_state_nolock()) ffff9689ba673000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997169.662996:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+4:2393:x1867507110385920:12345-192.168.206.51@tcp:250:mount.lustre.0 Request processed in 604us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997169.663005:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:2.0:1780997169.667327:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997169.667445:0:87021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110386048 00000100:00100000:0.0:1780997169.667455:0:87021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110386048 00000100:00100000:0.0:1780997169.667525:0:87021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:0.0:1780997169.667536:0:87021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+4:70239:x1867507110386048:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1780997169.667564:0:87021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997169.667584:0:87021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bb4ef400/0x30fd811c0305aada lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c95 expref: -99 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997169.667611:0:87021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bb4ef400/0x30fd811c0305aada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c95 expref: 5 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997169.667630:0:87021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bb4ef400/0x30fd811c0305aada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c95 expref: 5 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997169.667639:0:87021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ef400, rc 0) 00000100:00100000:0.0:1780997169.667837:0:87021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+5:70239:x1867507110386048:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 302us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997169.667845:0:87021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:1.0:1780997169.669523:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997169.669645:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110386176 00000100:00100000:0.0:1780997169.669653:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110386176 00000100:00100000:0.0:1780997169.669703:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:0.0:1780997169.669713:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+5:70239:x1867507110386176:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1780997169.669839:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+5:70239:x1867507110386176:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 127us (324us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780997169.669849:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:1.0:1780997169.680159:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997169.680311:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110386304 00000100:00100000:3.0:1780997169.680322:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110386304 00000100:00100000:3.0:1780997169.680399:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:3.0:1780997169.680409:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+5:70239:x1867507110386304:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1780997169.680430:0:87015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997169.680451:0:87015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce3400/0x30fd811c0305aae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8c9c expref: -99 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997169.682125:0:87015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce3400/0x30fd811c0305aae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c9c expref: 6 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997169.682310:0:87015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce3400/0x30fd811c0305aae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c9c expref: 6 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997169.682320:0:87015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3400, rc 0) 00000100:00100000:3.0:1780997169.682513:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+6:70239:x1867507110386304:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 2104us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997169.682522:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:3.0:1780997169.688986:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997169.689194:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110386432 00000100:00100000:0.0:1780997169.689205:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110386432 00000100:00100000:0.0:1780997169.689260:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:0.0:1780997169.689306:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+6:70239:x1867507110386432:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1780997169.689712:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70239:x1867507110386432:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 442us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997169.689720:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:1.0:1780997169.700037:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997169.700133:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110386560 00000100:00100000:3.0:1780997169.700145:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110386560 00000100:00100000:3.0:1780997169.700206:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:3.0:1780997169.700217:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70239:x1867507110386560:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1780997169.700420:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70239:x1867507110386560:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 204us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997169.700428:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:1.0:1780997169.702395:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997169.702727:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110386688 00000100:00100000:2.0:1780997169.702739:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110386688 00000100:00100000:2.0:1780997169.702796:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:2.0:1780997169.702805:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70257:x1867507110386688:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1780997169.702959:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70257:x1867507110386688:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 154us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997169.702976:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:2.0:1780997169.727188:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997169.727316:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110386816 00000100:00100000:3.0:1780997169.727327:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110386816 00000100:00100000:3.0:1780997169.727382:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:3.0:1780997169.727394:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70257:x1867507110386816:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1780997169.727593:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70257:x1867507110386816:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 200us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997169.727602:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:1.0:1780997169.749236:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997169.749421:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110386944 00000100:00100000:2.0:1780997169.749432:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110386944 00000100:00100000:2.0:1780997169.749492:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:2.0:1780997169.749502:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bf8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70257:x1867507110386944:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1780997169.749679:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bf8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70257:x1867507110386944:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 178us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997169.749686:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:1.0:1780997169.755360:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997169.755508:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110387072 00000100:00100000:3.0:1780997169.755522:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110387072 00000100:00100000:3.0:1780997169.755592:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:3.0:1780997169.755604:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70239:x1867507110387072:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1780997169.755633:0:87015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997169.755656:0:87015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce2800/0x30fd811c0305aae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ccd expref: -99 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997169.755698:0:87015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce2800/0x30fd811c0305aae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ccd expref: 8 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997169.755711:0:87015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce2800/0x30fd811c0305aae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ccd expref: 8 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997169.755722:0:87015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2800, rc 0) 00000100:00100000:3.0:1780997169.755793:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70239:x1867507110387072:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 191us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997169.755800:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:3.0:1780997169.762126:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997169.762370:0:87017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110387200 00000100:00100000:2.0:1780997169.762383:0:87017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110387200 00000100:00100000:2.0:1780997169.762455:0:87017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1780997169.762479:0:87017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70239:x1867507110387200:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:2.0:1780997169.762512:0:87017:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1780997169.762537:0:87017:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1780997169.762541:0:87017:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1780997169.762708:0:87017:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1780997169.762712:0:87017:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1780997169.762714:0:87017:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:2.0:1780997169.767665:0:87017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70239:x1867507110387200:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 5185us (5538us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997169.767683:0:87017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:1.0:1780997169.776367:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997169.776453:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110387328 00000100:00100000:3.0:1780997169.776464:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110387328 00000100:00100000:3.0:1780997169.776533:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:3.0:1780997169.776544:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70239:x1867507110387328:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1780997169.776570:0:87015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997169.776602:0:87015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce2000/0x30fd811c0305aaef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8cd4 expref: -99 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997169.776641:0:87015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce2000/0x30fd811c0305aaef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8cd4 expref: 9 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997169.776653:0:87015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce2000/0x30fd811c0305aaef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8cd4 expref: 9 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997169.776661:0:87015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2000, rc 0) 00000100:00100000:3.0:1780997169.776720:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70239:x1867507110387328:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 177us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997169.776728:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:3.0:1780997169.782818:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997169.782944:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110387456 00000100:00100000:0.0:1780997169.782955:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110387456 00000100:00100000:0.0:1780997169.783015:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:0.0:1780997169.783027:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888a32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70239:x1867507110387456:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1780997169.783211:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888a32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70239:x1867507110387456:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 186us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997169.783219:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:1.0:1780997169.785524:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997169.785657:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110387584 00000100:00100000:3.0:1780997169.785668:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110387584 00000100:00100000:3.0:1780997169.785727:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:3.0:1780997169.785737:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968885cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70239:x1867507110387584:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1780997169.785889:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968885cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70239:x1867507110387584:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 153us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997169.785898:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:1.0:1780997169.791988:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997169.792179:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110387712 00000100:00100000:0.0:1780997169.792189:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110387712 00000100:00100000:0.0:1780997169.792246:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:0.0:1780997169.792256:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968885cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70261:x1867507110387712:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1780997169.792435:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968885cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70261:x1867507110387712:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 180us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997169.792443:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:2.0:1780997169.797102:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997169.797201:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110387840 00000100:00100000:3.0:1780997169.797215:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110387840 00000100:00100000:3.0:1780997169.797321:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:3.0:1780997169.797331:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968885cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70261:x1867507110387840:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1780997169.797495:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968885cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70261:x1867507110387840:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 165us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997169.797516:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:1.0:1780997169.808540:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997169.808614:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997169.813590:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110387968 00000100:00100000:3.0:1780997169.813609:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110387968 00000100:00100000:0.0:1780997169.813905:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110388224 00000100:00100000:0.0:1780997169.813919:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110388224 00000100:00100000:0.0:1780997169.813957:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1308 00000100:00100000:0.0:1780997169.813967:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2393:x1867507110387968:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1780997169.814002:0:80049:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp t0 exp 0000000000000000 cur 3697 last 0 00000020:00000080:0.0:1780997169.814074:0:80049:0:(genops.c:1406:class_connect()) connect: client e4805cfa-ac6d-4d67-bb97-a6c06740fcd0, cookie 0x30fd811c0305aaf6 00000004:00100000:0.0:1780997169.814101:0:80049:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1780997169.814233:0:80049:0:(import.c:65:import_set_state_nolock()) ffff9689bb5a3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997169.814340:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110387968:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 373us (5813us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997169.814349:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1308 00000100:00100000:0.0:1780997169.814368:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1309 00000100:00100000:0.0:1780997169.814373:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc275450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2393:x1867507110388224:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1780997169.814391:0:80049:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp t0 exp 0000000000000000 cur 3697 last 0 00000020:00000080:0.0:1780997169.814426:0:80049:0:(genops.c:1406:class_connect()) connect: client e4805cfa-ac6d-4d67-bb97-a6c06740fcd0, cookie 0x30fd811c0305aafd 00000004:00100000:0.0:1780997169.814440:0:80049:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1780997169.814500:0:80049:0:(import.c:65:import_set_state_nolock()) ffff968994764000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997169.814526:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc275450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110388224:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 151us (5911us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997169.814533:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1309 00000100:00100000:1.0:1780997169.818825:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997169.818933:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110388480 00000100:00100000:2.0:1780997169.818944:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110388480 00000100:00100000:2.0:1780997169.819030:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1310 00000100:00100000:2.0:1780997169.819059:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70239:x1867507110388480:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1780997169.819114:0:63418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445257216 avail 1299017728 00000100:00100000:2.0:1780997169.819222:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70239:x1867507110388480:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 166us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997169.819230:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1310 00000100:00080000:3.0:1780997169.821400:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780997169.822383:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997169.822428:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997169.822517:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997169.822744:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110388352 00000100:00100000:2.0:1780997169.822755:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110388352 00000100:00100000:2.0:1780997169.822819:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110388096 00000100:00100000:2.0:1780997169.822823:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110388096 00000100:00100000:2.0:1780997169.822838:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110388608 00000100:00100000:2.0:1780997169.822841:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110388608 00000100:00100000:2.0:1780997169.822860:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1311 00000100:00100000:2.0:1780997169.822869:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:0:x1867507110388352:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1780997169.822918:0:65272:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:2.0:1780997169.823001:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:0:x1867507110388352:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 133us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997169.823008:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1311 00000100:00100000:2.0:1780997169.823026:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1312 00000100:00100000:2.0:1780997169.823031:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:0:x1867507110388096:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1780997169.823043:0:65272:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445257216 avail 1299017728 00000100:00100000:2.0:1780997169.823071:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:0:x1867507110388096:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 40us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997169.823078:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1312 00000100:00100000:2.0:1780997169.823090:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1313 00000100:00100000:2.0:1780997169.823096:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70239:x1867507110388608:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:2.0:1780997169.823161:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70239:x1867507110388608:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 66us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997169.823169:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1313 00000100:00080000:0.0:1780997169.823936:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997169.829568:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997169.829666:0:63428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110388992 00000100:00100000:3.0:1780997169.829677:0:63428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110388992 00000100:00100000:3.0:1780997169.829735:0:63428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1780997169.829745:0:63428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70239:x1867507110388992:12345-192.168.206.51@tcp:900:mount.lustre.0 00000100:00100000:3.0:1780997169.829841:0:63428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70239:x1867507110388992:12345-192.168.206.51@tcp:900:mount.lustre.0 Request processed in 97us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997169.829849:0:63428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1780997169.830361:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997169.830441:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997169.830466:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110388736 00000100:00100000:1.0:1780997169.830471:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110388736 00000100:00100000:1.0:1780997169.830493:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110388864 00000100:00100000:1.0:1780997169.830495:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110388864 00000100:00100000:1.0:1780997169.830510:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5949 00000100:00100000:1.0:1780997169.830516:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2393:x1867507110388736:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1780997169.830541:0:25178:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp t0 exp 0000000000000000 cur 3697 last 0 00000020:00000080:1.0:1780997169.830584:0:25178:0:(genops.c:1406:class_connect()) connect: client e4805cfa-ac6d-4d67-bb97-a6c06740fcd0, cookie 0x30fd811c0305ab04 00002000:00100000:1.0:1780997169.830596:0:25178:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e4805cfa-ac6d-4d67-bb97-a6c06740fcd0/ffff9689a67f1800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1780997169.830614:0:25178:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1780997169.830715:0:25178:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1780997169.830746:0:25178:0:(import.c:65:import_set_state_nolock()) ffff9689a67f5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997169.830788:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110388736:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 271us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997169.830812:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5949 00000100:00100000:1.0:1780997169.830827:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5950 00000100:00100000:1.0:1780997169.830831:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2393:x1867507110388864:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1780997169.830847:0:25178:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp t0 exp 0000000000000000 cur 3697 last 0 00000020:00000080:1.0:1780997169.830865:0:25178:0:(genops.c:1406:class_connect()) connect: client e4805cfa-ac6d-4d67-bb97-a6c06740fcd0, cookie 0x30fd811c0305ab0b 00002000:00100000:1.0:1780997169.830870:0:25178:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e4805cfa-ac6d-4d67-bb97-a6c06740fcd0/ffff96888964e800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1780997169.830881:0:25178:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1780997169.830934:0:25178:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1780997169.830950:0:25178:0:(import.c:65:import_set_state_nolock()) ffff9689868b9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997169.830975:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110388864:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 142us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997169.830982:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5950 00000100:00100000:1.0:1780997169.837159:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997169.837328:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110389120 00000100:00100000:2.0:1780997169.837340:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110389120 00000100:00100000:2.0:1780997169.837405:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 230 00000100:00100000:2.0:1780997169.837418:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70239:x1867507110389120:12345-192.168.206.51@tcp:33:mount.lustre.0 00000004:00200000:2.0:1780997169.837508:0:63420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1780997169.837595:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70239:x1867507110389120:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 180us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997169.837603:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 230 00010000:00010000:1.0:1780997169.893688:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997170.917432:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997171.621733:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997171.621758:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126925696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997171.622070:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997171.622084:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126925824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997171.623486:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997171.623595:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126925824 00000100:00100000:3.0:1780997171.623604:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126925824 00000100:00100000:3.0:1780997171.623721:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:3.0:1780997171.623732:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126925824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997171.623765:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997171.623830:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126925824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997171.623839:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00100000:2.0:1780997171.623964:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997171.624047:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126925696 00000100:00100000:1.0:1780997171.624052:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126925696 00000100:00080000:0.0:1780997171.624251:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780997171.624256:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997171.624329:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126925824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997171.624484:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:1.0:1780997171.624492:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126925696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780997171.624512:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780997171.624562:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126925696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997171.624584:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00100000:3.0:1780997171.624665:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126925696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780997171.830949:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997171.831310:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110389248 00000100:00100000:0.0:1780997171.831326:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110389248 00000100:00100000:0.0:1780997171.831869:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1314 00000100:00100000:0.0:1780997171.831909:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70304:x1867507110389248:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1780997171.831936:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997171.831964:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee800/0x30fd811c0305ab12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d05 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997171.832041:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305ab19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997171.832058:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305ab19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997171.832072:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305ab19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997171.832142:0:65272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780997171.832146:0:65272:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997171.832168:0:65272:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305ab19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997171.832192:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee800/0x30fd811c0305ab12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d05 expref: 8 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997171.832211:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305ab19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d05 expref: 7 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997171.832220:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864000) 00010000:00010000:0.0:1780997171.832223:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780997171.832226:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ef000, rc 0) 00000100:00100000:0.0:1780997171.832350:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:70304:x1867507110389248:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 445us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997171.832376:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1314 00000100:00080000:3.0:1780997171.839330:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997171.839534:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997171.840005:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110389376 00000100:00100000:2.0:1780997171.840026:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110389376 00000100:00100000:2.0:1780997171.840127:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1315 00000100:00100000:2.0:1780997171.840141:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:70304:x1867507110389376:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:2.0:1780997171.840207:0:63584:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445257216 avail 1299017728 00000100:00100000:2.0:1780997171.840355:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:70304:x1867507110389376:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 217us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997171.840365:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1315 00000100:00100000:1.0:1780997171.844371:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997171.844480:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110389504 00000100:00100000:3.0:1780997171.844498:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110389504 00000100:00100000:3.0:1780997171.844614:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1316 00000100:00100000:3.0:1780997171.844629:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70304:x1867507110389504:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:3.0:1780997171.844714:0:63417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:3.0:1780997171.844811:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70304:x1867507110389504:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 186us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997171.844834:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1316 00000100:00080000:0.0:1780997171.845505:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997171.858879:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997171.859063:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110389632 00000100:00100000:2.0:1780997171.859077:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110389632 00000100:00100000:2.0:1780997171.859183:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2086 00000100:00100000:2.0:1780997171.859198:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70304:x1867507110389632:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1780997171.859260:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997171.859580:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70304:x1867507110389632:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 383us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997171.859590:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2086 00000100:00080000:0.0:1780997171.860074:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997171.870660:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997171.871340:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110389760 00000100:00100000:1.0:1780997171.871356:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110389760 00000100:00100000:1.0:1780997171.871464:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2087 00000100:00100000:1.0:1780997171.871476:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70304:x1867507110389760:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:1.0:1780997171.871509:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997171.871617:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70304:x1867507110389760:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 143us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997171.871626:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2087 00000100:00080000:0.0:1780997171.872319:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1780997171.941516:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997172.134594:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997172.134634:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126925952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997172.134738:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997172.134834:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126925952 00000100:00100000:0.0:1780997172.134844:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126925952 00000100:00100000:0.0:1780997172.134908:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00100000:0.0:1780997172.134919:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126925952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780997172.134955:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:0.0:1780997172.135005:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126925952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997172.135012:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00000100:00100000:2.0:1780997172.135156:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126925952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997172.137988:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997172.138009:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126926080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997172.138085:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997172.138150:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126926080 00000100:00100000:2.0:1780997172.138158:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126926080 00000100:00100000:2.0:1780997172.138205:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00100000:2.0:1780997172.138214:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126926080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780997172.138246:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445257216 avail 1299017728 00000100:00100000:2.0:1780997172.138320:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126926080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997172.138327:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00000100:00100000:2.0:1780997172.138368:0:3496:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149700 gen 3 00000004:00080000:2.0:1780997172.138374:0:3496:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 111669149700 committed transno 111669149700 00000100:00100000:2.0:1780997172.138405:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126926080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997172.138740:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126926208:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.138785:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997172.138816:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126926720:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.138842:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997172.138858:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126927232:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.138877:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997172.138897:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1780997172.138904:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126926336:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.138925:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997172.138940:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126926848:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.138959:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997172.138986:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126926720 00000100:00100000:1.0:1780997172.138991:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126926720 00000100:00100000:1.0:1780997172.139046:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126927232 00000100:00100000:1.0:1780997172.139050:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126927232 00000100:00100000:1.0:1780997172.139067:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126926336 00000100:00100000:1.0:1780997172.139069:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126926336 00000100:00100000:1.0:1780997172.139079:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126926848 00000100:00100000:1.0:1780997172.139081:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126926848 00000100:00100000:1.0:1780997172.139092:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:1.0:1780997172.139111:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126926720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139149:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126926720:12345-0@lo:400:kworker.0 Request processed in 51us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997172.139155:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:1.0:1780997172.139168:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1780997172.139173:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126927232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139194:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126927232:12345-0@lo:400:kworker.0 Request processed in 21us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997172.139198:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1780997172.139208:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1780997172.139212:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507126926336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139231:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507126926336:12345-0@lo:400:kworker.0 Request processed in 19us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997172.139235:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1780997172.139243:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:1.0:1780997172.139247:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126926848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139265:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126926848:12345-0@lo:400:kworker.0 Request processed in 18us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997172.139292:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00080000:1.0:1780997172.139309:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780997172.139319:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997172.139344:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126926336:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139352:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126926848:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139359:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126926720:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139366:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126927232:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139388:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126926592:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139410:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997172.139424:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126927104:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139443:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997172.139457:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1780997172.139462:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126926464:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139480:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997172.139492:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126926976:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139508:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997172.139528:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126927104 00000100:00100000:1.0:1780997172.139532:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126927104 00000100:00100000:1.0:1780997172.139562:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126926976 00000100:00100000:1.0:1780997172.139565:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126926976 00000100:00100000:1.0:1780997172.139583:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:1.0:1780997172.139589:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126927104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139636:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126927104:12345-0@lo:400:kworker.0 Request processed in 47us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997172.139642:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:1.0:1780997172.139654:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1780997172.139659:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126926976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139696:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126926976:12345-0@lo:400:kworker.0 Request processed in 37us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997172.139702:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1780997172.139722:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126926592 00000100:00100000:1.0:1780997172.139725:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126926592 00000100:00100000:1.0:1780997172.139748:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126926464 00000100:00100000:1.0:1780997172.139750:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126926464 00000100:00100000:1.0:1780997172.139767:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:1.0:1780997172.139774:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126926592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139802:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126926592:12345-0@lo:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997172.139808:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:1.0:1780997172.139818:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:1.0:1780997172.139824:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126926464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139850:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126926464:12345-0@lo:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997172.139856:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00080000:1.0:1780997172.139871:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997172.139873:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780997172.139876:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997172.139877:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997172.139895:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126926464:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139905:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126926976:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139913:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126926592:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.139921:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126927104:0@lo:400:kworker.0 00000100:00100000:0.0:1780997172.140075:0:87016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126926208 00000100:00100000:0.0:1780997172.140080:0:87016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126926208 00000100:00100000:0.0:1780997172.140129:0:87016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1780997172.140137:0:87016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968885cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126926208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997172.140173:0:87016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968885cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126926208:12345-0@lo:400:kworker.0 Request processed in 38us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997172.140179:0:87016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1780997172.140394:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126926208:0@lo:400:kworker.0 00000100:00100000:1.0:1780997172.646482:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997172.646508:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126927360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997172.646584:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997172.646626:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126927488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997172.646645:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126927360 00000100:00100000:1.0:1780997172.646653:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126927360 00000100:00100000:2.0:1780997172.646656:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997172.646689:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126927488 00000100:00100000:1.0:1780997172.646702:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:2.0:1780997172.646703:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126927488 00000100:00100000:1.0:1780997172.646710:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688884a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126927360:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997172.646725:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:2.0:1780997172.646729:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126927488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780997172.646733:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1780997172.646738:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997172.646774:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126927488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997172.646775:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688884a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126927360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997172.646782:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:1.0:1780997172.646790:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00100000:2.0:1780997172.646825:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126927488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997172.646830:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126927360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997172.772471:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997172.773663:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110389888 00000100:00100000:2.0:1780997172.773676:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110389888 00000100:00100000:2.0:1780997172.773743:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1317 00000100:00100000:2.0:1780997172.773755:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:70338:x1867507110389888:12345-192.168.206.51@tcp:101:cp.0 00010000:00010000:2.0:1780997172.773780:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997172.773803:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843600/0x30fd811c0305ab20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d0c expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.773871:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842200/0x30fd811c0305ab27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.773886:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842200/0x30fd811c0305ab27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.773901:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842200/0x30fd811c0305ab27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.773917:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c0305ab2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.773925:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c0305ab2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.773944:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c0305ab2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774013:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843400/0x30fd811c0305ab35 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774022:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843400/0x30fd811c0305ab35 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774028:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843400/0x30fd811c0305ab35 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997172.774069:0:80049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843400/0x30fd811c0305ab35 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774082:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842200/0x30fd811c0305ab27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774089:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842200/0x30fd811c0305ab27 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774096:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842200/0x30fd811c0305ab27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774103:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997172.774107:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842200/0x30fd811c0305ab27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774115:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842200/0x30fd811c0305ab27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774129:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864000) 00010000:00010000:2.0:1780997172.774138:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997172.774145:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842200/0x30fd811c0305ab27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774150:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc842200/0x30fd811c0305ab27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774165:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c0305ab2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774171:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c0305ab2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774178:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c0305ab2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774183:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc843c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997172.774185:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c0305ab2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774191:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c0305ab2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774200:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9689964dc800) 00010000:00010000:2.0:1780997172.774202:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997172.774206:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c0305ab2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774212:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843c00/0x30fd811c0305ab2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774245:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843600/0x30fd811c0305ab20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d0c expref: 9 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774310:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843400/0x30fd811c0305ab35 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d0c expref: 8 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.774319:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9689964dc600) 00010000:00010000:2.0:1780997172.774322:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780997172.774325:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc843400, rc 0) 00000100:00100000:2.0:1780997172.774398:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:70338:x1867507110389888:12345-192.168.206.51@tcp:101:cp.0 Request processed in 646us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997172.774406:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1317 00000100:00100000:3.0:1780997172.782914:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997172.782984:0:63428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110390016 00000100:00100000:1.0:1780997172.782996:0:63428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110390016 00000100:00100000:1.0:1780997172.783064:0:63428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1780997172.783074:0:63428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad903050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70338:x1867507110390016:12345-192.168.206.51@tcp:900:cp.0 00000100:00100000:1.0:1780997172.783177:0:63428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad903050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70338:x1867507110390016:12345-192.168.206.51@tcp:900:cp.0 Request processed in 104us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997172.783187:0:63428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1780997172.795728:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997172.795830:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110390144 00000100:00100000:1.0:1780997172.795842:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110390144 00000100:00100000:1.0:1780997172.795914:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1318 00000100:00100000:1.0:1780997172.795926:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:70338:x1867507110390144:12345-192.168.206.51@tcp:101:cp.0 00010000:00010000:1.0:1780997172.795958:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997172.795997:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305ab3c lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d13 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.796070:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305ab43 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.796085:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305ab43 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.796099:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305ab43 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997172.796145:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00000004:00200000:1.0:1780997172.796149:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1780997172.796204:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305ab3c lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d13 expref: 8 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.796220:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305ab43 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d13 expref: 7 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.796229:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898962f900) 00010000:00010000:1.0:1780997172.796231:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1780997172.796235:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955e00, rc 0) 00000100:00100000:1.0:1780997172.796328:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:70338:x1867507110390144:12345-192.168.206.51@tcp:101:cp.0 Request processed in 405us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997172.796336:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1318 00000100:00100000:2.0:1780997172.799632:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997172.799986:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110390272 00000100:00100000:3.0:1780997172.799997:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110390272 00000100:00100000:3.0:1780997172.800058:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1319 00000100:00100000:3.0:1780997172.800070:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:70338:x1867507110390272:12345-192.168.206.51@tcp:101:cp.0 00010000:00010000:3.0:1780997172.800091:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997172.800113:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3000/0x30fd811c0305ab4a lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d1a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800179:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2400/0x30fd811c0305ab51 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800194:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2400/0x30fd811c0305ab51 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800206:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2400/0x30fd811c0305ab51 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800222:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3800/0x30fd811c0305ab58 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800229:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3800/0x30fd811c0305ab58 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800248:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3800/0x30fd811c0305ab58 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800351:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3600/0x30fd811c0305ab5f lrc: 3/1,0 mode: --/PR res: [0x240006991:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800361:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3600/0x30fd811c0305ab5f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800369:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3600/0x30fd811c0305ab5f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997172.800410:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xd:0x0]: returning size 4096 00000004:00200000:3.0:1780997172.800414:0:63418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780997172.800438:0:63418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3600/0x30fd811c0305ab5f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800451:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2400/0x30fd811c0305ab51 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800458:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2400/0x30fd811c0305ab51 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800463:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2400/0x30fd811c0305ab51 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800470:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2400/0x30fd811c0305ab51 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800475:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997172.800479:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2400/0x30fd811c0305ab51 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800493:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2400/0x30fd811c0305ab51 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800506:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898962f900) 00010000:00010000:3.0:1780997172.800509:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997172.800514:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2400/0x30fd811c0305ab51 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800652:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2400/0x30fd811c0305ab51 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800669:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3800/0x30fd811c0305ab58 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800675:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3800/0x30fd811c0305ab58 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800681:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3800/0x30fd811c0305ab58 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800686:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997172.800690:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3800/0x30fd811c0305ab58 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800696:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3800/0x30fd811c0305ab58 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800704:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xf7117594 (ffff96898d235100) 00010000:00010000:3.0:1780997172.800707:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997172.800710:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3800/0x30fd811c0305ab58 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800725:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3800/0x30fd811c0305ab58 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800759:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3000/0x30fd811c0305ab4a lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d1a expref: 9 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800774:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3600/0x30fd811c0305ab5f lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d1a expref: 8 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997172.800781:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898d235900) 00010000:00010000:3.0:1780997172.800784:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1780997172.800786:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3600, rc 0) 00000100:00100000:3.0:1780997172.800859:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:70338:x1867507110390272:12345-192.168.206.51@tcp:101:cp.0 Request processed in 791us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997172.800867:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1319 00000100:00100000:3.0:1780997172.805352:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997172.805610:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110390400 00000100:00100000:2.0:1780997172.805622:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110390400 00000100:00100000:2.0:1780997172.805688:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1320 00000100:00100000:2.0:1780997172.805699:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:70338:x1867507110390400:12345-192.168.206.51@tcp:101:cp.0 00010000:00010000:2.0:1780997172.805719:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997172.805744:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc843c00/0x30fd811c0305ab66 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d21 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.805817:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842200/0x30fd811c0305ab6d lrc: 3/1,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.805832:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842200/0x30fd811c0305ab6d lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.805844:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842200/0x30fd811c0305ab6d lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.805872:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842e00/0x30fd811c0305ab74 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.805881:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842e00/0x30fd811c0305ab74 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.805888:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842e00/0x30fd811c0305ab74 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.805938:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842200/0x30fd811c0305ab6d lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.805946:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842200/0x30fd811c0305ab6d lrc: 2/0,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.805952:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842200/0x30fd811c0305ab6d lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.805958:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997172.805962:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842200/0x30fd811c0305ab6d lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.805970:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842200/0x30fd811c0305ab6d lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.805980:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898d235900) 00010000:00010000:2.0:1780997172.805983:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997172.805987:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842200/0x30fd811c0305ab6d lrc: 2/0,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.805993:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842200/0x30fd811c0305ab6d lrc: 0/0,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.806012:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842e00/0x30fd811c0305ab74 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.806018:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842e00/0x30fd811c0305ab74 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.806023:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842e00/0x30fd811c0305ab74 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.806028:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997172.806031:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842e00/0x30fd811c0305ab74 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.806036:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842e00/0x30fd811c0305ab74 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.806044:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0xb1bed465 (ffff9689964dc800) 00010000:00010000:2.0:1780997172.806047:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997172.806050:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842e00/0x30fd811c0305ab74 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.806055:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc842e00/0x30fd811c0305ab74 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.806088:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc843c00/0x30fd811c0305ab66 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d21 expref: 9 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.806098:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898d235900) 00010000:00010000:2.0:1780997172.806100:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997172.806110:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc843c00/0x30fd811c0305ab66 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d21 expref: 9 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997172.806119:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc843c00, rc 0) 00000100:00100000:2.0:1780997172.806190:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:70338:x1867507110390400:12345-192.168.206.51@tcp:101:cp.0 Request processed in 492us (851us total) trans 0 rc 301/301 00000100:00100000:2.0:1780997172.806197:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1320 00000100:00100000:2.0:1780997172.810894:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997172.811128:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110390528 00000100:00100000:1.0:1780997172.811142:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110390528 00000100:00100000:1.0:1780997172.811218:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1321 00000100:00100000:1.0:1780997172.811228:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:70338:x1867507110390528:12345-192.168.206.51@tcp:101:cp.0 00010000:00010000:1.0:1780997172.811251:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997172.811300:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305ab7b lrc: 2/0,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d28 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.811375:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305ab82 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813403:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305ab82 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813431:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305ab82 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813668:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954600/0x30fd811c0305ab89 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813683:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954600/0x30fd811c0305ab89 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813692:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888954600/0x30fd811c0305ab89 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813746:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305ab82 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813755:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305ab82 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813762:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305ab82 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813785:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305ab82 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813792:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997172.813797:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305ab82 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813805:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305ab82 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813817:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898d235900) 00010000:00010000:1.0:1780997172.813820:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997172.813826:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305ab82 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813833:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305ab82 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813847:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954600/0x30fd811c0305ab89 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813852:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888954600/0x30fd811c0305ab89 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813859:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888954600/0x30fd811c0305ab89 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813864:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997172.813867:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888954600/0x30fd811c0305ab89 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813883:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888954600/0x30fd811c0305ab89 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813891:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0xb1bed465 (ffff96898962f800) 00010000:00010000:1.0:1780997172.813894:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997172.813897:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888954600/0x30fd811c0305ab89 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813903:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888954600/0x30fd811c0305ab89 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813949:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305ab7b lrc: 1/0,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d28 expref: 9 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813959:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898d235900) 00010000:00010000:1.0:1780997172.813962:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997172.813965:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305ab7b lrc: 0/0,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d28 expref: 9 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997172.813977:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955800, rc 0) 00000100:00100000:1.0:1780997172.814066:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:70338:x1867507110390528:12345-192.168.206.51@tcp:101:cp.0 Request processed in 2838us (3192us total) trans 0 rc 301/301 00000100:00100000:1.0:1780997172.814075:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1321 00000100:00100000:0.0:1780997172.819686:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997172.819761:0:63426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110390656 00000100:00100000:1.0:1780997172.819771:0:63426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110390656 00000100:00100000:1.0:1780997172.819822:0:63426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1780997172.819834:0:63426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:70338:x1867507110390656:12345-192.168.206.51@tcp:700:cp.0 00000020:02000000:1.0:1780997172.819858:0:63426:0:(tgt_handler.c:881:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00100000:1.0:1780997172.828810:0:63426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:70338:x1867507110390656:12345-192.168.206.51@tcp:700:cp.0 Request processed in 8957us (9113us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997172.828828:0:63426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00010000:00010000:3.0:1780997172.970648:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997173.990643:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1780997174.183445:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000001:00100000:2.0:1780997174.183465:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:2.0:1780997174.183470:0:8226:0:(genops.c:906:class_export_put()) final put ffff9688888d7800/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:1.0:1780997174.185493:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9688888d7800/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-OST0000 00000020:00000080:1.0:1780997174.185587:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9688888d6800 for lustre-OST0000 00000001:00100000:1.0:1780997174.193839:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000001:00100000:1.0:1780997174.193859:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:1.0:1780997174.193864:0:9294:0:(genops.c:906:class_export_put()) final put ffff9688888d0800/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:2.0:1780997174.193956:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9688888d0800/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-OST0001 00000020:00000080:2.0:1780997174.194029:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9688888d3000 for lustre-OST0001 00000001:00100000:3.0:1780997174.196324:0:87010:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000001:00100000:3.0:1780997174.196342:0:87010:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000001:00080000:3.0:1780997174.196352:0:87010:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149701 is committed 00000020:00000080:3.0:1780997174.196359:0:87010:0:(genops.c:906:class_export_put()) final put ffff968985081000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00000080:2.0:1780997174.196683:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff968985081000/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-MDT0000 00000020:00000080:2.0:1780997174.196754:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888a013800 for lustre-MDT0000 00000001:00100000:1.0:1780997174.208129:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000001:00100000:1.0:1780997174.208150:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000001:00080000:1.0:1780997174.208165:0:72364:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378737 is committed 00000020:00000080:1.0:1780997174.208188:0:72364:0:(genops.c:906:class_export_put()) final put ffff9689869ee800/285c134c-d3a6-4c01-bb4d-8148c50d5f95 00000020:00080000:1.0:1780997174.208219:0:72364:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff96888851c600 refcount 2 committed 0 result 0 batchid 77309411387 00000020:00080000:1.0:1780997174.208225:0:72364:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9689898d7a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff96888851ccc0 00000020:00080000:1.0:1780997174.208230:0:72364:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].2 00000020:00080000:1.0:1780997174.208233:0:72364:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9689898d7100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9688893ba400 00000020:00080000:1.0:1780997174.208236:0:72364:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].3 00000020:00080000:2.0:1780997174.208314:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411387 committed batchid 77309411386 00000020:00080000:2.0:1780997174.208420:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000020:00000080:3.0:1780997174.208492:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689869ee800/285c134c-d3a6-4c01-bb4d-8148c50d5f95 for lustre-MDT0001 00000020:00000080:3.0:1780997174.208583:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968983331000 for lustre-MDT0001 00010000:00010000:1.0:1780997175.014050:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997175.046499:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997175.046567:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997175.046651:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997175.046700:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997175.046738:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997175.046786:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110391168 00000100:00100000:3.0:1780997175.046801:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110391168 00000100:00100000:3.0:1780997175.046879:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110391296 00000100:00100000:3.0:1780997175.046882:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110391296 00000100:00100000:3.0:1780997175.046911:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2602 00000100:00100000:3.0:1780997175.046924:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110391168:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997175.047019:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110391168:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 99us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997175.047027:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2602 00000100:00100000:3.0:1780997175.047049:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2603 00000100:00100000:3.0:1780997175.047055:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110391296:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997175.047079:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110391296:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997175.047085:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2603 00000100:00100000:3.0:1780997175.047103:0:87015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110390784 00000100:00100000:3.0:1780997175.047107:0:87015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110390784 00000100:00100000:3.0:1780997175.047139:0:87015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:3.0:1780997175.047145:0:87015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb1f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110390784:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997175.047175:0:87015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb1f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110390784:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997175.047182:0:87015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:3.0:1780997175.047219:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110390912 00000100:00100000:3.0:1780997175.047223:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110390912 00000100:00100000:3.0:1780997175.047266:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110391040 00000100:00100000:3.0:1780997175.047320:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110391040 00000100:00100000:3.0:1780997175.047347:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1291 00000100:00100000:3.0:1780997175.047354:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110390912:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997175.047386:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110390912:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997175.047393:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1291 00000100:00100000:3.0:1780997175.047408:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1292 00000100:00100000:3.0:1780997175.047420:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110391040:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997175.047450:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110391040:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997175.047458:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1292 00000100:00080000:3.0:1780997175.047485:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997175.047489:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780997175.047493:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997175.047497:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:2.0:1780997175.606367:0:87916:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1780997175.606432:0:87916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.606447:0:87916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.606454:0:87916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.606462:0:87916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.606503:0:87916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1780997175.606509:0:87916:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1780997175.606535:0:87916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1780997175.606540:0:87916:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1780997175.606546:0:87916:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1780997175.606571:0:87916:0:(import.c:65:import_set_state_nolock()) ffff968983330800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1780997175.609695:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126927616:0@lo:39:umount.0 00000100:00100000:0.0:1780997175.609783:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780997175.610047:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997175.610058:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.610069:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455a00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997175.610073:0:37626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.610096:0:37626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997175.610103:0:37626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997175.610109:0:37626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1780997175.610111:0:37626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1780997175.610114:0:37626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1780997175.610156:0:37626:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.610163:0:37626:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997175.610186:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.610193:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba455a00/0x30fd811c0305a68f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a696 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.610205:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997175.610207:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997175.610209:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997175.610220:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126927744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997175.610258:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997175.610327:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126927744 00000100:00100000:1.0:1780997175.610335:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126927744 00000100:00100000:1.0:1780997175.610395:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1780997175.610405:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b6209c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507126927744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997175.610418:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997175.610438:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96888956f200/0x30fd811c0305a696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a68f expref: 23 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.610451:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997175.610487:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b6209c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3497:x1867507126927744:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997175.610494:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1780997175.610562:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126927744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997175.611519:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126927616 00000100:00100000:2.0:1780997175.611530:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126927616 00000100:00100000:2.0:1780997175.611593:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1780997175.611603:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1867507126927616:12345-0@lo:39:umount.0 00000020:00000080:2.0:1780997175.611632:0:65272:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a7ae 00000100:00080000:2.0:1780997175.611642:0:65272:0:(import.c:65:import_set_state_nolock()) ffff9689bc96b800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1780997175.611718:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3495:x1867507126927616:12345-0@lo:39:umount.0 Request processed in 118us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997175.611725:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000020:00000080:2.0:1780997175.611733:0:65272:0:(genops.c:906:class_export_put()) final put ffff9689bc96c000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1780997175.612218:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968983330800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1780997175.612241:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126927616:0@lo:39:umount.0 00000020:00000080:0.0:1780997175.612294:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1780997175.612374:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bc96b800 for lustre-MDT0000 00000100:00080000:2.0:1780997175.612609:0:87916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1780997175.612614:0:87916:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1780997175.612620:0:87916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1780997175.613549:0:87916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613564:0:87916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613571:0:87916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613607:0:87916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613622:0:87916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997175.613628:0:87916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613633:0:87916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613638:0:87916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613644:0:87916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613652:0:87916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780997175.613656:0:87916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613662:0:87916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613667:0:87916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613673:0:87916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613695:0:87916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1780997175.613700:0:87916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613706:0:87916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613712:0:87916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613717:0:87916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997175.613724:0:87916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1780997175.613727:0:87916:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1780997175.613756:0:87916:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1780997175.613760:0:87916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1780997175.613765:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1780997175.613770:0:87916:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1780997175.614650:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1780997175.614662:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614674:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2a00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997175.614678:0:6339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614689:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997175.614696:0:6339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997175.614702:0:6339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1780997175.614704:0:6339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1780997175.614706:0:6339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1780997175.614759:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614766:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997175.614796:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614814:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2a00/0x30fd811c0305a5af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a5b6 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614829:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780997175.614833:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614838:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956fe00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997175.614841:0:6339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614848:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997175.614854:0:6339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997175.614859:0:6339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1780997175.614861:0:6339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1780997175.614863:0:6339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1780997175.614875:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614881:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997175.614887:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614893:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96888956fe00/0x30fd811c0305a6b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a6c0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614915:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997175.614918:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614923:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03000 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997175.614925:0:6339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614931:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997175.614937:0:6339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997175.614942:0:6339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1780997175.614943:0:6339:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1780997175.614946:0:6339:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1780997175.614960:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614965:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997175.614981:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614989:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305a681 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a688 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.614997:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997175.615000:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.615010:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02a00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997175.615013:0:6339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.615020:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997175.615026:0:6339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997175.615030:0:6339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1780997175.615032:0:6339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1780997175.615034:0:6339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1780997175.615049:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.615056:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997175.615062:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.615067:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305a5a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305a5a8 expref: -99 pid: 87009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.615075:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997175.615077:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997175.615079:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997175.615102:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126927872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997175.615170:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997175.615213:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997175.615227:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126928000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997175.615250:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997175.615310:0:6337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126927872 00000100:00100000:1.0:1780997175.615318:0:6337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126927872 00000100:00100000:1.0:1780997175.615368:0:6337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126928000 00000100:00100000:1.0:1780997175.615371:0:6337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126928000 00000100:00100000:1.0:1780997175.615395:0:6337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1780997175.615403:0:6337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126927872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997175.615417:0:6337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997175.615432:0:6337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb3600/0x30fd811c0305a5b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a5af expref: 23 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.615443:0:6337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997175.615479:0:6337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3498:x1867507126927872:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997175.615487:0:6337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1780997175.615504:0:6337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1780997175.615510:0:6337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3498:x1867507126928000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997175.615518:0:6337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997175.615525:0:6337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba454800/0x30fd811c0305a6c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a6b9 expref: 21 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.615534:0:6337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997175.615553:0:6337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3498:x1867507126928000:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997175.615559:0:6337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1780997175.615599:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126928128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997175.615622:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997175.615647:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997175.615652:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126928256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997175.615672:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997175.615693:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126928128 00000100:00100000:1.0:1780997175.615696:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126928128 00000100:00100000:1.0:1780997175.615716:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126928256 00000100:00100000:1.0:1780997175.615718:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126928256 00000100:00100000:1.0:1780997175.615732:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1780997175.615738:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3496:x1867507126928128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997175.615745:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997175.615753:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2c00/0x30fd811c0305a688 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a681 expref: 21 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.615761:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997175.615783:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3496:x1867507126928128:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997175.615789:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1780997175.615800:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1780997175.615805:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3496:x1867507126928256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997175.615813:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997175.615821:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305a5a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a5a1 expref: 19 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.615829:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997175.615849:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3496:x1867507126928256:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997175.615855:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1780997175.615889:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126928256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997175.615907:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126928128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997175.615935:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997175.615947:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126928000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997175.615954:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126927872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997175.616060:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997175.616297:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1780997175.618936:0:87916:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:2.0:1780997175.619406:0:87916:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1780997175.619417:0:87916:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689bb5a5000 e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 192.168.206.51@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780997175.619424:0:87916:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689886b4000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780997175.619428:0:87916:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff96888b416800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780997175.619432:0:87916:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff96888b415000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780997175.619437:0:87916:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689869ef800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 111669149700 stale:0 00000020:00080000:2.0:1780997175.619457:0:87916:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff968886ec3380) has exports, disconnecting them 00000020:00080000:2.0:1780997175.619463:0:87916:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.206.51@tcp (ffff9689bb5a5000), last request at 1780997175 00000020:00000080:2.0:1780997175.619470:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305aaf6 00000020:00010000:2.0:1780997175.619479:0:87916:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689bb5a5000: total 0 00000100:00080000:2.0:1780997175.619484:0:87916:0:(import.c:65:import_set_state_nolock()) ffff9689bb5a3800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780997175.619515:0:87916:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.206.51@tcp (ffff9689bb5a5000): rc 0 00000020:00080000:2.0:1780997175.619518:0:87916:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689886b4000), last request at 1780997151 00000020:00000080:2.0:1780997175.619521:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a7a7 00000100:00080000:2.0:1780997175.619524:0:87916:0:(import.c:65:import_set_state_nolock()) ffff9689bc968800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780997175.619532:0:87916:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689886b4000): rc 0 00000020:00000080:2.0:1780997175.619534:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689886b4000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1780997175.619541:0:87916:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96888b416800), last request at 1780997172 00000020:00000080:2.0:1780997175.619543:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a7a0 00000100:00080000:2.0:1780997175.619546:0:87916:0:(import.c:65:import_set_state_nolock()) ffff96888b417800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780997175.619553:0:87916:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96888b416800): rc 0 00000020:00000080:2.0:1780997175.619555:0:87916:0:(genops.c:906:class_export_put()) final put ffff96888b416800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1780997175.619558:0:87916:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96888b415000), last request at 1780997172 00000020:00000080:2.0:1780997175.619560:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a799 00000100:00080000:2.0:1780997175.619568:0:87916:0:(import.c:65:import_set_state_nolock()) ffff96888b414800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780997175.619609:0:87916:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96888b415000): rc 0 00000020:00000080:2.0:1780997175.619612:0:87916:0:(genops.c:906:class_export_put()) final put ffff96888b415000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1780997175.619616:0:87916:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689869ef800), last request at 1780997146 00000020:00000080:2.0:1780997175.619618:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a603 00000100:00080000:2.0:1780997175.619627:0:87916:0:(import.c:65:import_set_state_nolock()) ffff9689886b0000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780997175.619631:0:87916:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689869ef800): rc 0 00000020:00000080:2.0:1780997175.619632:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689869ef800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:2.0:1780997175.619639:0:87916:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa8c8c1517ae0 00000100:00080000:2.0:1780997175.619656:0:87916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780997175.619665:0:87916:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:1.0:1780997175.620605:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689886b4000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1780997175.620664:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96888b416800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1780997175.620688:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96888b415000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1780997175.620706:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689869ef800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1780997175.620732:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bc968800 for lustre-MDT0000 00000020:00000080:1.0:1780997175.620735:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888b417800 for lustre-MDT0000 00000020:00000080:1.0:1780997175.620738:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888b414800 for lustre-MDT0000 00000020:00000080:1.0:1780997175.620741:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689886b0000 for lustre-MDT0000 00000020:00010000:1.0:1780997175.620752:0:37626:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689bb5a5000: total 0 00010000:00010000:1.0:1780997175.620755:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997175.620809:0:37626:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689bb5a5000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1780997175.620854:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc843400/0x30fd811c0305ab35 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d0c expref: 3 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.620882:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305ab19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d05 expref: 2 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997175.620895:0:37626:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689bb5a5000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1780997175.623669:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997175.623685:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997175.623759:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780997175.626840:0:87916:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1780997175.626881:0:87916:0:(import.c:65:import_set_state_nolock()) ffff96898d685000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1780997175.627254:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126928384:0@lo:39:umount.0 00000100:00100000:0.0:1780997175.627363:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997175.627479:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126928384 00000100:00100000:3.0:1780997175.627489:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126928384 00000100:00100000:3.0:1780997175.627555:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011 00000100:00100000:3.0:1780997175.627565:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126928384:12345-0@lo:39:umount.0 00000020:00000080:3.0:1780997175.627602:0:8241:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a642 00000100:00080000:3.0:1780997175.627611:0:8241:0:(import.c:65:import_set_state_nolock()) ffff9689869c9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780997175.627637:0:8241:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378737 00000100:00100000:3.0:1780997175.627808:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3495:x1867507126928384:12345-0@lo:39:umount.0 Request processed in 244us (444us total) trans 81604378738 rc 0/0 00000100:00100000:3.0:1780997175.627816:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00010000:00010000:3.0:1780997175.627854:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780997175.627892:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d685000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1780997175.627899:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126928384:0@lo:39:umount.0 00000100:00080000:2.0:1780997175.628703:0:87916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780997175.628709:0:87916:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 3 00000004:00080000:2.0:1780997175.628731:0:87916:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:2.0:1780997175.628794:0:87916:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1780997175.628818:0:87916:0:(import.c:65:import_set_state_nolock()) ffff9689bc9e1000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1780997175.628829:0:87916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780997175.628831:0:87916:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 3 00000004:00080000:2.0:1780997175.628844:0:87916:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:2.0:1780997175.628901:0:87916:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1780997175.628909:0:87916:0:(import.c:65:import_set_state_nolock()) ffff9689ba41b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1780997175.628949:0:87916:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff968886ec3380) has no exports 00000100:00100000:0.0:1780997175.629011:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126928512:0@lo:9:umount.0 00000100:00100000:0.0:1780997175.629067:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997175.629100:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126928640:0@lo:9:umount.0 00000100:00100000:0.0:1780997175.629120:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997175.629151:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126928512 00000100:00100000:0.0:1780997175.629156:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126928512 00000100:00100000:0.0:1780997175.629201:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126928640 00000100:00100000:0.0:1780997175.629203:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126928640 00000100:00100000:0.0:1780997175.629224:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5951 00000100:00100000:0.0:1780997175.629231:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126928512:12345-0@lo:9:umount.0 00000020:00000080:0.0:1780997175.629252:0:8232:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a65e 00000100:00080000:0.0:1780997175.629259:0:8232:0:(import.c:65:import_set_state_nolock()) ffff9689bcb6c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780997175.629326:0:8232:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:0.0:1780997175.629451:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3495:x1867507126928512:12345-0@lo:9:umount.0 Request processed in 219us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997175.629457:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5951 00000100:00100000:0.0:1780997175.629470:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5952 00000100:00100000:0.0:1780997175.629477:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126928640:12345-0@lo:9:umount.0 00000020:00000080:0.0:1780997175.629488:0:8232:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a66c 00000100:00080000:0.0:1780997175.629494:0:8232:0:(import.c:65:import_set_state_nolock()) ffff9688858f0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780997175.629518:0:8232:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:0.0:1780997175.629616:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3495:x1867507126928640:12345-0@lo:9:umount.0 Request processed in 139us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997175.629623:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5952 00000100:00080000:0.0:1780997175.629639:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997175.629643:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1780997175.629657:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780997175.629682:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bc9e1000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1780997175.629687:0:3495:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:0.0:1780997175.629689:0:3495:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780997175.629693:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126928512:0@lo:9:umount.0 00000100:00080000:0.0:1780997175.629702:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ba41b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1780997175.629704:0:3495:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:0.0:1780997175.629705:0:3495:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780997175.629708:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126928640:0@lo:9:umount.0 00010000:00010000:0.0:1780997175.629726:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1780997175.630231:0:87916:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff968886ec3380) has no exports 00000020:00000080:1.0:1780997175.664103:0:37626:0:(genops.c:906:class_export_put()) final put ffff9689bb5a5000/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00010000:00010000:1.0:1780997175.664171:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997175.664174:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997175.664176:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1780997175.664325:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bb5a5000/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 for lustre-MDT0000 00000020:00000080:2.0:1780997175.664388:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bb5a3800 for lustre-MDT0000 00000020:00000080:0.0:1780997175.688871:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a618 00000020:00000080:0.0:1780997175.688887:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689ba41d000/lustre-QMT0000_UUID 00000020:01000000:0.0:1780997175.688953:0:87916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1780997175.689056:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997175.689070:0:87916:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1780997175.689076:0:87916:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff96888ac54d40) has no exports 00000020:00000080:2.0:1780997175.689624:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a611 00000020:00000080:2.0:1780997175.689630:0:87916:0:(genops.c:906:class_export_put()) final put ffff96888969a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780997175.689701:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba41d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1780997175.689829:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96888969a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1780997175.689900:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780997175.689909:0:87916:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1780997175.689912:0:87916:0:(genops.c:906:class_export_put()) final put ffff96888969a800/lustre-QMT0000_UUID 00000020:00000080:2.0:1780997175.689914:0:87916:0:(genops.c:865:class_export_destroy()) destroying export ffff96888969a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1780997175.689921:0:87916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1780997175.690076:0:87916:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968887c39f60 - data ffff9689aee16af8/ffff968889f65400 00000020:01000000:2.0:1780997175.690211:0:87916:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9688868c6d80 - data ffff9689aefbd510/ffff968885e2ec00 00000100:00080000:2.0:1780997175.756077:0:87916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780997175.756101:0:87916:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1780997175.756115:0:87916:0:(client.c:3169:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9689a5dbf100 x1867507126928384/t81604378738(81604378738) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997185 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997175.756139:0:87916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1780997175.757815:0:87916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780997175.757821:0:87916:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 4 00000004:00080000:2.0:1780997175.757845:0:87916:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997175.757848:0:87916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1780997175.758311:0:87028:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1780997175.758316:0:87028:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:0.0:1780997175.758328:0:87028:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:2.0:1780997175.759833:0:87916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780997175.759838:0:87916:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 4 00000004:00080000:2.0:1780997175.759858:0:87916:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997175.759860:0:87916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1780997175.760157:0:87030:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1780997175.760162:0:87030:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:1.0:1780997175.760173:0:87030:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:2.0:1780997175.764075:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a5d2 00000020:00000080:2.0:1780997175.764089:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689bd36c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780997175.764410:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bd36c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1780997175.765037:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a5e7 00000020:00000080:2.0:1780997175.765046:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689b79cd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780997175.765061:0:87916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1780997175.765069:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997175.765080:0:87916:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1780997175.765084:0:87916:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff968886ec4d40) has no exports 00000020:00000080:1.0:1780997175.765189:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b79cd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1780997175.765571:0:87916:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1780997175.765594:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a665 00000020:00000080:2.0:1780997175.765602:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689891a9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780997175.765609:0:87916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1780997175.765614:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997175.765619:0:87916:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780997175.765628:0:87916:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff968990fe19c0) has no exports 00000020:00000080:1.0:1780997175.765657:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689891a9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1780997175.766442:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a657 00000020:00000080:2.0:1780997175.766448:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689bd36a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780997175.766735:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bd36a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1780997175.768575:0:87916:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1780997175.768595:0:87916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780997175.768601:0:87916:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 5 00000004:00080000:2.0:1780997175.768621:0:87916:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997175.768624:0:87916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780997175.768690:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780997175.768701:0:87916:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997175.768753:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689ba41b800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1780997175.769308:0:36:0:(genops.c:906:class_export_put()) final put ffff9689ba677800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780997175.769314:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba677800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1780997175.769323:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780997175.769543:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a649 00000020:00000080:2.0:1780997175.769551:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689ba676800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780997175.769607:0:87916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1780997175.769612:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997175.769620:0:87916:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780997175.769624:0:87916:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff96888ac50000) has no exports 00000020:00000080:2.0:1780997175.769631:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a63b 00000020:00000080:2.0:1780997175.769635:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689bc9e7800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780997175.773897:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba676800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1780997175.774904:0:87916:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1780997175.774911:0:87916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780997175.774916:0:87916:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 5 00000004:00080000:2.0:1780997175.774923:0:87916:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997175.774926:0:87916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1780997175.778068:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc9e7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1780997175.778823:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780997175.778841:0:87916:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1780997175.778861:0:87916:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1780997175.778872:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a62d 00000020:00000080:2.0:1780997175.778883:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689ba419800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780997175.778912:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bc9e1000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1780997175.778919:0:36:0:(genops.c:906:class_export_put()) final put ffff9689ba41c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780997175.778922:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba41c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1780997175.778927:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1780997175.782704:0:87916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1780997175.782719:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997175.782732:0:87916:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780997175.782739:0:87916:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff968886ec19c0) has no exports 00000020:00000080:2.0:1780997175.782749:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a626 00000020:00000080:2.0:1780997175.782759:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689bd36c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780997175.784435:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba419800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1780997175.787841:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bd36c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1780997175.792414:0:87916:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1780997175.792425:0:87916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1780997175.792430:0:87916:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1780997175.792440:0:87916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780997175.792509:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997175.792521:0:87916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997175.792557:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997175.792560:0:87916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997175.792577:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689bc96a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780997175.792581:0:87916:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1780997175.792604:0:87916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997175.792727:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a5ee 00000020:00000080:0.0:1780997175.792735:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689b79cb000/lustre-MDD0000_UUID 00000020:01000000:0.0:1780997175.792740:0:87916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1780997175.792744:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780997175.792749:0:87916:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1780997175.792753:0:87916:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff968886ec0000) has no exports 00000020:00000080:0.0:1780997175.792774:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997175.792778:0:87916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1780997175.792782:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a5f5 00000020:00000080:0.0:1780997175.792785:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689b79c9000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1780997175.792792:0:87916:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689aebbd000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1780997175.792795:0:87916:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689aebbd000 3 00000020:01000004:0.0:1780997175.792798:0:87916:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9689aebbd000 from lustre-MDT0000 00000020:00000080:0.0:1780997175.792815:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997175.792817:0:87916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1780997175.792820:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689bd36d800/lustre-MDT0000_UUID 00000020:00000080:0.0:1780997175.792822:0:87916:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bd36d800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1780997175.792829:0:87916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1780997175.792864:0:87916:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1780997175.792867:0:87916:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1780997175.792870:0:87916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1780997175.792872:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780997175.792876:0:87916:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1780997175.792885:0:87916:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9689891a8000 cf5d474c-5b3a-4e23-b534-5ea64925b132 192.168.206.51@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780997175.792892:0:87916:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff968986145800 bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780997175.792896:0:87916:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff968990fe0000) has exports, disconnecting them 00000020:00080000:0.0:1780997175.792900:0:87916:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.206.51@tcp (ffff9689891a8000), last request at 1780997169 00000020:00000080:0.0:1780997175.792915:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305aad3 00000020:00010000:0.0:1780997175.792926:0:87916:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689891a8000: total 2 00000100:00080000:0.0:1780997175.792930:0:87916:0:(import.c:65:import_set_state_nolock()) ffff9689ba673000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780997175.792956:0:87916:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.206.51@tcp (ffff9689891a8000): rc 0 00000020:00080000:0.0:1780997175.792960:0:87916:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff968986145800), last request at 1780997146 00000020:00000080:0.0:1780997175.792967:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a59a 00000020:00010000:0.0:1780997175.792970:0:87916:0:(genops.c:1942:obd_stale_export_put()) Put export ffff968986145800: total 2 00000100:00080000:0.0:1780997175.792973:0:87916:0:(import.c:65:import_set_state_nolock()) ffff968886f5c000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780997175.792984:0:87916:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff968986145800): rc 0 00000020:00080000:0.0:1780997175.792989:0:87916:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff968990fe0000) has no exports 00000020:00010000:0.0:1780997175.793001:0:14480:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689891a8000: total 2 00010000:00010000:0.0:1780997175.793029:0:14480:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689891a8000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1780997175.793061:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce2800/0x30fd811c0305aae8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ccd expref: 5 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793083:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce3400/0x30fd811c0305aae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c9c expref: 4 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793094:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bb4ef400/0x30fd811c0305aada lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8c95 expref: 3 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793105:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce2000/0x30fd811c0305aaef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8cd4 expref: 2 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793113:0:14480:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689891a8000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1780997175.793131:0:14480:0:(genops.c:906:class_export_put()) final put ffff9689891a8000/cf5d474c-5b3a-4e23-b534-5ea64925b132 00000020:00010000:0.0:1780997175.793136:0:14480:0:(genops.c:1928:obd_stale_export_get()) Get export ffff968986145800: total 3 00010000:00010000:0.0:1780997175.793151:0:14480:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff968986145800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1780997175.793164:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455c00/0x30fd811c0305a6ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a6e3 expref: 14 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793186:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96888956e800/0x30fd811c0305a74c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a745 expref: 13 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793196:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02800/0x30fd811c0305a6dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a6d5 expref: 12 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793208:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455400/0x30fd811c0305a75a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a753 expref: 11 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793218:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03e00/0x30fd811c0305a768 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a761 expref: 10 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793230:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96888956ea00/0x30fd811c0305a6f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a6f1 expref: 9 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793240:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455000/0x30fd811c0305a776 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a76f expref: 8 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793248:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96888956e000/0x30fd811c0305a706 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a6ff expref: 7 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793257:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96888956e200/0x30fd811c0305a714 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a70d expref: 6 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793266:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96888956f000/0x30fd811c0305a722 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a71b expref: 5 pid: 87016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793305:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02600/0x30fd811c0305a73e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a737 expref: 4 pid: 87017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793326:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba454e00/0x30fd811c0305a6ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a6c7 expref: 3 pid: 87015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793338:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305a730 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305a729 expref: 2 pid: 87021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997175.793348:0:14480:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff968986145800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1780997175.793361:0:14480:0:(genops.c:906:class_export_put()) final put ffff968986145800/bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 00010000:00010000:0.0:1780997175.793366:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997175.793368:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997175.793370:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997175.793433:0:87016:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9689ba52f000:87016] 1 exiting: rc = 0 00000100:00100000:1.0:1780997175.793602:0:87017:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9689ba52f400:87017] 2 exiting: rc = 0 00000020:00000080:1.0:1780997175.793645:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96898d685000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1780997175.793651:0:36:0:(genops.c:906:class_export_put()) final put ffff9689bc968000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780997175.793653:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc968000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1780997175.793657:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997175.793709:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b79cb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1780997175.793718:0:36:0:(genops.c:906:class_export_put()) final put ffff96898d684000/lustre-MDD0000_UUID 00000020:00000080:1.0:1780997175.793720:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96898d684000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1780997175.793724:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1780997175.793749:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b79c9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780997175.793754:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689891a8000/cf5d474c-5b3a-4e23-b534-5ea64925b132 for MGS 00000020:00000080:1.0:1780997175.793787:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff968986145800/bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 for MGS 00000020:00000080:1.0:1780997175.793799:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689ba673000 for MGS 00000020:00000080:1.0:1780997175.793803:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968886f5c000 for MGS 00010000:00010000:3.0:1780997175.795720:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997175.795786:0:87015:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9689ba3b6a00:87015] 0 exiting: rc = 1 00000100:00100000:3.0:1780997175.795885:0:87021:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff96888965dc00:87021] 3 exiting: rc = 0 00000100:00100000:1.0:1780997175.797634:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797653:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797658:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797664:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797670:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797676:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797682:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797688:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797695:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797701:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797707:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797713:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797719:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797724:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797730:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797735:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797740:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797746:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797751:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797758:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797764:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797771:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797777:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797785:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797791:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797811:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797820:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797827:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797833:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797839:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797845:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797851:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797857:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797863:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797869:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797875:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797882:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797888:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797895:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797902:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797908:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797915:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797922:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797928:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797934:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797940:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797946:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797953:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797959:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797964:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797969:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.797975:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.799228:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.799235:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.799241:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.799248:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.799253:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.799258:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.799263:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.799281:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.799301:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.799307:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.799313:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997175.799318:0:87916:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1780997175.801613:0:87916:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9688868c61e0 - data ffff9689ae2306c0/ffff968885e2e800 00000020:01000000:1.0:1780997175.801972:0:87916:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9689bb4f6300 - data ffff9689aef470d8/ffff9689bc928800 00000020:00000080:1.0:1780997175.807785:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a593 00000020:00000080:1.0:1780997175.807803:0:87916:0:(genops.c:906:class_export_put()) final put ffff968986146000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1780997175.807833:0:87916:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689aebbd000 from MGS, refs=2 00000020:01000004:1.0:1780997175.807836:0:87916:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689aebbd000 2 00000020:01000004:1.0:1780997175.807840:0:87916:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9689aebbd000 from MGS 00000020:00000080:1.0:1780997175.807865:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997175.807877:0:87916:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1780997175.807880:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689910a7800/MGS 00000020:00000080:1.0:1780997175.807882:0:87916:0:(genops.c:865:class_export_destroy()) destroying export ffff9689910a7800/MGS for MGS 00000020:01000000:1.0:1780997175.807890:0:87916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1780997175.807986:0:87916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1780997175.807991:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780997175.807997:0:87916:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1780997175.808005:0:87916:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff968987775000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780997175.808012:0:87916:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff96888ac519c0) has exports, disconnecting them 00000020:00080000:1.0:1780997175.808017:0:87916:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff968987775000), last request at 1780997146 00000020:00000080:1.0:1780997175.808021:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a6a4 00000020:00080000:1.0:1780997175.808033:0:87916:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff968987775000): rc 0 00000020:00000080:1.0:1780997175.808038:0:87916:0:(genops.c:906:class_export_put()) final put ffff968987775000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1780997175.809567:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff968986146000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780997175.809598:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff968987775000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1780997175.814134:0:87916:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1780997175.814146:0:87916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1780997175.814151:0:87916:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1780997175.814160:0:87916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780997175.814201:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968983330800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1780997175.814411:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997175.814422:0:87916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1780997175.814427:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689bfab4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1780997175.814431:0:87916:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bfab4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1780997175.814442:0:87916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1780997175.814526:0:87916:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689aebbd000 1 00000020:00000080:0.0:1780997175.814533:0:87916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305a585 00000020:00000080:0.0:1780997175.814541:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689910a1000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1780997175.814548:0:87916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1780997175.814570:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689910a1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780997175.814580:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780997175.814597:0:87916:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1780997175.814601:0:87916:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff96888ac53380) has no exports 00000020:00000080:1.0:1780997175.994155:0:87916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997175.994171:0:87916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1780997175.994176:0:87916:0:(genops.c:906:class_export_put()) final put ffff9689ae563800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780997175.994181:0:87916:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ae563800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1780997175.994195:0:87916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1780997175.994343:0:87916:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9689aebbc800 00000020:02000400:1.0:1780997175.994421:0:87916:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1780997176.038252:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997176.747647:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126928768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997176.747749:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997176.747834:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126928768 00000100:00100000:0.0:1780997176.747843:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126928768 00000100:00100000:0.0:1780997176.747927:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:0.0:1780997176.747941:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126928768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997176.747983:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997176.748047:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126928768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997176.748058:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00000100:00080000:0.0:1780997176.748088:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997176.748150:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126928768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997176.749515:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997176.749533:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126928896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997176.749611:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997176.749671:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126928896 00000100:00100000:2.0:1780997176.749696:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126928896 00000100:00100000:2.0:1780997176.749747:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091 00000100:00100000:2.0:1780997176.749757:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126928896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997176.749787:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997176.749831:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126928896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997176.749839:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091 00000100:00080000:2.0:1780997176.749862:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997176.750472:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126928896:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1780997177.068946:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997177.254625:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126929024:0@lo:400:kworker.0 00000400:00000100:0.0:1780997177.254727:0:3496:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126929024 offset 0 length 224: 4 00000100:00100000:0.0:1780997177.254788:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126929536:0@lo:400:kworker.0 00000100:00100000:0.0:1780997177.254840:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997177.254883:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1780997177.254891:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507126929152:0@lo:400:kworker.0 00000100:00100000:0.0:1780997177.254919:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997177.254940:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126929664:0@lo:400:kworker.0 00000100:00100000:0.0:1780997177.254973:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997177.255027:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126929280:0@lo:400:kworker.0 00000100:00100000:0.0:1780997177.255055:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997177.255073:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126929792:0@lo:400:kworker.0 00000100:00100000:0.0:1780997177.255093:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997177.255110:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997177.255115:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126929408:0@lo:400:kworker.0 00000100:00100000:0.0:1780997177.255135:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997177.255177:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126929536 00000100:00100000:0.0:1780997177.255187:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126929536 00000100:00100000:0.0:1780997177.255256:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126929152 00000100:00100000:0.0:1780997177.255260:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126929152 00000100:00100000:0.0:1780997177.255295:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126929280 00000100:00100000:0.0:1780997177.255297:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126929280 00000100:00100000:0.0:1780997177.255314:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126929792 00000100:00100000:0.0:1780997177.255316:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126929792 00000100:00100000:0.0:1780997177.255324:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126929408 00000100:00100000:0.0:1780997177.255326:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126929408 00000100:00100000:0.0:1780997177.255339:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:0.0:1780997177.255349:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126929536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997177.255419:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126929536:12345-0@lo:400:kworker.0 Request processed in 71us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997177.255427:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:0.0:1780997177.255448:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:0.0:1780997177.255455:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126929280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997177.255489:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126929280:12345-0@lo:400:kworker.0 Request processed in 35us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997177.255496:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:0.0:1780997177.255507:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1780997177.255518:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3496:x1867507126929152:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780997177.255525:0:63418:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780997177.255556:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3496:x1867507126929152:12345-0@lo:400:kworker.0 Request processed in 37us (636us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780997177.255561:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1780997177.255573:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1780997177.255594:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3498:x1867507126929792:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780997177.255599:0:63418:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780997177.255621:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3498:x1867507126929792:12345-0@lo:400:kworker.0 Request processed in 27us (528us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780997177.255626:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1780997177.255636:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1780997177.255639:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3498:x1867507126929408:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780997177.255643:0:63418:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780997177.255662:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3498:x1867507126929408:12345-0@lo:400:kworker.0 Request processed in 22us (526us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780997177.255668:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1780997177.255695:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126929664 00000100:00100000:0.0:1780997177.255699:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126929664 00000100:00100000:0.0:1780997177.255729:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012 00000100:00100000:0.0:1780997177.255734:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3496:x1867507126929664:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780997177.255739:0:23042:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780997177.255764:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3496:x1867507126929664:12345-0@lo:400:kworker.0 Request processed in 28us (791us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780997177.255771:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00000100:00080000:0.0:1780997177.255806:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780997177.255861:0:3498:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780997177.255870:0:3498:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780997177.255882:0:3498:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780997177.255891:0:3498:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997177.255898:0:3498:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3679 00000100:00080000:0.0:1780997177.255909:0:3498:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997177.255953:0:3498:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6794e00 x1867507126929920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997177.255983:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126929408:0@lo:400:kworker.0 00000100:00100000:0.0:1780997177.256008:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126929280:0@lo:400:kworker.0 00000100:00080000:0.0:1780997177.256017:0:3498:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780997177.256019:0:3498:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780997177.256022:0:3498:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780997177.256025:0:3498:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997177.256027:0:3498:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3679 00000100:00080000:0.0:1780997177.256033:0:3498:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997177.256047:0:3498:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6797480 x1867507126930048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997177.256056:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126929792:0@lo:400:kworker.0 00000100:00100000:0.0:1780997177.256090:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126929920:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1780997177.256125:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997177.256144:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126930048:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1780997177.256166:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997177.256197:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126929920 00000100:00100000:0.0:1780997177.256208:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126929920 00000100:00100000:0.0:1780997177.256228:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126930048 00000100:00100000:0.0:1780997177.256230:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126930048 00000100:00100000:0.0:1780997177.256241:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1780997177.256245:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126929920:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1780997177.256296:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997177.256330:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126929920:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 83us (205us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997177.256336:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1780997177.256347:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1780997177.256351:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126930048:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1780997177.256356:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126930176:0@lo:41:osp-pre-0-1.0 00010000:00020000:0.0:1780997177.256361:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997177.256383:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126930048:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 30us (217us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997177.256389:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:3.0:1780997177.256391:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997177.256416:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1780997177.256422:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126930176 00000100:00080000:0.0:1780997177.256422:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997177.256425:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126930176 00000100:00100000:0.0:1780997177.256426:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126929920:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1780997177.256435:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997177.256438:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997177.256441:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126930048:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1780997177.256449:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013 00000100:00100000:3.0:1780997177.256454:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3499:x1867507126930176:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1780997177.256461:0:8241:0:(tgt_handler.c:804:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00080000:0.0:1780997177.256471:0:3496:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780997177.256474:0:3496:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780997177.256477:0:3496:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1780997177.256488:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3499:x1867507126930176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 33us (96us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780997177.256494:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013 00000100:02020000:3.0:1780997177.256548:0:3499:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1780997177.256696:0:3496:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997177.256703:0:3496:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3679 00000100:00080000:0.0:1780997177.256708:0:3496:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997177.256725:0:3496:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b78dca80 x1867507126930304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997177.256742:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507126929152:0@lo:400:kworker.0 00000100:00080000:0.0:1780997177.256755:0:3496:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780997177.256759:0:3496:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780997177.256762:0:3496:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780997177.256767:0:3496:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997177.256777:0:3496:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3679 00000100:00080000:0.0:1780997177.256781:0:3496:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997177.256794:0:3496:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a6797480 x1867507126930432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997177.256805:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126929664:0@lo:400:kworker.0 00000100:00100000:0.0:1780997177.256821:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126929536:0@lo:400:kworker.0 00000100:00100000:0.0:1780997177.256843:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126930304:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1780997177.256868:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997177.256887:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126930432:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1780997177.256908:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997177.256933:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126930304 00000100:00100000:0.0:1780997177.256937:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126930304 00000100:00100000:0.0:1780997177.256970:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1780997177.256974:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126930304:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1780997177.256985:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997177.257017:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126930304:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 41us (147us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997177.257023:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1780997177.257045:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126930432 00000100:00100000:0.0:1780997177.257048:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126930432 00000100:00100000:0.0:1780997177.257066:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00000100:00100000:0.0:1780997177.257071:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126930432:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1780997177.257081:0:23042:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997177.257104:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126930432:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 32us (194us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997177.257110:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00080000:0.0:1780997177.257134:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997177.257138:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997177.257141:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126930304:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1780997177.257150:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997177.257154:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997177.257157:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126930432:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1780997177.272290:0:3499:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780997177.272300:0:3499:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9689ae566000 already not connected (conn 68, was 67): DISCONN 00010000:00010000:2.0:1780997178.086593:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997179.109556:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997180.134360:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1780997180.164344:0:3489:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110391424 offset 0 length 224: 4 00000100:00100000:0.0:1780997180.164411:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997180.166848:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110391680 00000100:00100000:2.0:1780997180.166880:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110391680 00000100:00100000:2.0:1780997180.167014:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1295 00000100:00100000:2.0:1780997180.167029:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110391680:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:1.0:1780997180.167203:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997180.167401:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997180.167847:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110391680:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 819us (3433us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997180.167866:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1295 00000100:00100000:0.0:1780997180.167926:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997180.168396:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997180.168824:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110391936 00000100:00100000:1.0:1780997180.168836:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110391936 00000100:00100000:1.0:1780997180.168905:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110391808 00000100:00100000:1.0:1780997180.168909:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110391808 00000100:00100000:1.0:1780997180.168938:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2604 00000100:00100000:1.0:1780997180.168949:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110391936:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997180.172970:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110391552 00000100:00100000:2.0:1780997180.172994:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110391552 00000100:00100000:2.0:1780997180.173102:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1329 00000100:00100000:2.0:1780997180.173114:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1867507110391552:12345-192.168.206.51@tcp:400:kworker.0 00000020:00080000:2.0:1780997180.173126:0:63419:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.206.51@tcp 00000100:00100000:1.0:1780997180.185024:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110391936:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 15535us (17083us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997180.185047:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2604 00000100:00100000:1.0:1780997180.185122:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2605 00000100:00100000:1.0:1780997180.185149:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110391808:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997180.185634:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1867507110391552:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 12516us (18178us total) trans 0 rc -107/-107 00000100:00100000:2.0:1780997180.185647:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1329 00000100:00080000:2.0:1780997180.187285:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997180.187299:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997180.188783:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997180.188832:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110392064 00000100:00100000:0.0:1780997180.188846:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110392064 00000100:00100000:0.0:1780997180.188909:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1330 00000100:00100000:0.0:1780997180.188921:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110392064:12345-192.168.206.51@tcp:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1780997180.188957:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997180.189077:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110392064:12345-192.168.206.51@tcp:38:ptlrpcd_00_00.0 Request processed in 156us (309us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997180.189086:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1330 00000100:00100000:1.0:1780997180.192686:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110391808:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 7531us (24268us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997180.192721:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2605 00000001:00100000:1.0:1780997180.338730:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1780997180.338755:0:72364:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378738 is committed 00000020:00000080:1.0:1780997180.338764:0:72364:0:(genops.c:906:class_export_put()) final put ffff9689869ca000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:1.0:1780997180.338796:0:72364:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411387 batchid updated 00000020:00080000:2.0:1780997180.338925:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000004:00080000:2.0:1780997180.339019:0:72384:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff96888a47f540 with version 13 00000020:00080000:2.0:1780997180.339038:0:72384:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411387 cancel update log [0x2000088d1:0x2:0x0].2: rc = 0 00000020:00080000:2.0:1780997180.339155:0:72384:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411387 cancel update log [0x2400090a0:0x2:0x0].3: rc = 0 00000020:00080000:2.0:1780997180.339166:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000020:00000080:0.0:1780997180.339531:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689869ca000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1780997180.339662:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689869c9000 for lustre-MDT0001 00000004:00080000:1.0:1780997180.340432:0:72369:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff968889e33300 version 13 rpc_version 13 00000020:00100000:1.0:1780997180.340506:0:72369:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1780997180.340525:0:72369:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9689a5d81880 x1867507126930688/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997180.340572:0:72369:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9689a5d81880 x1867507126930688/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997180.340584:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00010000:00010000:2.0:1780997181.163249:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997181.349491:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000001:00100000:2.0:1780997181.351404:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780997181.351414:0:8226:0:(genops.c:906:class_export_put()) final put ffff9689bcb6b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780997181.351740:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcb6b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1780997181.351802:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bcb6c800 for lustre-OST0000 00000001:00100000:2.0:1780997181.354231:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780997181.354241:0:9294:0:(genops.c:906:class_export_put()) final put ffff9688858f4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1780997181.354377:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9688858f4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1780997181.354441:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9688858f0800 for lustre-OST0001 00000100:00100000:2.0:1780997181.861546:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997181.861591:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126930816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997181.861686:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997181.861790:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126930816 00000100:00100000:2.0:1780997181.861800:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126930816 00000100:00100000:2.0:1780997181.862176:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:2.0:1780997181.862195:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126930816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997181.862247:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997181.862535:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126930816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 346us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997181.862557:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00080000:2.0:1780997181.862609:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997181.862695:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126930816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997181.863434:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126930944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997181.863478:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997181.863574:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126930944 00000100:00100000:3.0:1780997181.863589:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126930944 00000100:00100000:3.0:1780997181.863705:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:3.0:1780997181.863719:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126930944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997181.863770:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997181.863863:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126930944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 147us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997181.863871:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00080000:2.0:1780997181.863900:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997181.863995:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126930944:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780997182.181909:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997182.373445:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00080000:1.0:1780997182.373711:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997182.373717:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997182.373721:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997182.373731:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3704 00000100:00080000:1.0:1780997182.373736:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780997182.373743:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997182.373767:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a5d81c00 x1867507126931200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997182.373797:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997182.373801:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997182.373803:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997182.373806:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3704 00000100:00080000:1.0:1780997182.373809:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780997182.373812:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997182.373941:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126931328:0@lo:400:kworker.0 00000100:00100000:2.0:1780997182.374028:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997182.374072:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997182.374078:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126931072:0@lo:400:kworker.0 00000400:00000100:2.0:1780997182.374099:0:3499:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126931072 offset 0 length 224: 4 00000100:00100000:3.0:1780997182.374194:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126931328 00000100:00100000:3.0:1780997182.374202:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126931328 00000100:00100000:3.0:1780997182.374268:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1780997182.374295:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126931328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997182.374363:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126931328:12345-0@lo:400:kworker.0 Request processed in 72us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997182.374371:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1780997182.374421:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126931328:0@lo:400:kworker.0 00000100:00080000:2.0:1780997182.374684:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997182.374830:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a5d81180 x1867507126931456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997182.374879:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997182.374882:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997182.374885:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997182.374889:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3704 00000100:00080000:1.0:1780997182.374892:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780997182.374896:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997182.374923:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a5d80000 x1867507126931712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997182.374933:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997182.374936:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997182.374938:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997182.374941:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3704 00000100:00080000:1.0:1780997182.374943:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780997182.374946:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997182.374955:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a5d83800 x1867507126931840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997182.375079:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126931584:0@lo:400:kworker.0 00000100:00100000:2.0:1780997182.375116:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997182.375194:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126931584 00000100:00100000:1.0:1780997182.375199:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126931584 00000100:00100000:0.0:1780997182.375293:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126931200:0@lo:38:kworker.0 00000100:00100000:0.0:1780997182.375334:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997182.375354:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126931456:0@lo:38:kworker.0 00000100:00100000:0.0:1780997182.375376:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997182.375390:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126931712:0@lo:38:kworker.0 00000100:00100000:0.0:1780997182.375415:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997182.375432:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126931840:0@lo:38:kworker.0 00000100:00100000:0.0:1780997182.375453:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997182.375693:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126931200 00000100:00100000:1.0:1780997182.375698:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126931200 00000100:00100000:1.0:1780997182.375713:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126931456 00000100:00100000:1.0:1780997182.375715:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126931456 00000100:00100000:1.0:1780997182.375722:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126931840 00000100:00100000:1.0:1780997182.375724:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126931840 00000100:00100000:1.0:1780997182.375734:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:1.0:1780997182.375743:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126931584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997182.375792:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126931584:12345-0@lo:400:kworker.0 Request processed in 50us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997182.375798:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00100000:1.0:1780997182.375813:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1780997182.375818:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126931200:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997182.375851:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997182.375893:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126931200:12345-0@lo:38:kworker.0 Request processed in 73us (559us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997182.375899:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1780997182.375912:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1780997182.375916:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126931456:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997182.375925:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997182.375949:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126931456:12345-0@lo:38:kworker.0 Request processed in 31us (572us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997182.375954:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1780997182.375965:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1780997182.375969:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126931840:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997182.375978:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997182.376000:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126931840:12345-0@lo:38:kworker.0 Request processed in 29us (546us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997182.376007:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1780997182.376045:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126931584:0@lo:400:kworker.0 00000100:00100000:1.0:1780997182.376090:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126931712 00000100:00100000:1.0:1780997182.376094:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126931712 00000100:00100000:1.0:1780997182.376113:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015 00000100:00100000:1.0:1780997182.376117:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126931712:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997182.376127:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997182.376153:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126931712:12345-0@lo:38:kworker.0 Request processed in 34us (737us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997182.376159:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015 00000100:00080000:0.0:1780997182.376515:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997182.376521:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997182.376524:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126931840:0@lo:38:kworker.0 00000100:00080000:0.0:1780997182.376554:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997182.376558:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997182.376570:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126931200:0@lo:38:kworker.0 00000100:00080000:0.0:1780997182.376583:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997182.376588:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997182.376591:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126931456:0@lo:38:kworker.0 00000100:00080000:0.0:1780997182.376599:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997182.376602:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997182.376604:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126931712:0@lo:38:kworker.0 00000100:00080000:2.0:1780997182.380046:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1780997183.205561:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997183.397512:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00010000:00010000:2.0:1780997184.229677:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997184.421503:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00010000:00010000:2.0:1780997185.253580:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1780997185.284790:0:3489:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110392192 offset 0 length 224: 4 00000100:00100000:0.0:1780997185.284840:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997185.284885:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997185.284976:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110392320 00000100:00100000:3.0:1780997185.284986:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110392320 00000100:00100000:3.0:1780997185.285037:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110392448 00000100:00100000:3.0:1780997185.285041:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110392448 00000100:00100000:3.0:1780997185.285097:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1298 00000100:00100000:3.0:1780997185.285108:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110392448:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997185.285203:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110392448:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 97us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997185.285212:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1298 00000100:00100000:3.0:1780997185.285243:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1334 00000100:00100000:3.0:1780997185.285248:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110392320:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:3.0:1780997185.285325:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997185.285379:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110392320:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 129us (540us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997185.285386:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1334 00000100:00080000:2.0:1780997185.285596:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997185.288770:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997185.288826:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997185.288933:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110392704 00000100:00100000:1.0:1780997185.288944:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110392704 00000100:00100000:1.0:1780997185.289023:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110392576 00000100:00100000:1.0:1780997185.289027:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110392576 00000100:00100000:1.0:1780997185.289052:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2606 00000100:00100000:1.0:1780997185.289080:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110392704:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997185.289168:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110392704:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 107us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997185.289175:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2606 00000100:00100000:1.0:1780997185.289194:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2607 00000100:00100000:1.0:1780997185.289200:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110392576:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997185.289241:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110392576:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 41us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997185.289248:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2607 00000100:00080000:2.0:1780997185.289911:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997185.289916:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997185.446123:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00010000:00010000:2.0:1780997186.278085:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997186.469639:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00100000:3.0:1780997186.983057:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126931968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780997186.983133:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997186.983258:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126931968 00000100:00100000:2.0:1780997186.983265:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126931968 00000100:00100000:2.0:1780997186.983335:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:2.0:1780997186.983343:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126931968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997186.983370:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997186.983409:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126931968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997186.983416:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00080000:3.0:1780997186.983633:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997186.983664:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126931968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780997186.984538:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126932096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780997186.984618:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997186.984801:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126932096 00000100:00100000:1.0:1780997186.984811:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126932096 00000100:00100000:1.0:1780997186.984895:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:1.0:1780997186.984907:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126932096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997186.984945:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997186.985003:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126932096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997186.985011:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:0.0:1780997186.985158:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126932096:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1780997186.985223:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1780997187.301550:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780997187.493920:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997187.493943:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1780997187.493946:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00080000:2.0:1780997187.493948:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997187.493964:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3709 00000100:00080000:2.0:1780997187.493972:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780997187.493980:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997187.494012:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba654a80 x1867507126932352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997187.494053:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997187.494057:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997187.494059:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997187.494062:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3709 00000100:00080000:2.0:1780997187.494065:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780997187.494069:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997187.494081:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba655f80 x1867507126932608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997187.494096:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997187.494099:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997187.494101:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997187.494104:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3709 00000100:00080000:2.0:1780997187.494107:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780997187.494110:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997187.494121:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba654700 x1867507126932864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997187.494150:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1780997187.494164:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126932352:0@lo:38:kworker.0 00000100:00080000:2.0:1780997187.494165:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997187.494171:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997187.494177:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3709 00000100:00080000:2.0:1780997187.494180:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780997187.494184:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997187.494313:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997187.494328:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126932992:0@lo:400:kworker.0 00000100:00100000:0.0:1780997187.494363:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126932608:0@lo:38:kworker.0 00000100:00100000:0.0:1780997187.494403:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997187.494414:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997187.494429:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126932864:0@lo:38:kworker.0 00000100:00100000:0.0:1780997187.494470:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997187.494485:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1780997187.494499:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126932224:0@lo:400:kworker.0 00000400:00000100:1.0:1780997187.494539:0:3498:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126932224 offset 0 length 224: 4 00000100:00100000:0.0:1780997187.494545:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126932864 00000100:00100000:0.0:1780997187.494557:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126932864 00000100:00100000:1.0:1780997187.494571:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126933120:0@lo:400:kworker.0 00000100:00100000:1.0:1780997187.494602:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997187.494616:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016 00000100:00100000:0.0:1780997187.494628:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126932864:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997187.494655:0:8242:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997187.494669:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126932480:0@lo:400:kworker.0 00000100:00100000:1.0:1780997187.494700:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997187.494732:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997187.494741:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126932736:0@lo:400:kworker.0 00000100:00100000:0.0:1780997187.494750:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126932864:12345-0@lo:38:kworker.0 Request processed in 117us (274us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997187.494762:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016 00000100:00100000:1.0:1780997187.494779:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997187.494832:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997187.494841:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997187.494846:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126932864:0@lo:38:kworker.0 00000100:00100000:2.0:1780997187.494857:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9688874f5500 x1867507126933248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997187.494895:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126932352 00000100:00100000:2.0:1780997187.494902:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126932352 00000100:00100000:2.0:1780997187.494937:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126932608 00000100:00100000:2.0:1780997187.494941:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126932608 00000100:00100000:2.0:1780997187.494959:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126932480 00000100:00100000:2.0:1780997187.495041:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126932480 00000100:00100000:1.0:1780997187.497216:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126932992 00000100:00100000:1.0:1780997187.497231:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126932992 00000100:00100000:1.0:1780997187.497300:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126933120 00000100:00100000:1.0:1780997187.497304:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126933120 00000100:00100000:1.0:1780997187.497333:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:1.0:1780997187.497343:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126932992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997187.497424:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126932992:12345-0@lo:400:kworker.0 Request processed in 82us (3014us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997187.497432:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:1.0:1780997187.497448:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:1.0:1780997187.497454:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126933120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997187.497485:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126933120:12345-0@lo:400:kworker.0 Request processed in 32us (2885us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997187.497491:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:0.0:1780997187.501093:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126932736 00000100:00100000:0.0:1780997187.501117:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126932736 00000100:00100000:0.0:1780997187.501197:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:0.0:1780997187.501211:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126932480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997187.501386:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126932480:12345-0@lo:400:kworker.0 Request processed in 178us (6683us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997187.501394:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:0.0:1780997187.501417:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:0.0:1780997187.501423:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126932736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997187.501468:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126932736:12345-0@lo:400:kworker.0 Request processed in 45us (6693us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997187.501474:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:0.0:1780997187.501490:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:0.0:1780997187.501495:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126932352:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997187.501529:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997187.501564:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126932352:12345-0@lo:38:kworker.0 Request processed in 67us (7253us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997187.501570:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:0.0:1780997187.501583:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1780997187.501609:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126932608:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997187.501620:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997187.501648:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126932608:12345-0@lo:38:kworker.0 Request processed in 38us (7246us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997187.501654:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1780997187.501700:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126933248:0@lo:38:kworker.0 00000100:00100000:0.0:1780997187.501768:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997187.501829:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997187.501835:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997187.501839:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126932352:0@lo:38:kworker.0 00000100:00080000:0.0:1780997187.501852:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997187.501856:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997187.501859:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126932608:0@lo:38:kworker.0 00000100:00100000:0.0:1780997187.501985:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126933248 00000100:00100000:0.0:1780997187.501991:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126933248 00000100:00080000:3.0:1780997187.502027:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997187.502037:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1780997187.502045:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126933248:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997187.502057:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997187.502096:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126933248:12345-0@lo:38:kworker.0 Request processed in 49us (327us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997187.502103:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00080000:0.0:1780997187.502140:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997187.502144:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997187.502147:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126933248:0@lo:38:kworker.0 00000100:00100000:0.0:1780997187.502239:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126933120:0@lo:400:kworker.0 00000100:00100000:0.0:1780997187.502256:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126932992:0@lo:400:kworker.0 00000100:00100000:0.0:1780997187.502343:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126932736:0@lo:400:kworker.0 00000100:00100000:0.0:1780997187.502358:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126932480:0@lo:400:kworker.0 00010000:00010000:2.0:1780997188.326076:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997188.357094:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:0.0:1780997188.357175:0:3491:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110392832 offset 0 length 224: 4 00000100:00100000:0.0:1780997188.357200:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997188.357251:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997188.357313:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110392960 00000100:00100000:1.0:1780997188.357324:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110392960 00000100:00100000:1.0:1780997188.357425:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1338 00000100:00100000:1.0:1780997188.357447:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110392960:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:1.0:1780997188.357472:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997188.357559:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1867507110392960:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 112us (357us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997188.357567:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1338 00000100:00100000:0.0:1780997188.359710:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997188.365521:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110393216 00000100:00100000:3.0:1780997188.365542:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110393216 00000100:00100000:3.0:1780997188.365626:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110393344 00000100:00100000:3.0:1780997188.365630:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110393344 00000100:00100000:3.0:1780997188.365672:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2610 00000100:00100000:3.0:1780997188.365683:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110393216:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997188.365910:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110393216:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 228us (8826us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997188.365920:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2610 00000100:00100000:3.0:1780997188.365945:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2611 00000100:00100000:3.0:1780997188.365952:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2396:x1867507110393344:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997188.365987:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2396:x1867507110393344:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (8750us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997188.366012:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2611 00000100:00080000:3.0:1780997188.366045:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997188.366050:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997188.367832:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110393088 00000100:00100000:2.0:1780997188.367848:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110393088 00000100:00100000:2.0:1780997188.367927:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1301 00000100:00100000:2.0:1780997188.367938:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2393:x1867507110393088:12345-192.168.206.51@tcp:38:kworker.0 00010000:02000400:2.0:1780997188.367971:0:65272:0:(ldlm_lib.c:951:target_handle_reconnect()) lustre-MDT0001: Client e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 (at 192.168.206.51@tcp) reconnecting 00000100:00080000:0.0:1780997188.368919:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1780997188.377476:0:65272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp t0 exp ffff968994767800 cur 3715 last 1780997188 00000004:00100000:2.0:1780997188.377527:0:65272:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli 192.168.206.51@tcp supports cksum type f7, return f7 00000100:00080000:2.0:1780997188.377555:0:65272:0:(import.c:65:import_set_state_nolock()) ffff968994764000 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1780997188.377566:0:65272:0:(import.c:65:import_set_state_nolock()) ffff968994764000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997188.377668:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2393:x1867507110393088:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 9731us (17963us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997188.377680:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1301 00000100:00100000:3.0:1780997188.387532:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997188.388058:0:63426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110390656 00000100:00100000:1.0:1780997188.388072:0:63426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110390656 00000100:00100000:1.0:1780997188.388138:0:63426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1780997188.388150:0:63426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:70338:x1867507110390656:12345-192.168.206.51@tcp:700:cp.0 00000100:00080000:1.0:1780997188.388220:0:63426:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9689a5d80000 x1867507126933376/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997188.388232:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:2.0:1780997188.517471:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00010000:00010000:2.0:1780997189.349582:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997189.413391:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:3.0:1780997189.543403:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00010000:00010000:0.0:1780997190.373711:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997190.437400:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:2.0:1780997190.568111:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00010000:00010000:3.0:1780997191.403576:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997191.461643:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:2.0:1780997191.599006:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00100000:3.0:1780997192.105406:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780997192.105448:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126933504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780997192.105550:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997192.105603:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126933504 00000100:00100000:3.0:1780997192.105613:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126933504 00000100:00080000:1.0:1780997192.105686:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997192.105691:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:3.0:1780997192.105702:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126933504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997192.105738:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997192.105799:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126933504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997192.105807:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:1.0:1780997192.105874:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126933504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997192.107463:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997192.107485:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126933632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997192.107569:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997192.107742:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126933632 00000100:00100000:0.0:1780997192.107753:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126933632 00000100:00100000:0.0:1780997192.107858:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1780997192.107869:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126933632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997192.107902:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997192.107956:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126933632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997192.107965:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00080000:1.0:1780997192.108097:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997192.108136:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126933632:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1780997192.421650:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997192.486373:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:2.0:1780997192.613523:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00080000:0.0:1780997192.613676:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997192.613683:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997192.613687:0:38:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997192.613698:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3715 00000100:00080000:0.0:1780997192.613724:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1780997192.613733:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997192.613766:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bff6c700 x1867507126933888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997192.613808:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997192.613813:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997192.613815:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997192.613820:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3715 00000100:00080000:0.0:1780997192.613822:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1780997192.613826:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997192.613837:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba655500 x1867507126934144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997192.613868:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997192.613872:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997192.613874:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997192.613877:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3715 00000100:00080000:0.0:1780997192.613881:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1780997192.613885:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997192.613897:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689ba655f80 x1867507126934400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997192.613920:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997192.613924:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997192.613926:0:38:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997192.613930:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3715 00000100:00080000:0.0:1780997192.613938:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1780997192.613942:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997192.614120:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126933760:0@lo:400:kworker.0 00000400:00000100:1.0:1780997192.614208:0:3498:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126933760 offset 0 length 224: 4 00000100:00100000:1.0:1780997192.614296:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126934656:0@lo:400:kworker.0 00000100:00100000:1.0:1780997192.614339:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997192.614373:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997192.614380:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126934016:0@lo:400:kworker.0 00000100:00100000:1.0:1780997192.614409:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997192.614944:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126933888:0@lo:38:kworker.0 00000100:00100000:2.0:1780997192.614993:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997192.615017:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126934144:0@lo:38:kworker.0 00000100:00100000:2.0:1780997192.615040:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997192.615061:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126934400:0@lo:38:kworker.0 00000100:00100000:2.0:1780997192.615087:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997192.615131:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126934016 00000100:00100000:2.0:1780997192.615142:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126934016 00000100:00100000:2.0:1780997192.615215:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126933888 00000100:00100000:2.0:1780997192.615219:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126933888 00000100:00100000:2.0:1780997192.615236:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126934144 00000100:00100000:2.0:1780997192.615239:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126934144 00000100:00100000:2.0:1780997192.615258:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1780997192.615292:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126934016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997192.615361:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126934016:12345-0@lo:400:kworker.0 Request processed in 93us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997192.615369:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1780997192.615391:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1780997192.615395:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126933888:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997192.615550:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997192.615587:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126933888:12345-0@lo:38:kworker.0 Request processed in 190us (593us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997192.615594:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1780997192.615620:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:2.0:1780997192.615624:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126934144:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997192.615635:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997192.615730:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126934144:12345-0@lo:38:kworker.0 Request processed in 103us (688us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997192.615737:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:2.0:1780997192.615760:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126934400 00000100:00100000:2.0:1780997192.615765:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126934400 00000100:00100000:2.0:1780997192.615787:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017 00000100:00100000:2.0:1780997192.615791:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126934400:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997192.615802:0:80061:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997192.615829:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126934400:12345-0@lo:38:kworker.0 Request processed in 37us (741us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997192.615836:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017 00000100:00080000:2.0:1780997192.615852:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997192.615911:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997192.615918:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997192.615922:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126933888:0@lo:38:kworker.0 00000100:00080000:2.0:1780997192.615933:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997192.615936:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997192.615939:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126934144:0@lo:38:kworker.0 00000100:00080000:2.0:1780997192.615948:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997192.615951:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997192.615954:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126934400:0@lo:38:kworker.0 00000100:00100000:0.0:1780997192.616122:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b4700 x1867507126934784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997192.616180:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126934272:0@lo:400:kworker.0 00000100:00100000:0.0:1780997192.616224:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997192.616326:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126934784:0@lo:38:kworker.0 00000100:00100000:2.0:1780997192.616385:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126934016:0@lo:400:kworker.0 00000100:00100000:0.0:1780997192.616545:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997192.616553:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126934528:0@lo:400:kworker.0 00000100:00100000:0.0:1780997192.616583:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997192.616620:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126934656 00000100:00100000:0.0:1780997192.616626:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126934656 00000100:00100000:0.0:1780997192.616675:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126934528 00000100:00100000:0.0:1780997192.616679:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126934528 00000100:00100000:0.0:1780997192.616699:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:0.0:1780997192.616706:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126934656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997192.616749:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126934656:12345-0@lo:400:kworker.0 Request processed in 43us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997192.616756:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:0.0:1780997192.616769:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:0.0:1780997192.616775:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126934528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997192.616804:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126934528:12345-0@lo:400:kworker.0 Request processed in 29us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997192.616810:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00100000:0.0:1780997192.616842:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126934528:0@lo:400:kworker.0 00000100:00100000:2.0:1780997192.617005:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997192.617658:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126934656:0@lo:400:kworker.0 00000100:00100000:1.0:1780997192.617811:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126934272 00000100:00100000:1.0:1780997192.617819:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126934272 00000100:00100000:1.0:1780997192.617873:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126934784 00000100:00100000:1.0:1780997192.617877:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126934784 00000100:00100000:1.0:1780997192.617892:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:1.0:1780997192.617900:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126934272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997192.617978:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126934272:12345-0@lo:400:kworker.0 Request processed in 78us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997192.617987:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:1.0:1780997192.618006:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:1.0:1780997192.618011:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126934784:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997192.618030:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997192.618061:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126934784:12345-0@lo:38:kworker.0 Request processed in 49us (1056us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997192.618067:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00080000:2.0:1780997192.618185:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997192.618209:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997192.618216:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997192.618219:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126934784:0@lo:38:kworker.0 00000100:00100000:1.0:1780997192.618850:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126934272:0@lo:400:kworker.0 00010000:00010000:2.0:1780997193.445659:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997193.480353:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997193.480392:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997193.480553:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:0.0:1780997193.480572:0:3491:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110393600 offset 0 length 224: 4 00000100:00100000:0.0:1780997193.480593:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997193.480624:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110393728 00000100:00100000:0.0:1780997193.480637:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110393728 00000100:00100000:0.0:1780997193.480679:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110393856 00000100:00100000:0.0:1780997193.480682:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110393856 00000100:00100000:0.0:1780997193.480730:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1304 00000100:00100000:0.0:1780997193.480742:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2395:x1867507110393856:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997193.480864:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110393984 00000100:00100000:3.0:1780997193.480869:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110393984 00000100:00100000:3.0:1780997193.480901:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110394112 00000100:00100000:3.0:1780997193.480903:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110394112 00000100:00100000:3.0:1780997193.480930:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5953 00000100:00100000:3.0:1780997193.480937:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2393:x1867507110393984:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:3.0:1780997193.480963:0:25170:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ab04 00000100:00080000:3.0:1780997193.480974:0:25170:0:(import.c:65:import_set_state_nolock()) ffff9689a67f5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780997193.481035:0:25170:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:3.0:1780997193.481229:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+2:2393:x1867507110393984:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 291us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997193.481245:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5953 00000100:00100000:3.0:1780997193.481263:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5954 00000100:00100000:3.0:1780997193.481290:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2393:x1867507110394112:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:3.0:1780997193.481306:0:25170:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ab0b 00000100:00080000:3.0:1780997193.481312:0:25170:0:(import.c:65:import_set_state_nolock()) ffff9689868b9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780997193.481337:0:25170:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:3.0:1780997193.481493:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+2:2393:x1867507110394112:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 222us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997193.481500:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5954 00010000:00010000:3.0:1780997193.484031:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997193.484151:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1342 00000100:00100000:1.0:1780997193.484162:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110393728:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:1.0:1780997193.484194:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997193.485337:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2395:x1867507110393856:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 4588us (4732us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997193.485350:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1304 00000100:00080000:0.0:1780997193.485528:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997193.485535:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780997193.485540:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1780997193.485558:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997193.489968:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110393728:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 5785us (9608us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997193.490000:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1342 00000100:00100000:1.0:1780997193.510324:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00000400:1.0:1780997193.637703:0:3496:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780997177/real 1780997177] req@ffff9689b78dd500 x1867507126929024/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997193 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997193.637742:0:3496:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9689b78dd500 x1867507126929024/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997193 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997193.637750:0:3496:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1780997193.637753:0:3496:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1780997193.637756:0:3496:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.151@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1780997193.637758:0:3496:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1780997193.637762:0:3496:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689b78dd500 x1867507126929024/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997193 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997193.637769:0:3496:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689a5d83480 x1867507126931072/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997198 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997193.637783:0:3496:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689ba654380 x1867507126932224/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997203 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997193.637801:0:3496:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689bff6f800 x1867507126933760/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997208 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1780997193.637809:0:3496:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1780997193.637812:0:3496:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1780997193.637813:0:3496:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1780997193.637815:0:3496:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1780997193.637833:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126929024:0@lo:400:kworker.0 00000100:00100000:2.0:1780997193.637912:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126933760:0@lo:400:kworker.0 00000100:00100000:2.0:1780997193.637919:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126932224:0@lo:400:kworker.0 00000100:00100000:3.0:1780997193.638024:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126931072:0@lo:400:kworker.0 00000100:00100000:0.0:1780997193.638103:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00080000:0.0:1780997193.638118:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997193.638123:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1780997193.638126:0:38:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997193.638131:0:38:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3673 00000100:00080000:0.0:1780997193.638139:0:38:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997193.638170:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b4000 x1867507126934912/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997193.638195:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997193.638199:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997193.638201:0:38:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997193.638218:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3720 00000100:00080000:0.0:1780997193.638220:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997193.638225:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997193.638240:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b7b80 x1867507126935040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997193.638291:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997193.638296:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997193.638297:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997193.638301:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3720 00000100:00080000:0.0:1780997193.638303:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997193.638307:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997193.638319:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b4a80 x1867507126935296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997193.638432:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126934912:0@lo:250:kworker.0 00000400:00000100:2.0:1780997193.638476:0:3495:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126934912 offset 0 length 520: 4 00000100:00100000:2.0:1780997193.638530:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126935040:0@lo:38:kworker.0 00000100:00100000:2.0:1780997193.638563:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997193.638584:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126935296:0@lo:38:kworker.0 00000100:00100000:2.0:1780997193.638604:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997193.638636:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126935040 00000100:00100000:2.0:1780997193.638643:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126935040 00000100:00100000:2.0:1780997193.638672:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126935296 00000100:00100000:2.0:1780997193.638675:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126935296 00000100:00100000:2.0:1780997193.638692:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:2.0:1780997193.638698:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126935040:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997193.638717:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997193.638764:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126935040:12345-0@lo:38:kworker.0 Request processed in 65us (200us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997193.638772:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:2.0:1780997193.638787:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:2.0:1780997193.638790:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126935296:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997193.638800:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997193.638823:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126935296:12345-0@lo:38:kworker.0 Request processed in 30us (218us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997193.638828:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00080000:2.0:1780997193.638866:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997193.638871:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997193.638874:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126935040:0@lo:38:kworker.0 00000100:00080000:2.0:1780997193.638882:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997193.638885:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997193.638887:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126935296:0@lo:38:kworker.0 00000100:00100000:3.0:1780997193.639088:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126935168:0@lo:400:kworker.0 00000100:00100000:3.0:1780997193.639118:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997193.639190:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997193.639193:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997193.639195:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997193.639199:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3720 00000100:00080000:0.0:1780997193.639202:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997193.639206:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997193.639225:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689854b4a80 x1867507126935552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997193.639256:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997193.639259:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997193.639260:0:38:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997193.639291:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3720 00000100:00080000:0.0:1780997193.639293:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997193.639297:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997193.639311:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f13800 x1867507126935936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997193.639332:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126935424:0@lo:400:kworker.0 00000100:00100000:3.0:1780997193.639680:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126935680:0@lo:400:kworker.0 00000100:00100000:3.0:1780997193.639710:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997193.639799:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126935680 00000100:00100000:3.0:1780997193.639805:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126935680 00000100:00100000:3.0:1780997193.639841:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:3.0:1780997193.639847:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126935680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997193.639892:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126935680:12345-0@lo:400:kworker.0 Request processed in 45us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997193.639899:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00100000:3.0:1780997193.639929:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126935680:0@lo:400:kworker.0 00000100:00100000:2.0:1780997193.640056:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126935168 00000100:00100000:2.0:1780997193.640061:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126935168 00000100:00100000:2.0:1780997193.640097:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:2.0:1780997193.640105:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126935168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997193.640138:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126935168:12345-0@lo:400:kworker.0 Request processed in 35us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997193.640143:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:2.0:1780997193.640163:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126935552:0@lo:38:kworker.0 00000100:00100000:2.0:1780997193.640188:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997193.640207:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126935936:0@lo:38:kworker.0 00000100:00100000:2.0:1780997193.640238:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997193.640266:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126935552 00000100:00100000:2.0:1780997193.640286:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126935552 00000100:00100000:2.0:1780997193.640307:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018 00000100:00100000:2.0:1780997193.640311:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126935552:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997193.640326:0:8242:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997193.640716:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126935936 00000100:00100000:3.0:1780997193.640727:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126935936 00000100:00100000:3.0:1780997193.640751:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1780997193.640755:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126935936:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997193.640766:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997193.640829:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126935808:0@lo:400:kworker.0 00000100:00100000:0.0:1780997193.641366:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997193.641437:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126935168:0@lo:400:kworker.0 00000100:00100000:2.0:1780997193.641806:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126935552:12345-0@lo:38:kworker.0 Request processed in 1492us (1615us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997193.641813:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018 00000100:00100000:2.0:1780997193.641838:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126935424 00000100:00100000:2.0:1780997193.641843:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126935424 00000100:00100000:2.0:1780997193.641869:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1780997193.641875:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126935424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997193.641916:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126935424:12345-0@lo:400:kworker.0 Request processed in 42us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997193.641922:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1780997193.641962:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126935424:0@lo:400:kworker.0 00000100:00080000:0.0:1780997193.642046:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997193.642051:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997193.642054:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126935552:0@lo:38:kworker.0 00000100:00100000:3.0:1780997193.643110:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126935936:12345-0@lo:38:kworker.0 Request processed in 2348us (2866us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997193.643119:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00080000:2.0:1780997193.643742:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997193.643748:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997193.643752:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126935936:0@lo:38:kworker.0 00000100:00100000:1.0:1780997193.647014:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997193.647304:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126935808 00000100:00100000:1.0:1780997193.647323:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126935808 00000100:00100000:1.0:1780997193.647369:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00100000:1.0:1780997193.647379:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126935808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997193.647438:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126935808:12345-0@lo:400:kworker.0 Request processed in 61us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997193.647445:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00100000:1.0:1780997193.647502:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126935808:0@lo:400:kworker.0 00010000:00010000:0.0:1780997194.475514:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997194.533868:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:2.0:1780997194.661436:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00100000:3.0:1780997194.678009:0:63427:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:3.0:1780997194.678038:0:63427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00010000:00010000:2.0:1780997195.495173:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997195.559973:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:2.0:1780997195.687453:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000020:01000004:1.0:1780997195.708237:0:88339:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1780997195.708243:0:88339:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1780997195.708245:0:88339:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1780997195.708591:0:88339:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9689a5870800 00000020:01000004:1.0:1780997195.708607:0:88339:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1780997195.708621:0:88339:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1780997195.708637:0:88339:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff96888ac53380) 00000020:00000080:1.0:1780997195.708654:0:88339:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1780997195.768781:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1780997195.768991:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1780997195.772091:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1780997195.772540:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1780997195.772919:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1780997195.775371:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1780997195.777008:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1780997195.777723:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1780997195.780209:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1780997195.780804:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1780997195.781027:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1780997195.781362:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1780997195.781685:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1780997195.781905:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1780997195.784574:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1780997195.795108:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.795527:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.796620:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.796973:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.797233:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.797681:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.797878:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.798083:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.798481:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.798844:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.799057:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.799259:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.799687:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.799897:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.800085:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.800496:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.800707:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.800908:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.801628:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.801964:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.802227:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.802637:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.802896:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.803159:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.803510:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.803754:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.803983:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.804230:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.805005:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1780997195.805368:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.805631:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.809841:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1780997195.811001:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1780997195.811587:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1780997195.811771:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1780997195.812721:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1780997195.812949:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1780997195.813480:0:88339:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1780997195.813997:0:88339:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1780997195.814220:0:88339:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1780997195.814229:0:88339:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1780997195.814239:0:88339:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305ab97 00000020:01000004:1.0:1780997195.814245:0:88339:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1780997195.814258:0:88339:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1780997195.814263:0:88339:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9689a5870800 from MGS 00000020:01000004:1.0:1780997195.814267:0:88339:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1780997195.814319:0:88339:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff96888ac50000) 00000020:00000080:1.0:1780997195.814332:0:88339:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1780997195.814390:0:88339:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689a5870800 from MGS, refs=2 00080000:01000000:1.0:1780997195.814394:0:88339:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1780997195.814399:0:88339:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305aba5 00010000:00010000:1.0:1780997195.814525:0:88339:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1780997195.823181:0:88339:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1780997195.825079:0:88343:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1780997195.825136:0:88339:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1780997195.825187:0:88339:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1780997195.826737:0:88339:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1780997195.826998:0:88339:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1780997195.827153:0:88339:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1780997195.827159:0:88339:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1780997195.828252:0:88339:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1780997195.828262:0:88339:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1780997195.828929:0:88339:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1780997195.828937:0:88339:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1780997195.829934:0:88339:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1780997195.829960:0:88339:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1780997195.829962:0:88339:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1780997195.829966:0:88339:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1780997195.829971:0:88339:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96898d0e6000 already not connected (conn 72, was 0): CONNECTING 00000100:00100000:2.0:1780997195.829977:0:88339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00010000:00010000:3.0:1780997196.517641:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997196.548383:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997196.548545:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110394240 00000100:00100000:2.0:1780997196.548556:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110394240 00000100:00100000:2.0:1780997196.548610:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1780997196.548619:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2393:x1867507110394240:12345-192.168.206.51@tcp:250:kworker.0 00010000:00080000:2.0:1780997196.548649:0:88344:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp t0 exp 0000000000000000 cur 3724 last 0 00000020:00000080:2.0:1780997196.548691:0:88344:0:(genops.c:1406:class_connect()) connect: client cf5d474c-5b3a-4e23-b534-5ea64925b132, cookie 0x30fd811c0305abac 00000100:00080000:2.0:1780997196.548808:0:88344:0:(import.c:65:import_set_state_nolock()) ffff9689ba675000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997196.548896:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+4:2393:x1867507110394240:12345-192.168.206.51@tcp:250:kworker.0 Request processed in 277us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997196.548905:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1780997196.549330:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997196.549363:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997196.549506:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110394368 00000100:00100000:0.0:1780997196.549514:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110394368 00000100:00100000:0.0:1780997196.549550:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110394496 00000100:00100000:0.0:1780997196.549571:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110394496 00000100:00100000:0.0:1780997196.549628:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1307 00000100:00100000:0.0:1780997196.549638:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2395:x1867507110394496:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:3.0:1780997196.549664:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997196.549703:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2395:x1867507110394496:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 66us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997196.549707:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1346 00000100:00100000:0.0:1780997196.549720:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1307 00000100:00100000:3.0:1780997196.549721:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1867507110394368:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:3.0:1780997196.549743:0:63418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997196.549772:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1867507110394368:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 56us (445us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997196.549779:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1346 00000100:00100000:0.0:1780997196.581677:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:2.0:1780997196.709387:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00100000:0.0:1780997197.221900:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126936064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997197.222008:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997197.222218:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126936192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997197.222254:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997197.222750:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126936064 00000100:00100000:3.0:1780997197.222760:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126936064 00000100:00100000:3.0:1780997197.222847:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126936192 00000100:00100000:3.0:1780997197.222850:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126936192 00000100:00100000:3.0:1780997197.222879:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:3.0:1780997197.222891:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126936064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997197.222954:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997197.223018:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126936064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997197.223027:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00100000:3.0:1780997197.223045:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:3.0:1780997197.223052:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126936192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997197.223070:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997197.223101:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126936192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997197.223108:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00100000:3.0:1780997197.223175:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126936064:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1780997197.223491:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997197.223496:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997197.223738:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126936192:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1780997197.543447:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997197.606194:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:1.0:1780997197.647644:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997197.648575:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110394624 00000100:00100000:3.0:1780997197.648588:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110394624 00000100:00100000:3.0:1780997197.648704:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1780997197.648715:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+4:70253:x1867507110394624:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997197.648734:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997197.648755:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce3800/0x30fd811c0305abb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d2f expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997197.648784:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce3800/0x30fd811c0305abb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d2f expref: 5 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997197.648796:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce3800/0x30fd811c0305abb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d2f expref: 5 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997197.648806:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3800, rc 0) 00000100:00100000:3.0:1780997197.648891:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+5:70253:x1867507110394624:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 177us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997197.648899:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1780997197.658777:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997197.666122:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110394752 00000100:00100000:3.0:1780997197.666138:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110394752 00000100:00100000:3.0:1780997197.666196:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1780997197.666206:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+5:70253:x1867507110394752:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1780997197.666319:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+5:70253:x1867507110394752:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 Request processed in 113us (7550us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780997197.666327:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1780997197.683904:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997197.684106:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110394880 00000100:00100000:3.0:1780997197.684118:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110394880 00000100:00100000:3.0:1780997197.684257:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1780997197.684308:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+5:70253:x1867507110394880:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997197.684327:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997197.684350:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce3000/0x30fd811c0305abba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d36 expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997197.684380:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce3000/0x30fd811c0305abba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d36 expref: 6 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997197.684405:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce3000/0x30fd811c0305abba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d36 expref: 6 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997197.684416:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3000, rc 0) 00000100:00100000:3.0:1780997197.684487:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+6:70253:x1867507110394880:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 221us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997197.684511:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:1.0:1780997197.692190:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997197.692544:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110395008 00000100:00100000:0.0:1780997197.692556:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110395008 00000100:00100000:0.0:1780997197.692613:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1780997197.692624:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+6:70253:x1867507110395008:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1780997197.697825:0:88348:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1780997197.700198:0:88344:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 116 20000000:01000000:0.0:1780997197.702350:0:88349:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1780997197.702358:0:88349:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1780997197.702362:0:88349:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1780997197.702365:0:88349:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1780997197.702667:0:88349:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1780997197.702957:0:88344:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1780997197.703045:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70253:x1867507110395008:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 10417us (10858us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997197.703058:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1780997197.705320:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997197.705400:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110395136 00000100:00100000:3.0:1780997197.705410:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110395136 00000100:00100000:3.0:1780997197.705487:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1780997197.705496:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70253:x1867507110395136:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997197.705634:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70253:x1867507110395136:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 138us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997197.705642:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:1.0:1780997197.714153:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997197.714568:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110395264 00000100:00100000:2.0:1780997197.714579:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110395264 00000100:00100000:2.0:1780997197.714633:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1780997197.714643:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70253:x1867507110395264:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997197.714660:0:88344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997197.714682:0:88344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc843200/0x30fd811c0305abc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d3d expref: -99 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997197.714709:0:88344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc843200/0x30fd811c0305abc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d3d expref: 8 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997197.714721:0:88344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc843200/0x30fd811c0305abc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d3d expref: 8 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997197.714731:0:88344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc843200, rc 0) 00000100:00100000:2.0:1780997197.714791:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110395264:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 149us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997197.714798:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1780997197.718698:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997197.718809:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110395392 00000100:00100000:0.0:1780997197.718819:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110395392 00000100:00100000:0.0:1780997197.718875:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1780997197.718885:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110395392:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997197.719139:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110395392:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 255us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997197.719166:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1780997197.724413:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997197.724573:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110395520 00000100:00100000:3.0:1780997197.724584:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110395520 00000100:00100000:3.0:1780997197.724654:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1780997197.724665:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110395520:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997197.724831:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110395520:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 168us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997197.724839:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:1.0:1780997197.733111:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997197.733722:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110395648 00000100:00100000:0.0:1780997197.733733:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110395648 00000100:00100000:0.0:1780997197.733788:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1780997197.733799:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110395648:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997197.733816:0:88345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997197.733837:0:88345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305abc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d44 expref: -99 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997197.733867:0:88345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305abc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d44 expref: 9 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997197.733880:0:88345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305abc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d44 expref: 9 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997197.733888:0:88345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4eec00, rc 0) 00000100:00100000:0.0:1780997197.733954:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110395648:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 156us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997197.733961:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1780997197.734566:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00100000:1.0:1780997197.744538:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997197.744690:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110395776 00000100:00100000:3.0:1780997197.744699:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110395776 00000100:00100000:3.0:1780997197.744757:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1780997197.744767:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110395776:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997197.744877:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110395776:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 111us (348us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780997197.744885:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00010000:00010000:0.0:1780997198.566860:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997198.597119:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997198.597166:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997198.597322:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110396032 00000100:00100000:2.0:1780997198.597323:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110395904 00000100:00100000:3.0:1780997198.597333:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110396032 00000100:00100000:2.0:1780997198.597334:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110395904 00000100:00100000:2.0:1780997198.597401:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1308 00000100:00100000:3.0:1780997198.597414:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1347 00000100:00100000:2.0:1780997198.597417:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2395:x1867507110396032:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997198.597425:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110395904:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:3.0:1780997198.597447:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997198.597510:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2395:x1867507110396032:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 99us (400us total) trans 0 rc 0/0 00000100:00080000:1.0:1780997198.597512:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997198.597521:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1308 00000100:00100000:3.0:1780997198.603549:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110395904:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 6114us (6369us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997198.603566:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1347 00000100:00100000:0.0:1780997198.629578:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00080000:0.0:1780997198.757398:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997198.757407:0:13646:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1780997198.757410:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997198.757414:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997198.757433:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997198.757441:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3721 00000100:00080000:0.0:1780997198.757446:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997198.757462:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997198.757472:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00100000:0.0:1780997198.757502:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f12d80 x1867507126936320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997198.757562:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1780997198.757568:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126936320:0@lo:38:kworker.0 00000100:00080000:0.0:1780997198.757568:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997198.757570:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997198.757575:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3721 00000100:00080000:0.0:1780997198.757577:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997198.757581:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997198.757595:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f11f80 x1867507126936576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997198.757624:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997198.757627:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997198.757628:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997198.757632:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3721 00000100:00080000:0.0:1780997198.757634:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997198.757638:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997198.757650:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f12a00 x1867507126936832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997198.757667:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997198.757676:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997198.757680:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997198.757688:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997198.757705:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3721 00000100:00080000:0.0:1780997198.757708:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997198.757713:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997198.757726:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126936576:0@lo:38:kworker.0 00000100:00100000:2.0:1780997198.757753:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997198.757772:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126936832:0@lo:38:kworker.0 00000100:00100000:0.0:1780997198.757794:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f11880 x1867507126937216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997198.757803:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997198.757829:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126937216:0@lo:38:kworker.0 00000100:00100000:0.0:1780997198.757851:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126936320 00000100:00100000:2.0:1780997198.757853:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997198.757859:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126936320 00000100:00100000:2.0:1780997198.757886:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126936832 00000100:00100000:2.0:1780997198.757891:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126936832 00000100:00100000:0.0:1780997198.757894:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126936576 00000100:00100000:0.0:1780997198.757898:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126936576 00000100:00100000:0.0:1780997198.757919:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126937216 00000100:00100000:2.0:1780997198.757923:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019 00000100:00100000:0.0:1780997198.757923:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126937216 00000100:00100000:2.0:1780997198.757934:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126936832:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1780997198.757941:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1780997198.757947:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126936320:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997198.757959:0:80061:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1780997198.757961:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997198.758005:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126936320:12345-0@lo:38:kworker.0 Request processed in 57us (340us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997198.758011:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1780997198.758025:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1780997198.758029:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126936576:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997198.758037:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997198.758056:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126936576:12345-0@lo:38:kworker.0 Request processed in 26us (304us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997198.758061:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1780997198.758334:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126937088:0@lo:400:kworker.0 00000100:00100000:1.0:1780997198.758364:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997198.758386:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997198.758392:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126936448:0@lo:400:kworker.0 00000100:00100000:1.0:1780997198.758412:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997198.758434:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126937088 00000100:00100000:1.0:1780997198.758438:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126937088 00000100:00100000:1.0:1780997198.758478:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:1.0:1780997198.758484:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126937088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997198.758522:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126937088:12345-0@lo:400:kworker.0 Request processed in 38us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997198.758528:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00100000:1.0:1780997198.758561:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126937088:0@lo:400:kworker.0 00000100:00100000:1.0:1780997198.758591:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126936704:0@lo:400:kworker.0 00000100:00100000:1.0:1780997198.758614:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997198.758626:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997198.758631:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126936960:0@lo:400:kworker.0 00000100:00100000:1.0:1780997198.758650:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997198.758680:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126936448 00000100:00100000:1.0:1780997198.758684:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126936448 00000100:00100000:2.0:1780997198.758788:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126936832:12345-0@lo:38:kworker.0 Request processed in 854us (989us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997198.758796:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019 00000100:00100000:2.0:1780997198.758819:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126936704 00000100:00100000:2.0:1780997198.758822:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126936704 00000100:00100000:3.0:1780997198.758897:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126936960 00000100:00100000:3.0:1780997198.758902:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126936960 00000100:00100000:3.0:1780997198.758928:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00000100:00100000:3.0:1780997198.758935:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126936960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997198.758964:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1780997198.758975:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126937216:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1780997198.758978:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126936960:12345-0@lo:400:kworker.0 Request processed in 42us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997198.758988:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00010000:00020000:0.0:1780997198.759003:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997198.759034:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126936960:0@lo:400:kworker.0 00000100:00100000:0.0:1780997198.759045:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126937216:12345-0@lo:38:kworker.0 Request processed in 69us (1191us total) trans 0 rc -19/-19 00000100:00080000:3.0:1780997198.759102:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997198.759108:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997198.759111:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126937216:0@lo:38:kworker.0 00000100:00080000:3.0:1780997198.759120:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997198.759124:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997198.759126:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126936576:0@lo:38:kworker.0 00000100:00080000:3.0:1780997198.759135:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997198.759138:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997198.759141:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126936832:0@lo:38:kworker.0 00000100:00080000:3.0:1780997198.759149:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997198.759159:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997198.759163:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126936320:0@lo:38:kworker.0 00000100:00080000:3.0:1780997198.759293:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997198.760051:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:1.0:1780997198.760074:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126936448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997198.760130:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126936448:12345-0@lo:400:kworker.0 Request processed in 71us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997198.760136:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:1.0:1780997198.760174:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126936448:0@lo:400:kworker.0 00000100:00100000:2.0:1780997198.760414:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1780997198.760424:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126936704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997198.760474:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126936704:12345-0@lo:400:kworker.0 Request processed in 52us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997198.760480:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1780997198.760536:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1780997198.760540:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126936704:0@lo:400:kworker.0 00000001:00100000:2.0:1780997199.272848:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000020:00000080:2.0:1780997199.272856:0:8226:0:(genops.c:906:class_export_put()) final put ffff9689a67f1800/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000020:00000080:0.0:1780997199.273290:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff9689a67f1800/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 for lustre-OST0000 00000020:00000080:0.0:1780997199.273352:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689a67f5800 for lustre-OST0000 00000001:00100000:1.0:1780997199.273893:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000020:00000080:1.0:1780997199.273897:0:9294:0:(genops.c:906:class_export_put()) final put ffff96888964e800/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000020:00000080:2.0:1780997199.274012:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff96888964e800/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 for lustre-OST0001 00000020:00000080:2.0:1780997199.274049:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689868b9000 for lustre-OST0001 00010000:00010000:2.0:1780997199.589800:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997199.653384:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:0.0:1780997199.782770:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00010000:00010000:3.0:1780997200.615015:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997200.677770:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:0.0:1780997200.805411:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00010000:00010000:0.0:1780997201.637757:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997201.701412:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:0.0:1780997201.829395:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00100000:0.0:1780997202.342739:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997202.342769:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126937344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997202.342841:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997202.343009:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126937344 00000100:00100000:1.0:1780997202.343019:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126937344 00000100:00100000:1.0:1780997202.343080:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:1.0:1780997202.343091:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126937344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780997202.343124:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780997202.343171:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126937344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997202.343178:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:1.0:1780997202.343232:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126937344:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1780997202.343531:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997202.344352:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997202.344368:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126937472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997202.344427:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997202.344597:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126937472 00000100:00100000:3.0:1780997202.344604:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126937472 00000100:00100000:3.0:1780997202.344661:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:3.0:1780997202.344670:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126937472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997202.344693:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997202.344743:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126937472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997202.344750:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00100000:2.0:1780997202.344883:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126937472:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780997202.344939:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1780997202.661678:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997202.725377:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:0.0:1780997202.854634:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00010000:00010000:2.0:1780997203.685558:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997203.715315:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997203.715367:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997203.715519:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110396160 00000100:00100000:2.0:1780997203.715529:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110396160 00000100:00100000:2.0:1780997203.715588:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1780997203.715599:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110396160:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997203.715688:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110396160:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 90us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997203.715695:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1780997203.716387:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110396416 00000100:00100000:3.0:1780997203.716393:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110396416 00000100:00100000:3.0:1780997203.716462:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1311 00000100:00100000:3.0:1780997203.716471:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2394:x1867507110396416:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997203.716515:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2394:x1867507110396416:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997203.716522:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1311 00000100:00080000:0.0:1780997203.719591:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997203.719752:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997203.719968:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110396288 00000100:00100000:3.0:1780997203.719978:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110396288 00000100:00100000:3.0:1780997203.720031:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1351 00000100:00100000:3.0:1780997203.720040:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110396288:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:3.0:1780997203.720064:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997203.720584:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110396288:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 541us (834us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997203.720610:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1351 00000100:00100000:0.0:1780997203.749913:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00080000:0.0:1780997203.877382:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1780997203.877391:0:3495:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780997193/real 1780997193] req@ffff9689854b4000 x1867507126934912/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780997203 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997203.877399:0:13646:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1780997203.877402:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997203.877405:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997203.877409:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1780997203.877431:0:3495:0:(client.c:2511:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9689854b4000 x1867507126934912/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780997203 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997203.877440:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3726 00000100:00080000:0.0:1780997203.877444:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997203.877448:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997203.877450:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00080000:2.0:1780997203.877473:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1780997203.877485:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126934912:0@lo:250:kworker.0 00000100:00100000:0.0:1780997203.877487:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f10000 x1867507126937600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997203.877510:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126937600:0@lo:38:kworker.0 00000100:00080000:0.0:1780997203.877518:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997203.877522:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997203.877523:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997203.877526:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3726 00000100:00080000:0.0:1780997203.877528:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997203.877531:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997203.877540:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f13480 x1867507126937856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997203.877561:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997203.877563:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997203.877565:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1780997203.877568:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997203.877568:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3726 00000100:00080000:0.0:1780997203.877570:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997203.877574:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997203.877584:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f12d80 x1867507126938112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997203.877596:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126937856:0@lo:38:kworker.0 00000100:00080000:0.0:1780997203.877614:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1780997203.877617:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997203.877617:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997203.877619:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997203.877628:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3726 00000100:00080000:0.0:1780997203.877630:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1780997203.877633:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126938112:0@lo:38:kworker.0 00000100:00080000:0.0:1780997203.877634:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997203.877646:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f11880 x1867507126938496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997203.877659:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997203.877661:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1780997203.877663:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997203.877666:0:13646:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3721 00000100:00100000:2.0:1780997203.877667:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997203.877669:0:13646:0:(import.c:591:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1780997203.877672:0:13646:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997203.877681:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f10380 x1867507126938624/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997203.877685:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126938496:0@lo:38:kworker.0 00000100:00100000:0.0:1780997203.877704:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126938240:0@lo:400:kworker.0 00000100:00100000:2.0:1780997203.877705:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00020000:2.0:1780997203.877721:0:3495:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9689b7f10380 x1867507126938624/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997203.877731:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997203.877752:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997203.877757:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126937984:0@lo:400:kworker.0 00000100:00100000:0.0:1780997203.877777:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997203.877806:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126937600 00000100:00100000:0.0:1780997203.877812:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126937600 00000100:00100000:0.0:1780997203.877837:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126937856 00000100:00100000:0.0:1780997203.877839:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126937856 00000100:00100000:0.0:1780997203.877852:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126938496 00000100:00100000:0.0:1780997203.877855:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126938496 00000100:00100000:0.0:1780997203.877862:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126937984 00000100:00100000:0.0:1780997203.877864:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126937984 00000100:00100000:0.0:1780997203.877897:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:1.0:1780997203.877907:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00100000:0.0:1780997203.877907:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126937984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997203.877925:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1780997203.877929:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126937600:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997203.877948:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997203.877963:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126937984:12345-0@lo:400:kworker.0 Request processed in 58us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997203.877970:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:1.0:1780997203.877983:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126937600:12345-0@lo:38:kworker.0 Request processed in 52us (415us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997203.877987:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1780997203.877990:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:0.0:1780997203.877991:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126937856:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1780997203.878001:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00010000:00020000:0.0:1780997203.878001:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997203.878004:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126938496:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997203.878013:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997203.878020:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126937856:12345-0@lo:38:kworker.0 Request processed in 29us (403us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997203.878026:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1780997203.878029:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126938496:12345-0@lo:38:kworker.0 Request processed in 24us (324us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997203.878034:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:0.0:1780997203.878043:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126938240 00000100:00100000:0.0:1780997203.878046:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126938240 00000100:00100000:1.0:1780997203.878049:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126938368:0@lo:400:kworker.0 00000100:00100000:1.0:1780997203.878075:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997203.878082:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126938368 00000100:00100000:0.0:1780997203.878084:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126938368 00000100:00100000:0.0:1780997203.878104:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:1.0:1780997203.878106:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997203.878111:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126938240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997203.878112:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126937728:0@lo:400:kworker.0 00000100:00100000:1.0:1780997203.878134:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997203.878137:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126938240:12345-0@lo:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997203.878143:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1780997203.878153:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1780997203.878159:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126938368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997203.878172:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126937728 00000100:00100000:1.0:1780997203.878175:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126937728 00000100:00100000:0.0:1780997203.878188:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126938368:12345-0@lo:400:kworker.0 Request processed in 30us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997203.878194:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:1.0:1780997203.878199:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:1.0:1780997203.878204:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126937728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997203.878230:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126937728:12345-0@lo:400:kworker.0 Request processed in 25us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997203.878235:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00080000:1.0:1780997203.878256:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997203.878318:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126937984:0@lo:400:kworker.0 00000100:00100000:1.0:1780997203.878328:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126938240:0@lo:400:kworker.0 00000100:00100000:1.0:1780997203.878358:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126937728:0@lo:400:kworker.0 00000100:00100000:1.0:1780997203.878374:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126938368:0@lo:400:kworker.0 10000000:01000000:0.0:1780997203.878397:0:88339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1780997203.878412:0:88339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96888956e400/0x30fd811c0305a761 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a768 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997203.878446:0:88339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96888956e400/0x30fd811c0305a761 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a768 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997203.878451:0:88339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1780997203.878472:0:88339:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997203.878482:0:88339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96888956e400/0x30fd811c0305a761 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a768 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.878501:0:88339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03600/0x30fd811c0305a6c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a6ce expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997203.878507:0:88339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03600/0x30fd811c0305a6c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a6ce expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997203.878512:0:88339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997203.878516:0:88339:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997203.878519:0:88339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03600/0x30fd811c0305a6c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a6ce expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.878528:0:88339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96888956ec00/0x30fd811c0305a6e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a6ea expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997203.878534:0:88339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96888956ec00/0x30fd811c0305a6e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a6ea expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997203.878539:0:88339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997203.878543:0:88339:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997203.878546:0:88339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96888956ec00/0x30fd811c0305a6e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a6ea expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997203.878552:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126938112 00000100:00100000:3.0:1780997203.878557:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126938112 00010000:00010000:0.0:1780997203.878564:0:88339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305a70d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a714 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997203.878571:0:88339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305a70d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a714 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997203.878576:0:88339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1780997203.878578:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00010000:00010000:0.0:1780997203.878579:0:88339:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:3.0:1780997203.878584:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126938112:12345-0@lo:38:kworker.0 00010000:00010000:0.0:1780997203.878584:0:88339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305a70d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a714 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.878592:0:88339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305a71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a722 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:3.0:1780997203.878595:0:8242:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 10000000:00010000:0.0:1780997203.878598:0:88339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305a71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a722 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997203.878603:0:88339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997203.878606:0:88339:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997203.878609:0:88339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305a71b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a722 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.878618:0:88339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96888956f400/0x30fd811c0305a737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a73e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997203.878622:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126938112:12345-0@lo:38:kworker.0 Request processed in 39us (955us total) trans 0 rc -19/-19 10000000:00010000:0.0:1780997203.878625:0:88339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96888956f400/0x30fd811c0305a737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a73e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997203.878628:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 10000000:01000000:0.0:1780997203.878630:0:88339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997203.878639:0:88339:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997203.878643:0:88339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96888956f400/0x30fd811c0305a737 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a73e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.878652:0:88339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305a745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a74c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997203.878658:0:88339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305a745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a74c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997203.878663:0:88339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997203.878666:0:88339:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997203.878670:0:88339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305a745 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a74c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.878678:0:88339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96888956ee00/0x30fd811c0305a76f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a776 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997203.878684:0:88339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96888956ee00/0x30fd811c0305a76f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a776 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997203.878689:0:88339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997203.878695:0:88339:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997203.878698:0:88339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96888956ee00/0x30fd811c0305a76f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a776 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.878710:0:88339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96888956fc00/0x30fd811c0305a6d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a6dc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997203.878716:0:88339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96888956fc00/0x30fd811c0305a6d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a6dc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997203.878732:0:88339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997203.878747:0:88339:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997203.878751:0:88339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96888956fc00/0x30fd811c0305a6d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a6dc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.878764:0:88339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305a6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a6f8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997203.878771:0:88339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305a6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a6f8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997203.878776:0:88339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997203.878781:0:88339:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997203.878785:0:88339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305a6f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a6f8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.878796:0:88339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305a6ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a706 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997203.878803:0:88339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305a6ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a706 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997203.878808:0:88339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780997203.878819:0:88339:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997203.878823:0:88339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305a6ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a706 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.878831:0:88339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff96888956f800/0x30fd811c0305a729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a730 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997203.878848:0:88339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff96888956f800/0x30fd811c0305a729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a730 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997203.878854:0:88339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780997203.878858:0:88339:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997203.878862:0:88339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff96888956f800/0x30fd811c0305a729 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a730 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.878870:0:88339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305a753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305a75a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997203.878876:0:88339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305a753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305a75a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997203.878882:0:88339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780997203.878886:0:88339:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780997203.878889:0:88339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305a753 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305a75a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1780997203.897521:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997203.897521:0:88339:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96898d0e6000 already not connected (conn 73, was 0): CONNECTING 00000100:00080000:0.0:1780997203.897533:0:88339:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997203.897540:0:88339:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3731 00000100:00080000:0.0:1780997203.897546:0:88339:0:(import.c:591:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780997203.897553:0:88339:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00080000:2.0:1780997203.897558:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:2.0:1780997203.897565:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:0:1867507126938624:0@lo:250:kworker.0 00000100:00100000:0.0:1780997203.897590:0:88339:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f13100 x1867507126938752/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997203.897601:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997203.897606:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997203.897609:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126938496:0@lo:38:kworker.0 00000100:00080000:2.0:1780997203.897618:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997203.897621:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997203.897624:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126937856:0@lo:38:kworker.0 00000100:00080000:2.0:1780997203.897747:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997203.897751:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997203.897754:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126938112:0@lo:38:kworker.0 00000100:00080000:2.0:1780997203.897765:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997203.897768:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997203.897770:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126937600:0@lo:38:kworker.0 00000100:00080000:3.0:1780997203.897872:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997203.897878:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1780997203.898147:0:88339:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1780997203.898261:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126938752:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1780997203.898344:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997203.898868:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126938752 00000100:00100000:3.0:1780997203.898877:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126938752 00000100:00100000:3.0:1780997203.898918:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1780997203.898926:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3495:x1867507126938752:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1780997203.898951:0:88345:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo t0 exp 0000000000000000 cur 3731 last 0 00000020:00000080:3.0:1780997203.898977:0:88345:0:(genops.c:1406:class_connect()) connect: client bdcd4e03-8d56-43b8-bfda-3b2f97e67d18, cookie 0x30fd811c0305abcf 00000100:00080000:3.0:1780997203.899085:0:88345:0:(import.c:65:import_set_state_nolock()) ffff9689bfab0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780997203.899157:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:3495:x1867507126938752:12345-0@lo:250:mount.lustre.0 Request processed in 230us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997203.899165:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1780997203.899244:0:3495:0:(client.c:3131:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 27 00000100:00080000:2.0:1780997203.899264:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:2.0:1780997203.899290:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1780997203.899296:0:3495:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1780997203.899300:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1780997203.899302:0:3495:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1780997203.899330:0:3495:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1780997203.899341:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126938752:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1780997203.899696:0:88339:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1780997203.899715:0:88339:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1780997203.899751:0:88339:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 00000020:01000000:3.0:1780997203.899755:0:38:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.206.151@tcp 10000000:01000000:0.0:1780997203.899756:0:88339:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 10000000:01000000:3.0:1780997203.899768:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1780997203.899770:0:38:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1780997203.899772:0:38:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780997203.899784:0:38:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997203.899790:0:38:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997203.899791:0:38:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997203.899793:0:38:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997203.899794:0:38:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780997203.899796:0:38:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997203.899797:0:38:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1780997203.899843:0:38:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1780997203.899850:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000040:01000000:0.0:1780997203.899851:0:88339:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1780997203.899852:0:38:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1780997203.899853:0:38:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1780997203.899854:0:38:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997203.899855:0:38:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997203.899856:0:38:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997203.899857:0:38:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997203.899858:0:38:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780997203.899860:0:38:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997203.899861:0:38:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:0.0:1780997203.899873:0:88339:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1780997203.899876:0:88339:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000000:3.0:1780997203.899878:0:38:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000020:01000004:0.0:1780997203.899878:0:88339:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780997203.899879:0:88339:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997203.899880:0:88339:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997203.899881:0:88339:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 10000000:01000000:3.0:1780997203.899882:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1780997203.899883:0:88339:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997203.899884:0:38:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1780997203.899884:0:88339:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780997203.899885:0:38:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1780997203.899886:0:88339:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780997203.899887:0:38:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997203.899887:0:88339:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997203.899888:0:38:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997203.899888:0:88339:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1780997203.899889:0:38:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997203.899890:0:38:0:(tgt_mount.c:1151:server_mti_print()) flags: 10000000:01000000:0.0:1780997203.899890:0:88339:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1780997203.899892:0:38:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997203.899892:0:88339:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1780997203.899893:0:38:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997203.899893:0:88339:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780997203.899894:0:38:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:0.0:1780997203.899895:0:88339:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997203.899896:0:88339:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997203.899897:0:88339:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997203.899897:0:88339:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997203.899898:0:88339:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997203.899899:0:88339:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780997203.899900:0:88339:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997203.899901:0:88339:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000000:3.0:1780997203.899903:0:38:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1780997203.899912:0:88339:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1780997203.899923:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126939264:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1780997203.900012:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126939136:0@lo:253:kworker.0 00000100:00100000:1.0:1780997203.900054:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997203.900086:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780997203.900105:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126939008:0@lo:253:kworker.0 00000100:00100000:1.0:1780997203.900133:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997203.900163:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126939136 00000100:00100000:1.0:1780997203.900168:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126939136 00000100:00100000:1.0:1780997203.900198:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126939008 00000100:00100000:1.0:1780997203.900201:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126939008 00000100:00100000:1.0:1780997203.900213:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1780997203.900220:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:3497:x1867507126939136:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1780997203.900240:0:88344:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1780997203.900253:0:88344:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1780997203.900358:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997203.900368:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126938880:0@lo:253:kworker.0 00000100:00100000:1.0:1780997203.900398:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997203.900432:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126938880 00000100:00100000:1.0:1780997203.900436:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126938880 00000100:00100000:1.0:1780997203.900455:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1780997203.900461:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:3497:x1867507126939008:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1780997203.900477:0:88346:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1780997203.902374:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997203.902419:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982d77600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997203.904876:0:88345:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1780997203.904895:0:88345:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1780997203.905501:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126939264 00000100:00100000:2.0:1780997203.905512:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126939264 00000100:00100000:1.0:1780997203.905653:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1780997203.905665:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3498:x1867507126938880:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1780997203.905698:0:88351:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1780997203.908531:0:88344:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780997203.908544:0:88344:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1780997203.908690:0:88346:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1780997203.908886:0:88348:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1780997203.908892:0:88348:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1780997203.908912:0:88348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.908932:0:88348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968983ce3800/0x30fd811c0305abb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d2f expref: 8 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.908956:0:88348:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.908993:0:88348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968983ce3800/0x30fd811c0305abb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d2f expref: 8 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.909006:0:88348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968983ce3800/0x30fd811c0305abb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d2f expref: 8 pid: 88346 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997203.909020:0:88348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88348:1867507126939392:192.168.206.51@tcp:104: 00000100:00100000:0.0:1780997203.909364:0:88348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a5f5d600 going to sleep for 11 seconds 00000100:00100000:2.0:1780997203.909528:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3497:x1867507126939136:12345-0@lo:253:kworker.0 Request processed in 9306us (9471us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997203.909538:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1780997203.909571:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1780997203.909579:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:88339:x1867507126939264:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1780997203.909608:0:88344:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1780997203.909611:0:88344:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1780997203.909613:0:88344:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1780997203.909619:0:88344:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:1.0:1780997203.909698:0:3497:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1780997203.909701:0:3497:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1780997203.909702:0:3497:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997203.909703:0:3497:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997203.909705:0:3497:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997203.909706:0:3497:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997203.909708:0:3497:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780997203.909710:0:3497:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997203.909711:0:3497:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1780997203.909714:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126939136:0@lo:253:kworker.0 00000100:00100000:0.0:1780997203.913152:0:88348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88348:1867507126939392:192.168.206.51@tcp:104: 00010000:00010000:0.0:1780997203.913186:0:88348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997203.916144:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:88339:x1867507126939264:12345-0@lo:253:mount.lustre.0 Request processed in 6555us (13763us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997203.916159:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1780997203.916298:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126939264:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1780997203.916318:0:88339:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1780997203.916321:0:88339:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1780997203.916323:0:88339:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780997203.916324:0:88339:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997203.916325:0:88339:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997203.916326:0:88339:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997203.916327:0:88339:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997203.916329:0:88339:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780997203.916330:0:88339:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780997203.916332:0:88339:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997203.916333:0:88339:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1780997203.916365:0:88339:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9689a5870800 from lustre-MDT0000 10000000:01000000:1.0:1780997203.916399:0:88339:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1780997203.916403:0:88339:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1780997203.916411:0:88339:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9689a5870800 10000000:01000000:1.0:1780997203.916415:0:88339:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1780997203.916420:0:88339:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9689a5870800 10000000:01000000:1.0:1780997203.916433:0:88339:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1780997203.916437:0:88339:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9689a5870800 from 1 10000000:01000000:1.0:1780997203.916439:0:88339:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1780997203.916476:0:88339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997203.916506:0:88339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997203.916516:0:88339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997203.916538:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126939520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1780997203.916574:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997203.916602:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982d77600 going to sleep for 11 seconds 00000100:00100000:3.0:1780997203.917530:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126939520 00000100:00100000:3.0:1780997203.917539:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126939520 00000100:00100000:3.0:1780997203.917595:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1780997203.917606:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:88339:x1867507126939520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997203.917630:0:88344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997203.917647:0:88344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce2400/0x30fd811c0305abe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305abdd expref: -99 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.917673:0:88344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce2400/0x30fd811c0305abe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305abdd expref: 7 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.917685:0:88344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce2400/0x30fd811c0305abe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305abdd expref: 7 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.917695:0:88344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2400, rc 0) 00000100:00100000:3.0:1780997203.917752:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:88339:x1867507126939520:12345-0@lo:101:mount.lustre.0 Request processed in 147us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997203.917761:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1780997203.918679:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126939520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997203.918703:0:88339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.918715:0:88339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997203.918737:0:88339:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1780997203.918753:0:88339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.918762:0:88339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997203.918770:0:88339:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 20000000:01000000:2.0:1780997203.919489:0:88346:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780997203.919496:0:88346:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 10000000:01000000:3.0:1780997203.919947:0:88339:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1780997203.919955:0:88339:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9689a5870800 10000000:01000000:3.0:1780997203.919959:0:88339:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1780997203.919964:0:88339:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1780997203.919967:0:88339:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1780997203.920004:0:88339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.920015:0:88339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.920024:0:88339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997203.920049:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126939648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1780997203.920120:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997203.920160:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126939648 00000100:00100000:3.0:1780997203.920166:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126939648 00000100:00100000:3.0:1780997203.920206:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1780997203.920218:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:88339:x1867507126939648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997203.920232:0:88344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997203.920245:0:88344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce3c00/0x30fd811c0305abf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305abeb expref: -99 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.920268:0:88344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce3c00/0x30fd811c0305abf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305abeb expref: 8 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.920299:0:88344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce3c00/0x30fd811c0305abf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305abeb expref: 8 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.920321:0:88344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3c00, rc 0) 20000000:01000000:0.0:1780997203.920546:0:88351:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1780997203.921344:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688875b70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997203.921370:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126939648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997203.921403:0:88339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305abf2 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997203.921414:0:88339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305abf2 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997203.921494:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126939776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997203.922579:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:3497:x1867507126939008:12345-0@lo:253:kworker.0 Request processed in 22112us (22439us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997203.922593:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:2.0:1780997203.922657:0:3497:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1780997203.922660:0:3497:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1780997203.922661:0:3497:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780997203.922662:0:3497:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780997203.922663:0:3497:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780997203.922665:0:3497:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780997203.922678:0:3497:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780997203.922680:0:3497:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780997203.922681:0:3497:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1780997203.922685:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126939008:0@lo:253:kworker.0 00000100:00100000:3.0:1780997203.922829:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:88339:x1867507126939648:12345-0@lo:101:mount.lustre.0 Request processed in 2613us (2711us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997203.922836:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1780997203.922971:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997203.923043:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997203.923078:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982d77600 going to sleep for 11 seconds 00000100:00100000:0.0:1780997203.923130:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126939776 00000100:00100000:0.0:1780997203.923137:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126939776 00000100:00100000:0.0:1780997203.923175:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1780997203.923193:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:88339:x1867507126939776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780997203.923346:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:88339:x1867507126939776:12345-0@lo:501:mount.lustre.0 Request processed in 163us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997203.923353:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1780997203.923678:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126939776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780997203.923717:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126939904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780997203.923757:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997203.923783:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982d77600 going to sleep for 11 seconds 00000100:00100000:0.0:1780997203.923832:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126939904 00000100:00100000:0.0:1780997203.923836:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126939904 00000100:00100000:0.0:1780997203.923865:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1780997203.923879:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:88339:x1867507126939904:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780997203.924088:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110396544 00000100:00100000:3.0:1780997203.924093:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110396544 00010000:00010000:3.0:1780997203.924116:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968983ce3800/0x30fd811c0305abb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d2f expref: 9 pid: 88346 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997203.924144:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2562 00000100:00100000:3.0:1780997203.924151:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110396544:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780997203.924162:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997203.924167:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968983ce3800/0x30fd811c0305abb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d2f expref: 9 pid: 88346 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.924178:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968983ce3800/0x30fd811c0305abb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d2f expref: 9 pid: 88346 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.924259:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce3800/0x30fd811c0305abb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d2f expref: 9 pid: 88346 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.924304:0:25183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.924314:0:25183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780997203.924331:0:25183:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015440261s 00010000:00010000:3.0:1780997203.924343:0:25183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.924351:0:25183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.924358:0:25183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.924365:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.924372:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4efc00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997203.924376:0:25183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.924457:0:25183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.924480:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997203.924492:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997203.924539:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:2395:x1867507110396544:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 388us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997203.924547:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2562 00010000:00010000:2.0:1780997203.924869:0:88348:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997203.924879:0:88348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997203.924886:0:88348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bb4efc00/0x30fd811c0305abd6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997203.925098:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:88339:x1867507126939904:12345-0@lo:503:mount.lustre.0 Request processed in 1219us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997203.925107:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1780997203.925232:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126939904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780997203.925716:0:88352:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88352:1867507126940032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997203.925763:0:88352:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997203.925806:0:88352:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc784c00 going to sleep for 11 seconds 00000100:00100000:3.0:1780997203.925883:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126940032 00000100:00100000:3.0:1780997203.925890:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126940032 00000100:00100000:3.0:1780997203.925934:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1780997203.925942:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:88352:x1867507126940032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997203.926782:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:88352:x1867507126940032:12345-0@lo:502:llog_process_th.0 Request processed in 838us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997203.926789:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 20000000:01000000:2.0:1780997203.926873:0:88351:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780997203.926888:0:88351:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1780997203.926903:0:88348:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1780997203.926908:0:88348:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1780997203.926924:0:88348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689bb4ef600/0x30fd811c0305abf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.926936:0:88348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bb4ef600/0x30fd811c0305abf9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1780997203.926944:0:88348:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015440261s 00010000:00010000:0.0:1780997203.926949:0:88348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bb4ef600/0x30fd811c0305abf9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.926955:0:88348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bb4ef600/0x30fd811c0305abf9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.926963:0:88348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689bb4ef600/0x30fd811c0305abf9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.926970:0:88348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689bb4ef600/0x30fd811c0305abf9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.926977:0:88348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ef600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997203.926981:0:88348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689bb4ef600/0x30fd811c0305abf9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.926988:0:88348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689bb4ef600/0x30fd811c0305abf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.927001:0:88348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689bb4ef600/0x30fd811c0305abf9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.927022:0:88348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689bb4ef600/0x30fd811c0305abf9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997203.927029:0:88348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bb4ef600/0x30fd811c0305abf9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997203.927034:0:88352:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88352:1867507126940032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780997203.927246:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997203.927260:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997203.927262:0:88352:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1780997203.927267:0:88352:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1780997203.927340:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780997203.927354:0:88352:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff96888ac519c0) 00000020:00000080:1.0:1780997203.927375:0:88352:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:1.0:1780997203.927383:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1780997203.927475:0:88352:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1780997203.927482:0:88352:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305ac07 00000020:00000080:1.0:1780997203.927691:0:88352:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1780997203.927696:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997203.927700:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997203.927702:0:88352:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1780997203.927704:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997203.927708:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997203.927709:0:88352:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1780997203.927712:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780997203.927719:0:88352:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff96888ac54d40) 00000020:00000080:1.0:1780997203.927732:0:88352:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:1.0:1780997203.927737:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1780997203.927739:0:88352:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1780997203.927742:0:88352:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1780997203.927747:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1780997203.928039:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3498:x1867507126938880:12345-0@lo:253:kworker.0 Request processed in 22375us (27638us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997203.928049:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000004:3.0:1780997203.928083:0:3498:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1780997203.928087:0:3498:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780997203.928088:0:3498:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997203.928089:0:3498:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997203.928091:0:3498:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997203.928093:0:3498:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997203.928095:0:3498:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780997203.928096:0:3498:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997203.928097:0:3498:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1780997203.928100:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126938880:0@lo:253:kworker.0 00000020:01000004:1.0:1780997203.929619:0:88352:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689a5870800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1780997203.929643:0:88352:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9688858c19c0) 00000020:00000080:1.0:1780997203.929677:0:88352:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:1.0:1780997203.929752:0:88352:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1780997203.929757:0:88352:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305ac1c 00000020:00000080:1.0:1780997203.930017:0:88352:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1780997203.930024:0:88352:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1780997203.930029:0:88352:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x30fd811c0305ac23 00080000:01000000:1.0:1780997203.930035:0:88352:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1780997203.930039:0:88352:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305ac2a 00010000:00010000:2.0:1780997204.015565:0:88352:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1780997204.016567:0:88352:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149700 lx: 0 gen 21 00000001:00080000:2.0:1780997204.016614:0:88352:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 idx: 2 lr: 0 srv lr: 111669149700 lx: 0 gen 23 00000001:00000004:2.0:1780997204.016636:0:88352:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149700 00000001:00080000:2.0:1780997204.016922:0:88352:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1780997204.016979:0:88352:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9689bcb0e000: xid 1867507126925056, transno 111669149700, client gen 21, slot idx 0 00000020:00000080:2.0:1780997204.017548:0:88352:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff968990fe0000) 00000020:00000080:2.0:1780997204.017570:0:88352:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:2.0:1780997204.017639:0:88352:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1780997204.017646:0:88352:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305ac46 00000020:00000080:3.0:1780997204.021055:0:88352:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1780997204.029792:0:88352:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x30fd811c0305ac4d 00000020:00000080:2.0:1780997204.030125:0:88352:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1780997204.030138:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997204.030151:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997204.030154:0:88352:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1780997204.030158:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1780997204.030161:0:88352:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1780997204.030163:0:88352:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780997204.030165:0:88352:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780997204.030166:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1780997204.030169:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997204.030171:0:88352:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1780997204.030173:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780997204.030179:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997204.030180:0:88352:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1780997204.030184:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1780997204.030226:0:88352:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1780997204.030246:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997204.030248:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997204.030250:0:88352:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1780997204.030253:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780997204.030256:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997204.030257:0:88352:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1780997204.030261:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1780997204.030304:0:88352:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:00000080:2.0:1780997204.030334:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1780997204.030629:0:88352:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff968990fe19c0) 00000020:00000080:2.0:1780997204.030650:0:88352:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1780997204.030656:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1780997204.030711:0:88352:0:(osp_dev.c:1197:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1780997204.030716:0:88352:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1780997204.030723:0:88352:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305ac5b 00010000:00080000:2.0:1780997204.030753:0:88352:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689869cb800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:2.0:1780997204.033025:0:88352:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1780997204.039901:0:88352:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997204.039916:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1780997204.039949:0:88352:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1780997204.039971:0:88352:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305ac62 00000100:00080000:0.0:1780997204.039980:0:88352:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1780997204.039986:0:88352:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9689869cb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997204.040023:0:88352:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f10a80 x1867507126940160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997204.040055:0:88352:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1780997204.040111:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997204.040116:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997204.040118:0:88352:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1780997204.040120:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1780997204.040123:0:88352:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1780997204.040124:0:88352:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780997204.040126:0:88352:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780997204.040127:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1780997204.040129:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997204.040131:0:88352:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1780997204.040133:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1780997204.040138:0:88352:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1780997204.040142:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997204.040143:0:88352:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1780997204.040146:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1780997204.040156:0:88352:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:0.0:1780997204.040178:0:88352:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1780997204.040180:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780997204.040193:0:88352:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff968886ec3380) 00000020:00000080:0.0:1780997204.040208:0:88352:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1780997204.040212:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1780997204.040291:0:88352:0:(osp_dev.c:1197:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1780997204.040298:0:88352:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1780997204.040303:0:88352:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305ac70 00010000:00080000:0.0:1780997204.040333:0:88352:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689bcb9d000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1780997204.040527:0:88352:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1780997204.041843:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126940160:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780997204.041927:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997204.042487:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126940160 00000100:00100000:3.0:1780997204.042496:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126940160 00000100:00100000:3.0:1780997204.042535:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00100000:3.0:1780997204.042543:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126940160:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1780997204.042570:0:80061:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3731 last 0 00000020:00000080:3.0:1780997204.042602:0:80061:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305ac77 00000004:00100000:3.0:1780997204.042616:0:80061:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780997204.042701:0:80061:0:(import.c:65:import_set_state_nolock()) ffff9689bcd7d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780997204.042754:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126940160:12345-0@lo:38:llog_process_th.0 Request processed in 211us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997204.042762:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000100:00100000:1.0:1780997204.043593:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1780997204.043603:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1780997204.043610:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1780997204.043615:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1780997204.043618:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689869cb800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1780997204.043640:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126940160:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1780997204.044359:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780997204.044379:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126940288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780997204.044441:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997204.044581:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126940288 00000100:00100000:0.0:1780997204.044588:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126940288 00000100:00100000:0.0:1780997204.044636:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022 00000100:00100000:0.0:1780997204.044645:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126940288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780997204.044689:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:0.0:1780997204.044734:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126940288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997204.044741:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00000100:00100000:1.0:1780997204.044924:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126940288:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1780997204.045914:0:88352:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1780997204.046214:0:88352:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1780997204.049656:0:88352:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780997204.049942:0:88352:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000040:00080000:2.0:1780997204.050110:0:88352:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000040:00080000:2.0:1780997204.050601:0:88358:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:2.0:1780997204.050606:0:88358:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1780997204.051323:0:88352:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997204.051335:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1780997204.051381:0:88352:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1780997204.051403:0:88352:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305ac7e 00000100:00080000:0.0:1780997204.051412:0:88352:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1780997204.051417:0:88352:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9689bcb9d000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997204.051462:0:88352:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f10000 x1867507126940416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997204.051489:0:88352:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1780997204.051544:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997204.051548:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997204.051550:0:88352:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1780997204.051553:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1780997204.051556:0:88352:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1780997204.051558:0:88352:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780997204.051559:0:88352:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780997204.051561:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1780997204.051563:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997204.051564:0:88352:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1780997204.051567:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1780997204.051571:0:88352:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1780997204.051575:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997204.051576:0:88352:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1780997204.051579:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1780997204.051582:0:88352:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:0.0:1780997204.051604:0:88352:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1780997204.051607:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780997204.051619:0:88352:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff968886ec4d40) 00000020:00000080:0.0:1780997204.051635:0:88352:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:0.0:1780997204.051640:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1780997204.051706:0:88352:0:(osp_dev.c:1197:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1780997204.051711:0:88352:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1780997204.051715:0:88352:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305ac8c 00010000:00080000:0.0:1780997204.051742:0:88352:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689aebbd800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1780997204.051928:0:88352:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1780997204.051992:0:88352:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1780997204.052006:0:88352:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1780997204.052512:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126940416:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780997204.052576:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997204.053036:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126940416 00000100:00100000:0.0:1780997204.053052:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126940416 00000100:00100000:0.0:1780997204.053089:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5955 00000100:00100000:0.0:1780997204.053096:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3495:x1867507126940416:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1780997204.053131:0:9596:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3731 last 0 00000020:00000080:0.0:1780997204.053156:0:9596:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305ac93 00002000:00100000:0.0:1780997204.053169:0:9596:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9689aebbf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1780997204.053173:0:9596:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1780997204.053176:0:9596:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1780997204.053238:0:9596:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1780997204.053259:0:9596:0:(import.c:65:import_set_state_nolock()) ffff9689aebbb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997204.053336:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126940416:12345-0@lo:8:llog_process_th.0 Request processed in 238us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997204.053344:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5955 00000100:00100000:2.0:1780997204.053905:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780997204.053914:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1780997204.053922:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1780997204.053926:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1780997204.053929:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcb9d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1780997204.053989:0:3495:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:2.0:1780997204.053996:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126940416:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1780997204.055293:0:88358:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1780997204.055340:0:88358:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3731601068721ns, next at 0ns, rc = 0 00080000:00080000:0.0:1780997204.055510:0:88358:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1780997204.058669:0:88340:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1780997204.059613:0:88352:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1780997204.060176:0:88352:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:0.0:1780997204.060349:0:88352:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000100:00100000:0.0:1780997204.060967:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126940544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780997204.061051:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997204.061133:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126940544 00000100:00100000:3.0:1780997204.061149:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126940544 00000100:00100000:3.0:1780997204.061212:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:3.0:1780997204.061223:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126940544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780997204.061250:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997204.061326:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126940544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997204.061333:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:3.0:1780997204.061406:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126940544:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1780997204.061651:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1780997204.062202:0:88360:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:1.0:1780997204.062208:0:88360:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1780997204.063703:0:88352:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997204.063717:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1780997204.063756:0:88352:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1780997204.063775:0:88352:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305ac9a 00000100:00080000:0.0:1780997204.063784:0:88352:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1780997204.063790:0:88352:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9689aebbd800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997204.063895:0:88352:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7f13480 x1867507126940672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997204.063972:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126940672:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780997204.064168:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997204.064220:0:88352:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1780997204.064302:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997204.064306:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997204.064308:0:88352:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1780997204.064312:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780997204.064315:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997204.064317:0:88352:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1780997204.064320:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1780997204.064321:0:88352:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1780997204.064323:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997204.064325:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997204.064326:0:88352:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1780997204.064328:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780997204.064330:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997204.064332:0:88352:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1780997204.064335:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1780997204.064381:0:88352:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88352:1867507126940800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997204.064435:0:88352:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997204.064470:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126940800 00000100:00100000:0.0:1780997204.064476:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126940800 00000100:00100000:0.0:1780997204.064514:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1780997204.064523:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:88352:x1867507126940800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997204.064632:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:88352:x1867507126940800:12345-0@lo:502:llog_process_th.0 Request processed in 110us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997204.064640:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1780997204.064690:0:88352:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a64bc480 going to sleep for 11 seconds 00000100:00100000:0.0:1780997204.064713:0:88352:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88352:1867507126940800:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780997204.064736:0:88352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997204.064744:0:88352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997204.064746:0:88352:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1780997204.064750:0:88352:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1780997204.064799:0:88339:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1780997204.064832:0:88339:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1780997204.064848:0:88339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305abf2 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997204.064859:0:88339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305abf2 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997204.064867:0:88339:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9689a5870800 from 1 10000000:01000000:0.0:1780997204.064870:0:88339:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1780997204.064891:0:88339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997204.064899:0:88339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997204.064908:0:88339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997204.064921:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126940928:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780997204.064947:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997204.064962:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a64bc480 going to sleep for 11 seconds 00000100:00100000:0.0:1780997204.064983:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126940928 00000100:00100000:0.0:1780997204.064999:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126940928 00000100:00100000:0.0:1780997204.065023:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1780997204.065029:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:88339:x1867507126940928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780997204.065037:0:88344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997204.065659:0:88344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bb4ee400/0x30fd811c0305aca8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305aca1 expref: -99 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997204.065681:0:88344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bb4ee400/0x30fd811c0305aca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305aca1 expref: 8 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997204.065692:0:88344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bb4ee400/0x30fd811c0305aca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305aca1 expref: 8 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997204.065700:0:88344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ee400, rc 0) 00000100:00100000:0.0:1780997204.065746:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:88339:x1867507126940928:12345-0@lo:101:mount.lustre.0 Request processed in 716us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997204.065753:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1780997204.065948:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126940928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997204.065962:0:88339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305aca8 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997204.065971:0:88339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305aca8 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997204.066933:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126941056:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1780997204.067198:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997204.067236:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997204.067313:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126941056 00000100:00100000:0.0:1780997204.067320:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126941056 00000100:00100000:0.0:1780997204.067530:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1780997204.067540:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:88339:x1867507126941056:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1780997204.067560:0:88345:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1780997204.067579:0:88345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1780997204.067583:0:88345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1780997204.067586:0:88345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1780997204.067589:0:88345:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 119 00000100:00100000:0.0:1780997204.067684:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:88339:x1867507126941056:12345-0@lo:256:mount.lustre.0 Request processed in 145us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997204.067691:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1780997204.067769:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126941056:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1780997204.067883:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126940672 00000100:00100000:3.0:1780997204.067889:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126940672 00000100:00100000:3.0:1780997204.067912:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5956 00000100:00100000:3.0:1780997204.067916:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3495:x1867507126940672:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1780997204.067937:0:25178:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3731 last 0 00000020:00000080:3.0:1780997204.067963:0:25178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305acaf 00002000:00100000:3.0:1780997204.067974:0:25178:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9689bcd7b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1780997204.067978:0:25178:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1780997204.067981:0:25178:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1780997204.068051:0:25178:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1780997204.068075:0:25178:0:(import.c:65:import_set_state_nolock()) ffff9689bcd7f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780997204.068123:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126940672:12345-0@lo:8:llog_process_th.0 Request processed in 205us (3955us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997204.068130:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5956 00000100:00100000:3.0:1780997204.068230:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780997204.068238:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1780997204.068245:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1780997204.068249:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1780997204.068257:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689aebbd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1780997204.068286:0:3495:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:3.0:1780997204.068291:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126940672:0@lo:8:llog_process_th.0 10000000:01000000:1.0:1780997204.068712:0:88339:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:3.0:1780997204.068724:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126941184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1780997204.068728:0:88339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305aca8 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.068738:0:88339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305aca8 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997204.068755:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1780997204.068756:0:88339:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9689a5870800 from 1 10000000:01000000:1.0:1780997204.068759:0:88339:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1780997204.068783:0:88339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.068791:0:88339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.068800:0:88339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997204.068903:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126941312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1780997204.068933:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997204.068960:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689845e7780 going to sleep for 11 seconds 00000100:00100000:1.0:1780997204.068984:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126941184 00000100:00100000:1.0:1780997204.068989:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126941184 00000100:00100000:1.0:1780997204.069035:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:1.0:1780997204.069043:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126941184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780997204.069064:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997204.069100:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126941184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997204.069106:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:1.0:1780997204.069151:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126941184:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1780997204.069481:0:88360:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1780997204.069543:0:88360:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3731615271758ns, next at 0ns, rc = 0 00080000:00080000:1.0:1780997204.069549:0:88360:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1780997204.069901:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126941312 00000100:00100000:2.0:1780997204.069906:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126941312 00000100:00100000:2.0:1780997204.069936:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1780997204.069945:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:88339:x1867507126941312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997204.069955:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997204.069969:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc843800/0x30fd811c0305acbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305acb6 expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997204.069990:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc843800/0x30fd811c0305acbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305acb6 expref: 9 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997204.070000:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc843800/0x30fd811c0305acbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305acb6 expref: 9 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997204.070008:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc843800, rc 0) 00000100:00100000:2.0:1780997204.070045:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:88339:x1867507126941312:12345-0@lo:101:mount.lustre.0 Request processed in 101us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997204.070051:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1780997204.070131:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997204.070295:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126941312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780997204.070319:0:88339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997204.070338:0:88339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997204.070736:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126941440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780997204.070769:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997204.070800:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc784d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997204.070875:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126941440 00000100:00100000:3.0:1780997204.070880:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126941440 00000100:00100000:3.0:1780997204.070914:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1780997204.070921:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:88339:x1867507126941440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780997204.071031:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:88339:x1867507126941440:12345-0@lo:501:mount.lustre.0 Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997204.071038:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1780997204.071109:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126941440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780997204.071136:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126941568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780997204.071173:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997204.071194:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc784d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997204.071246:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126941568 00000100:00100000:2.0:1780997204.071251:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126941568 00000100:00100000:2.0:1780997204.071306:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1780997204.071314:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:88339:x1867507126941568:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997204.073023:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:88339:x1867507126941568:12345-0@lo:503:mount.lustre.0 Request processed in 1704us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997204.073035:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1780997204.073495:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126941568:0@lo:503:mount.lustre.0 00000004:00080000:3.0:1780997204.074958:0:88340:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1780997204.075582:0:88362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88362:1867507126941696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997204.075953:0:88362:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997204.076206:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126941696 00000100:00100000:3.0:1780997204.076215:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126941696 00000100:00100000:1.0:1780997204.076221:0:88362:0:(client.c:2692:ptlrpc_set_wait()) set ffff968887ce4840 going to sleep for 11 seconds 00000100:00100000:3.0:1780997204.076263:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1780997204.076301:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:88362:x1867507126941696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997204.077485:0:88362:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88362:1867507126941696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780997204.077529:0:88362:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997204.077538:0:88362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997204.077541:0:88362:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1780997204.077548:0:88362:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9689a5870800 00000020:00000080:1.0:1780997204.077550:0:88362:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1780997204.077557:0:88362:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997204.077560:0:88362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997204.077561:0:88362:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1780997204.077564:0:88362:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997204.077566:0:88362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997204.077568:0:88362:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1780997204.077571:0:88362:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9689a5870800 00000020:00000080:1.0:1780997204.077573:0:88362:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1780997204.077652:0:88362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88362:1867507126941824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997204.077694:0:88362:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997204.077726:0:88362:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885e41b40 going to sleep for 11 seconds 00000100:00100000:3.0:1780997204.077757:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:88362:x1867507126941696:12345-0@lo:502:llog_process_th.0 Request processed in 1095us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997204.077767:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1780997204.077798:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126941824 00000100:00100000:3.0:1780997204.077803:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126941824 00000100:00100000:3.0:1780997204.078489:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1780997204.078499:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:88362:x1867507126941824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997204.078615:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:88362:x1867507126941824:12345-0@lo:502:llog_process_th.0 Request processed in 117us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997204.078631:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1780997204.079735:0:88362:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88362:1867507126941824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780997204.079768:0:88362:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997204.079776:0:88362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997204.079778:0:88362:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1780997204.079782:0:88362:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1780997204.084121:0:88339:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1780997204.084311:0:88339:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780997204.084337:0:88339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997204.084350:0:88339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997204.084415:0:88339:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1780997204.084418:0:88339:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9689a5870800 10000000:01000000:2.0:1780997204.084432:0:88339:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9689a5870800 10000000:01000000:2.0:1780997204.084437:0:88339:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1780997204.084443:0:88339:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689a5870800 from 1 10000000:01000000:2.0:1780997204.084446:0:88339:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780997204.084484:0:88339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997204.084493:0:88339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997204.084504:0:88339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997204.084529:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126941952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780997204.084602:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997204.084646:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997204.084772:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126941952 00000100:00100000:3.0:1780997204.084779:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126941952 00000100:00100000:3.0:1780997204.084833:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1780997204.084842:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:88339:x1867507126941952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997204.084855:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997204.084868:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce2600/0x30fd811c0305accb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305acc4 expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997204.084890:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce2600/0x30fd811c0305accb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305acc4 expref: 10 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997204.084901:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce2600/0x30fd811c0305accb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305acc4 expref: 10 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997204.084908:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2600, rc 0) 00000100:00100000:3.0:1780997204.084947:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:88339:x1867507126941952:12345-0@lo:101:mount.lustre.0 Request processed in 106us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997204.084953:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1780997204.085144:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126941952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997204.085160:0:88339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305accb expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997204.087973:0:88339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305accb expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997204.088091:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126942080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997204.088151:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997204.088206:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997204.088231:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126942080 00000100:00100000:0.0:1780997204.088239:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126942080 00000100:00100000:0.0:1780997204.088311:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1780997204.088321:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:88339:x1867507126942080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780997204.088727:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:88339:x1867507126942080:12345-0@lo:501:mount.lustre.0 Request processed in 407us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997204.088734:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1780997204.089169:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126942080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997204.089204:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126942208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997204.089244:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997204.089312:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997204.089727:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126942208 00000100:00100000:3.0:1780997204.089734:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126942208 00000100:00100000:3.0:1780997204.089767:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1780997204.089774:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:88339:x1867507126942208:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780997204.090687:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:88339:x1867507126942208:12345-0@lo:503:mount.lustre.0 Request processed in 909us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997204.090696:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1780997204.091172:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126942208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997204.092686:0:88364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88364:1867507126942336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997204.092749:0:88364:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997204.092792:0:88364:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb180 going to sleep for 11 seconds 00000100:00100000:3.0:1780997204.093138:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126942336 00000100:00100000:3.0:1780997204.093160:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126942336 00000100:00100000:3.0:1780997204.093204:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1780997204.093213:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:88364:x1867507126942336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997204.093932:0:88364:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88364:1867507126942336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997204.094539:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:88364:x1867507126942336:12345-0@lo:502:llog_process_th.0 Request processed in 1324us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997204.094548:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000020:01000004:2.0:1780997204.094957:0:88364:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1780997204.094972:0:88364:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff968990fe4d40) 00000020:00000080:2.0:1780997204.095014:0:88364:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1780997204.095201:0:88364:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689a5870800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1780997204.095205:0:88364:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689a5870800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1780997204.095208:0:88364:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689a5870800 4 00010000:00080000:2.0:1780997204.095234:0:88364:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689bc969000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:2.0:1780997204.096985:0:88364:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1780997204.097087:0:88364:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1780997204.097124:0:88364:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1780997204.097135:0:88364:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x30fd811c0305acd9 00000100:00080000:2.0:1780997204.097146:0:88364:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780997204.097158:0:88364:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9689bc969000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997204.097203:0:88364:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bff6ed80 x1867507126942464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997204.097244:0:88364:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1780997204.101946:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126942464:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1780997204.102055:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997204.102119:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126942464 00000100:00100000:1.0:1780997204.102134:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126942464 00000100:00100000:1.0:1780997204.102179:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1780997204.102187:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126942464:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1780997204.102242:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126942464:12345-0@lo:38:llog_process_th.0 Request processed in 54us (187us total) trans 0 rc -11/-11 00000100:00100000:1.0:1780997204.102249:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1780997204.102307:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1780997204.102315:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bc969000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997204.102320:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1780997204.102324:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126942464:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780997204.104518:0:88364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88364:1867507126942592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997204.104592:0:88364:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997204.104856:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126942592 00000100:00100000:0.0:1780997204.104863:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126942592 00000100:00100000:2.0:1780997204.104958:0:88364:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1780997204.105323:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1780997204.105334:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:88364:x1867507126942592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997204.105487:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:88364:x1867507126942592:12345-0@lo:502:llog_process_th.0 Request processed in 154us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997204.105494:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1780997204.105586:0:88364:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88364:1867507126942592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997204.105631:0:88364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88364:1867507126942720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997204.105665:0:88364:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997204.106023:0:88364:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb180 going to sleep for 11 seconds 00000100:00100000:1.0:1780997204.106353:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126942720 00000100:00100000:1.0:1780997204.106361:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126942720 00000100:00100000:1.0:1780997204.106506:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1780997204.106515:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:88364:x1867507126942720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997204.106614:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:88364:x1867507126942720:12345-0@lo:502:llog_process_th.0 Request processed in 101us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997204.106622:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1780997204.106668:0:88364:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88364:1867507126942720:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1780997204.106693:0:88364:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1780997204.106920:0:88339:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1780997204.106949:0:88339:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780997204.106973:0:88339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305accb expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997204.107221:0:88339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305accb expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1780997204.107288:0:88339:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1780997204.107291:0:88339:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780997204.107292:0:88339:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997204.107294:0:88339:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997204.107295:0:88339:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997204.107296:0:88339:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997204.107298:0:88339:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997204.107300:0:88339:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780997204.107302:0:88339:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997204.107303:0:88339:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1780997204.107307:0:88339:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1780997204.107309:0:88339:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1780997204.107311:0:88339:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780997204.107312:0:88339:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997204.107313:0:88339:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997204.107314:0:88339:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997204.107315:0:88339:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997204.107316:0:88339:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997204.107317:0:88339:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780997204.107318:0:88339:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997204.107319:0:88339:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1780997204.107337:0:88339:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1780997204.107361:0:88339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126942848:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1780997204.107531:0:88339:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997204.107557:0:88339:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898a58ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1780997204.107650:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126942848 00000100:00100000:1.0:1780997204.107656:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126942848 00000100:00100000:1.0:1780997204.107683:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1780997204.107690:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:88339:x1867507126942848:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1780997204.107710:0:88351:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1780997204.107724:0:88351:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1780997204.109213:0:88351:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1780997204.109233:0:88351:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1780997204.109297:0:88348:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780997204.109302:0:88348:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780997204.109322:0:88348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.109339:0:88348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bb4ee400/0x30fd811c0305aca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305aca1 expref: 10 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.109352:0:88348:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.109648:0:88348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bb4ee400/0x30fd811c0305aca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305aca1 expref: 10 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.109662:0:88348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bb4ee400/0x30fd811c0305aca8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305aca1 expref: 10 pid: 88344 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997204.109675:0:88348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88348:1867507126942976:0@lo:104: 00000100:00100000:1.0:1780997204.109721:0:88348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997204.109788:0:88348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898daa4180 going to sleep for 11 seconds 00000100:00100000:1.0:1780997204.109856:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:88339:x1867507126942848:12345-0@lo:253:mount.lustre.0 Request processed in 2166us (2324us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997204.109866:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1780997204.109923:0:88339:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88339:1867507126942848:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1780997204.109932:0:88339:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1780997204.109935:0:88339:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1780997204.109937:0:88339:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780997204.109938:0:88339:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997204.109939:0:88339:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997204.109940:0:88339:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997204.109948:0:88339:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997204.109950:0:88339:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780997204.109951:0:88339:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780997204.109953:0:88339:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997204.109954:0:88339:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1780997204.109968:0:88339:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1780997204.116916:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126942976 00000100:00100000:0.0:1780997204.116930:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126942976 00000100:00100000:0.0:1780997204.117219:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1780997204.117239:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:88348:x1867507126942976:12345-0@lo:104: 00010000:00010000:0.0:1780997204.117259:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305aca8 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997204.117661:0:88348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88348:1867507126942976:0@lo:104: 00010000:00010000:0.0:1780997204.117684:0:88348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997204.117744:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1780997204.117750:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:88348:x1867507126942976:12345-0@lo:104: Request processed in 516us (8028us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997204.117758:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00010000:2.0:1780997204.117796:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997204.117803:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305aca8 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997204.117810:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ef600 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997204.117883:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305aca8 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997204.117894:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305aca8 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997204.117902:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305aca8 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997204.117907:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1780997204.117949:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305aca8 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997204.117963:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1780997204.118375:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126943104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997204.118428:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997204.118527:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126943104 00000100:00100000:1.0:1780997204.118534:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126943104 00010000:00010000:1.0:1780997204.118556:0:6338:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bb4ee400/0x30fd811c0305aca8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305aca1 expref: 10 pid: 88344 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997204.118576:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:1.0:1780997204.118583:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:3497:x1867507126943104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997204.118595:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997204.118599:0:6338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bb4ee400/0x30fd811c0305aca8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305aca1 expref: 10 pid: 88344 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.118608:0:6338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bb4ee400/0x30fd811c0305aca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305aca1 expref: 10 pid: 88344 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.118622:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bb4ee400/0x30fd811c0305aca8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305aca1 expref: 10 pid: 88344 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.118635:0:6338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.118643:0:6338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780997204.118656:0:6338:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015440261s 00010000:00010000:1.0:1780997204.118660:0:6338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.118677:0:6338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.118684:0:6338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.118690:0:6338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.118695:0:6338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997204.118699:0:6338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.118707:0:6338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.118720:0:6338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.118728:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997204.118968:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305aca8 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997204.118986:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305aca1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305aca8 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997204.119001:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997204.119002:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997204.119004:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997204.119741:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:3497:x1867507126943104:12345-0@lo:103:ldlm_bl.0 Request processed in 1156us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997204.119751:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00010000:00010000:1.0:1780997204.120777:0:88348:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.120789:0:88348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997204.120796:0:88348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888955c00/0x30fd811c0305ace0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997204.121643:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126943104:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1780997204.123019:0:88339:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444067 00000040:01000000:0.0:1780997204.123537:0:88339:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1780997204.123544:0:88370:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444067 00000020:00080000:3.0:1780997204.123548:0:88370:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444067 00000040:01000000:3.0:1780997204.124247:0:88371:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1780997204.124524:0:88339:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1780997204.125742:0:88372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88372:1867507126943232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997204.125837:0:88372:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997204.125875:0:88372:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898daa4180 going to sleep for 11 seconds 00000040:01000000:3.0:1780997204.126376:0:88339:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1780997204.126418:0:88339:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1780997204.126913:0:88339:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1780997204.126921:0:88339:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1780997204.126956:0:88339:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1780997204.127945:0:88339:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1780997204.128520:0:88339:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1780997204.128553:0:88339:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1780997204.128634:0:88339:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1780997204.129165:0:88339:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00000100:00100000:2.0:1780997204.130187:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126943232 00000100:00100000:2.0:1780997204.130200:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126943232 00000100:00100000:2.0:1780997204.130283:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023 00000100:00100000:2.0:1780997204.130294:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88372:x1867507126943232:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780997204.130629:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88372:x1867507126943232:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 335us (4790us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997204.130637:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00000100:00100000:0.0:1780997204.130720:0:88372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88372:1867507126943232:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1780997204.130763:0:88372:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1780997204.130804:0:88372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88372:1867507126943360:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997204.130856:0:88372:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997204.130887:0:88372:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a1600 going to sleep for 11 seconds 00000100:00100000:2.0:1780997204.131350:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126943360 00000100:00100000:2.0:1780997204.131357:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126943360 00000100:00100000:2.0:1780997204.131398:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024 00000100:00100000:2.0:1780997204.131406:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88372:x1867507126943360:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1780997204.131510:0:88371:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1780997204.131526:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88372:x1867507126943360:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 121us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997204.131532:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00000100:00100000:0.0:1780997204.131678:0:88372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88372:1867507126943360:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997204.131748:0:88372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88372:1867507126943488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780997204.131774:0:88372:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997204.131796:0:88372:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a1600 going to sleep for 11 seconds 00000100:00100000:2.0:1780997204.133601:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126943488 00000100:00100000:2.0:1780997204.133612:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126943488 00000100:00100000:2.0:1780997204.133652:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:2.0:1780997204.133675:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88372:x1867507126943488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780997204.133777:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88372:x1867507126943488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 104us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997204.133785:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000100:00100000:0.0:1780997204.133916:0:88372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88372:1867507126943488:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1780997204.133968:0:88372:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780997204.134793:0:88371:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1780997204.134863:0:88371:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00010000:00080000:3.0:1780997204.137296:0:88339:0:(ldlm_lib.c:3037:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149700 00000040:00080000:0.0:1780997204.139130:0:88372:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1780997204.139214:0:88372:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1780997204.139219:0:88372:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1780997204.140620:0:88373:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 88373 00010000:02000000:0.0:1780997204.140632:0:88373:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1780997204.140635:0:88373:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1780997204.140639:0:88373:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1780997204.140876:0:88339:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1780997204.140891:0:88339:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1780997204.140915:0:88339:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:1.0:1780997204.140936:0:88339:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1780997204.142876:0:88339:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1780997204.143137:0:88339:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1780997204.712531:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997204.776167:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:0.0:1780997204.903642:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 10000000:01000000:3.0:1780997205.157506:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1780997205.157514:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9689a5870800 from 120 10000000:01000000:3.0:1780997205.157519:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1780997205.157567:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.157580:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.157606:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997205.157631:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126943616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.157700:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997205.157747:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.157791:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126943616 00000100:00100000:1.0:1780997205.157801:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126943616 00000100:00100000:1.0:1780997205.157858:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1780997205.157867:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:6348:x1867507126943616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997205.157883:0:88345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997205.157897:0:88345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888954e00/0x30fd811c0305acee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ace7 expref: -99 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.157930:0:88345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888954e00/0x30fd811c0305acee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ace7 expref: 10 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.157942:0:88345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888954e00/0x30fd811c0305acee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ace7 expref: 10 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.157952:0:88345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954e00, rc 0) 00000100:00100000:1.0:1780997205.157988:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126943616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.157995:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1780997205.158090:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126943616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997205.158104:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.158114:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997205.158172:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126943744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.158200:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997205.158220:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.158401:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126943744 00000100:00100000:1.0:1780997205.158406:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126943744 00000100:00100000:1.0:1780997205.158450:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1780997205.158456:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126943744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1780997205.158470:0:88351:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1780997205.158486:0:88351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1780997205.158489:0:88351:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 120 00000100:00100000:1.0:1780997205.158559:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126943744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.158566:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1780997205.158719:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126943744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1780997205.158765:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1780997205.158772:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.158779:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997205.158786:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1780997205.158788:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968886f5e000 from 52 10000000:01000000:3.0:1780997205.158795:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780997205.158812:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.158820:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.158827:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997205.158841:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126943872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.158867:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997205.158895:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.158977:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126943872 00000100:00100000:1.0:1780997205.158982:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126943872 00000100:00100000:1.0:1780997205.159010:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1780997205.159016:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507126943872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997205.159024:0:88345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997205.159045:0:88345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888955600/0x30fd811c0305acfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305acf5 expref: -99 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.159064:0:88345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888955600/0x30fd811c0305acfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305acf5 expref: 11 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.159073:0:88345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888955600/0x30fd811c0305acfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305acf5 expref: 11 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.159080:0:88345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955600, rc 0) 00000100:00100000:1.0:1780997205.159107:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126943872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.159114:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1780997205.159320:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126943872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997205.159331:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305acfc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.159339:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305acfc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997205.159398:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.159432:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997205.159451:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.159499:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126944000 00000100:00100000:1.0:1780997205.159504:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126944000 00000100:00100000:1.0:1780997205.159532:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1780997205.159544:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126944000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.159649:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126944000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.159656:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1780997205.159805:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.159834:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.159870:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997205.159890:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.159997:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126944128 00000100:00100000:1.0:1780997205.160001:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126944128 00000100:00100000:1.0:1780997205.160029:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1780997205.160198:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126944128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.160294:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126944128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.160301:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1780997205.160382:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997205.166934:0:88424:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1780997205.171625:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1780997205.171664:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780997205.171675:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305acfc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.171688:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305acfc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997205.171697:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1780997205.171700:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff968886f5e000 from 117 10000000:01000000:2.0:1780997205.171702:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1780997205.171744:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843400/0x30fd811c0305ad03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.171751:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc843400/0x30fd811c0305ad03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.171762:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc843400/0x30fd811c0305ad03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997205.171791:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.171874:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997205.171925:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968983bc79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.171956:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126944256 00000100:00100000:1.0:1780997205.171965:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126944256 00000100:00100000:1.0:1780997205.172023:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1780997205.172043:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507126944256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997205.172066:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997205.172079:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888954800/0x30fd811c0305ad0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ad03 expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.172104:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888954800/0x30fd811c0305ad0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ad03 expref: 12 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.172114:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888954800/0x30fd811c0305ad0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad03 expref: 12 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.172122:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954800, rc 0) 00000100:00100000:1.0:1780997205.172176:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126944256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.172196:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1780997205.172225:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997205.172240:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc843400/0x30fd811c0305ad03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad0a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.172256:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc843400/0x30fd811c0305ad03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ad0a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997205.172323:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.172354:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997205.172371:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968983bc79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.172445:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126944384 00000100:00100000:1.0:1780997205.172450:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126944384 00000100:00100000:1.0:1780997205.172479:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1780997205.172486:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126944384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1780997205.172498:0:88345:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1780997205.172514:0:88345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1780997205.172518:0:88345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1780997205.172520:0:88345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1780997205.172523:0:88345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1780997205.172525:0:88345:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:1.0:1780997205.172598:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126944384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.172605:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1780997205.172636:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1780997205.172701:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780997205.172707:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843400/0x30fd811c0305ad03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad0a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.172715:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc843400/0x30fd811c0305ad03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad0a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997205.172721:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1780997205.172723:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1780997205.172725:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1780997205.172741:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.172757:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.172764:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997205.172777:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.172802:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997205.172820:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac273c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997205.172841:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126944512 00000100:00100000:2.0:1780997205.172846:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126944512 00000100:00100000:2.0:1780997205.172882:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1780997205.172888:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507126944512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997205.172896:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997205.172905:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc842800/0x30fd811c0305ad18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ad11 expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.172918:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc842800/0x30fd811c0305ad18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ad11 expref: 13 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.172925:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc842800/0x30fd811c0305ad18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad11 expref: 13 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.172932:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc842800, rc 0) 00000100:00100000:2.0:1780997205.172979:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126944512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997205.172986:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1780997205.173346:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997205.173359:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad18 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.173367:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ad18 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997205.173435:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.173461:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997205.173476:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac273c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997205.173657:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126944640 00000100:00100000:2.0:1780997205.173662:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126944640 00000100:00100000:2.0:1780997205.173695:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1780997205.173711:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126944640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.174007:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126944640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997205.174015:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1780997205.174103:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.174132:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.174173:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997205.174239:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac273c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997205.174391:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126944768 00000100:00100000:2.0:1780997205.174395:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126944768 00000100:00100000:2.0:1780997205.174433:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1780997205.174441:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126944768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.177922:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126944768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3472us (3738us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997205.177937:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1780997205.178246:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780997205.179446:0:88426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1780997205.179749:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1780997205.179788:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1780997205.179800:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad18 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.179812:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad18 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997205.179822:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1780997205.179825:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff968886f5e000 from 1 10000000:01000000:2.0:1780997205.179828:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1780997205.179868:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305ad1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.179877:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305ad1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.179888:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305ad1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997205.179917:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.180205:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997205.180253:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898a5ccd80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997205.180323:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126944896 00000100:00100000:0.0:1780997205.180331:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126944896 00000100:00100000:1.0:1780997205.180464:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1780997205.180476:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507126944896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997205.180491:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997205.180504:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888955800/0x30fd811c0305ad26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ad1f expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.180528:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888955800/0x30fd811c0305ad26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ad1f expref: 14 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.180539:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888955800/0x30fd811c0305ad26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad1f expref: 14 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.180547:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955800, rc 0) 00000100:00100000:1.0:1780997205.180602:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507126944896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.180610:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1780997205.180686:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126944896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997205.180703:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305ad1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad26 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997205.180714:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305ad1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ad26 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997205.180731:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1780997205.180735:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305ad1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad26 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997205.180752:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305ad1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad26 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997205.180759:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1780997205.180761:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff968886f5e000 from 7 10000000:01000000:0.0:1780997205.180764:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780997205.180781:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4efe00/0x30fd811c0305ad2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997205.180788:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bb4efe00/0x30fd811c0305ad2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997205.180795:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bb4efe00/0x30fd811c0305ad2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997205.180809:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997205.180837:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997205.180862:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126945024 00000100:00100000:1.0:1780997205.180868:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126945024 00000100:00100000:0.0:1780997205.180874:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.180904:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1780997205.180913:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507126945024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997205.180921:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997205.180929:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888955c00/0x30fd811c0305ad34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ad2d expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.181054:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888955c00/0x30fd811c0305ad34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ad2d expref: 15 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.181067:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888955c00/0x30fd811c0305ad34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad2d expref: 15 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.181085:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955c00, rc 0) 00000100:00100000:1.0:1780997205.181120:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126945024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.181126:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1780997205.181155:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997205.181168:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bb4efe00/0x30fd811c0305ad2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad34 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997205.181175:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bb4efe00/0x30fd811c0305ad2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ad34 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997205.181230:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997205.181255:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997205.181305:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997205.181354:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126945152 00000100:00100000:2.0:1780997205.181358:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126945152 00000100:00100000:2.0:1780997205.181388:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1780997205.181395:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126945152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.181516:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126945152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997205.181523:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1780997205.181586:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997205.181614:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997205.181655:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997205.181674:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997205.181684:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126945280 00000100:00100000:0.0:1780997205.181688:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126945280 00000100:00100000:0.0:1780997205.181720:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1780997205.181727:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126945280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997205.181803:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126945280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997205.181810:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1780997205.181877:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780997205.182797:0:88427:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1780997205.182885:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1780997205.182919:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1780997205.182929:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4efe00/0x30fd811c0305ad2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad34 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997205.182938:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bb4efe00/0x30fd811c0305ad2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad34 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997205.182947:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780997205.182949:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689bfa99000 from 52 10000000:01000000:0.0:1780997205.182952:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780997205.182982:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997205.182989:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997205.183011:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997205.183036:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997205.183077:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997205.183100:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997205.183282:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126945408 00000100:00100000:3.0:1780997205.183289:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126945408 00000100:00100000:3.0:1780997205.183328:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1780997205.183336:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126945408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997205.183346:0:88344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997205.183357:0:88344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce2a00/0x30fd811c0305ad42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ad3b expref: -99 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.183378:0:88344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce2a00/0x30fd811c0305ad42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ad3b expref: 16 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.183387:0:88344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce2a00/0x30fd811c0305ad42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad3b expref: 16 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.183394:0:88344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2a00, rc 0) 00000100:00100000:3.0:1780997205.183441:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126945408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997205.183447:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1780997205.183911:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997205.183926:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad42 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.183935:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ad42 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997205.183992:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.184024:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997205.184062:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27b40 going to sleep for 11 seconds 00000100:00100000:3.0:1780997205.184710:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126945536 00000100:00100000:3.0:1780997205.184718:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126945536 00000100:00100000:3.0:1780997205.184755:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1780997205.184764:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126945536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.184893:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126945536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997205.184900:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1780997205.186505:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.186562:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.186622:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997205.186648:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27b40 going to sleep for 11 seconds 00000100:00100000:3.0:1780997205.186773:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126945664 00000100:00100000:3.0:1780997205.186779:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126945664 00000100:00100000:3.0:1780997205.186830:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1780997205.186838:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126945664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.186951:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126945664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997205.186958:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1780997205.187312:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780997205.188652:0:88428:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1780997205.190471:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1780997205.190507:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780997205.190520:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad42 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997205.190533:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad42 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997205.190544:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1780997205.190547:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1780997205.190550:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1780997205.190591:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997205.190600:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997205.190611:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997205.190634:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997205.190693:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997205.190734:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99180 going to sleep for 11 seconds 00000100:00100000:3.0:1780997205.195552:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126945792 00000100:00100000:3.0:1780997205.195570:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126945792 00000100:00100000:3.0:1780997205.195625:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1780997205.195636:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126945792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997205.195653:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997205.195671:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce2000/0x30fd811c0305ad50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ad49 expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.195697:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce2000/0x30fd811c0305ad50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ad49 expref: 17 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.195709:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce2000/0x30fd811c0305ad50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad49 expref: 17 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.195719:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2000, rc 0) 00000100:00100000:3.0:1780997205.195795:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126945792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (5100us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997205.195802:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1780997205.197284:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997205.197310:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad50 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997205.197323:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ad50 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997205.197403:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997205.197460:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997205.197503:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126945920 00000100:00100000:0.0:1780997205.197504:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99180 going to sleep for 11 seconds 00000100:00100000:2.0:1780997205.197510:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126945920 00000100:00100000:2.0:1780997205.197548:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1780997205.197554:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126945920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.197676:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126945920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997205.197682:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1780997205.201427:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126945920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997205.201495:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997205.201585:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997205.201632:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99180 going to sleep for 11 seconds 00000100:00100000:2.0:1780997205.201912:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126946048 00000100:00100000:2.0:1780997205.201920:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126946048 00000100:00100000:2.0:1780997205.201975:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1780997205.201986:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126946048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.204819:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126946048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2827us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997205.204834:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1780997205.206076:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997205.207492:0:88430:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1780997205.208011:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1780997205.208056:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1780997205.208070:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad50 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.208086:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad50 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997205.208098:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1780997205.208103:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9689bfa99000 from 7 10000000:01000000:1.0:1780997205.208106:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1780997205.208231:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888955a00/0x30fd811c0305ad57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.208241:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968888955a00/0x30fd811c0305ad57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.208252:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968888955a00/0x30fd811c0305ad57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997205.208483:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.208562:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997205.208651:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27b40 going to sleep for 11 seconds 00000100:00100000:2.0:1780997205.209134:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126946176 00000100:00100000:2.0:1780997205.209217:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126946176 00000100:00100000:2.0:1780997205.209359:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1780997205.209369:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126946176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997205.209384:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997205.209397:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc842200/0x30fd811c0305ad5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ad57 expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.209435:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc842200/0x30fd811c0305ad5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ad57 expref: 18 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.209449:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc842200/0x30fd811c0305ad5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad57 expref: 18 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.209460:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc842200, rc 0) 00000100:00100000:2.0:1780997205.209518:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126946176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997205.209525:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1780997205.209620:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997205.209637:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968888955a00/0x30fd811c0305ad57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad5e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.209647:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968888955a00/0x30fd811c0305ad57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ad5e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997205.209709:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.209747:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997205.214493:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126946304 00000100:00100000:0.0:1780997205.214509:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126946304 00000100:00100000:0.0:1780997205.214568:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1780997205.214578:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886f06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126946304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997205.214764:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886f06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126946304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (5015us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997205.214772:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1780997205.219204:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.219246:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.219676:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.219755:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997205.219780:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.220550:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126946432 00000100:00100000:1.0:1780997205.220559:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126946432 00000100:00100000:1.0:1780997205.220608:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1780997205.220618:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126946432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.220758:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126946432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.220766:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1780997205.220896:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997205.223561:0:88432:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1780997205.231236:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1780997205.232249:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1780997205.232264:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888955a00/0x30fd811c0305ad57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad5e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.233439:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968888955a00/0x30fd811c0305ad57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad5e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997205.233452:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780997205.233455:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968990f90000 from 52 10000000:01000000:1.0:1780997205.233458:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780997205.233500:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.233509:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.233530:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997205.233556:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.233621:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997205.233707:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac27900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997205.239661:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126946560 00000100:00100000:3.0:1780997205.239680:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126946560 00000100:00100000:3.0:1780997205.240000:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1780997205.240014:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126946560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997205.240035:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997205.240061:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce3400/0x30fd811c0305ad6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ad65 expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.240090:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce3400/0x30fd811c0305ad6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ad65 expref: 19 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.240102:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce3400/0x30fd811c0305ad6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad65 expref: 19 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.240112:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3400, rc 0) 00000100:00100000:3.0:1780997205.240207:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126946560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (6585us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997205.240214:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1780997205.240354:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997205.240373:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad6c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997205.240384:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ad6c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997205.240472:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997205.240508:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997205.246883:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.249046:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126946688 00000100:00100000:1.0:1780997205.249062:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126946688 00000100:00100000:1.0:1780997205.249158:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1780997205.249170:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126946688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.250484:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126946688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1311us (9970us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.250495:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1780997205.251520:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.251603:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.251676:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997205.251711:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984b300c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.251778:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126946816 00000100:00100000:1.0:1780997205.251785:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126946816 00000100:00100000:1.0:1780997205.251835:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1780997205.251844:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126946816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.251961:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126946816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.251968:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1780997205.252551:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997205.253773:0:88435:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1780997205.254102:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1780997205.254202:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780997205.254217:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad6c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.254232:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad6c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997205.254258:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1780997205.254260:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1780997205.254263:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1780997205.254477:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.254486:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.254498:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997205.254522:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.254580:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997205.254622:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898ac276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997205.254674:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126946944 00000100:00100000:2.0:1780997205.254681:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126946944 00000100:00100000:2.0:1780997205.254728:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1780997205.254737:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126946944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997205.254749:0:88344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997205.254762:0:88344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc842e00/0x30fd811c0305ad7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ad73 expref: -99 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.254786:0:88344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc842e00/0x30fd811c0305ad7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ad73 expref: 20 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.254797:0:88344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc842e00/0x30fd811c0305ad7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad73 expref: 20 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.254812:0:88344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc842e00, rc 0) 00000100:00100000:2.0:1780997205.254862:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126946944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997205.254869:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1780997205.256326:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126946944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997205.256359:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad7a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.256385:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ad7a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997205.256478:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.256557:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997205.256611:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898d9aecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997205.256744:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126947072 00000100:00100000:2.0:1780997205.256751:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126947072 00000100:00100000:2.0:1780997205.256785:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1780997205.256811:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126947072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.256959:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126947072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997205.256986:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1780997205.258265:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.258429:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.258506:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997205.258543:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898d9aecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997205.258635:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126947200 00000100:00100000:2.0:1780997205.258648:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126947200 00000100:00100000:2.0:1780997205.258681:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1780997205.258697:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126947200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.259502:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126947200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 803us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997205.259527:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1780997205.259651:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780997205.264441:0:88436:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1780997205.264960:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1780997205.264990:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1780997205.265002:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad7a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.265014:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad7a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997205.265024:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1780997205.265027:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff968990f90000 from 7 10000000:01000000:3.0:1780997205.265030:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1780997205.265065:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce2800/0x30fd811c0305ad81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.265073:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968983ce2800/0x30fd811c0305ad81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.265083:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968983ce2800/0x30fd811c0305ad81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997205.265108:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.265189:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997205.269712:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126947328 00000100:00100000:2.0:1780997205.269731:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126947328 00000100:00100000:2.0:1780997205.269806:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1780997205.269816:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126947328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997205.269835:0:88345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997205.269855:0:88345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc843c00/0x30fd811c0305ad88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ad81 expref: -99 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.269908:0:88345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc843c00/0x30fd811c0305ad88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ad81 expref: 21 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.269919:0:88345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc843c00/0x30fd811c0305ad88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad81 expref: 21 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.269929:0:88345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc843c00, rc 0) 00000100:00100000:2.0:1780997205.269999:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126947328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997205.270006:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1780997205.272514:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898d9ae900 going to sleep for 11 seconds 00000100:00100000:2.0:1780997205.272562:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997205.272585:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968983ce2800/0x30fd811c0305ad81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad88 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.272597:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968983ce2800/0x30fd811c0305ad81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ad88 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997205.272691:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.272759:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997205.272801:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.272954:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126947456 00000100:00100000:1.0:1780997205.272961:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126947456 00000100:00100000:1.0:1780997205.273007:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1780997205.273029:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126947456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.273463:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126947456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 434us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.273492:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1780997205.274332:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.274391:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.274459:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997205.274484:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.275485:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126947584 00000100:00100000:1.0:1780997205.275496:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126947584 00000100:00100000:1.0:1780997205.275543:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1780997205.275572:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126947584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997205.275703:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126947584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.275712:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1780997205.275773:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997205.281171:0:88437:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1780997205.281438:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1780997205.281472:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780997205.281485:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce2800/0x30fd811c0305ad81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad88 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.281497:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968983ce2800/0x30fd811c0305ad81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad88 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997205.281507:0:6348:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1780997205.281509:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9689b6283380 from 1 10000000:01000000:2.0:1780997205.281512:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1780997205.281555:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305ad8f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.281562:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305ad8f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.281572:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305ad8f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997205.281599:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.281666:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997205.281721:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.281781:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126947712 00000100:00100000:1.0:1780997205.281791:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126947712 00000100:00100000:1.0:1780997205.281855:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1780997205.281953:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126947712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997205.281971:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997205.281988:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888955200/0x30fd811c0305ad96 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ad8f expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.282013:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888955200/0x30fd811c0305ad96 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ad8f expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.282025:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888955200/0x30fd811c0305ad96 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad8f expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.282034:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955200, rc 0) 00000100:00100000:1.0:1780997205.282083:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126947712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.282091:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1780997205.282183:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997205.282198:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305ad8f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad96 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.282207:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305ad8f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ad96 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997205.282238:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1780997205.282242:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305ad8f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad96 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.282248:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305ad8f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ad96 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997205.282255:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1780997205.282257:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9689b6283380 from 1 10000000:01000000:2.0:1780997205.282259:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1780997205.282305:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.282312:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.282318:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997205.282331:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.282356:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997205.282375:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997205.282437:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126947840 00000100:00100000:1.0:1780997205.282442:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126947840 00000100:00100000:1.0:1780997205.282471:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1780997205.282478:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126947840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997205.282487:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997205.282502:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968888954000/0x30fd811c0305ada4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ad9d expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.282516:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968888954000/0x30fd811c0305ada4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ad9d expref: 23 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.282523:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968888954000/0x30fd811c0305ada4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad9d expref: 23 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.282529:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954000, rc 0) 00000100:00100000:1.0:1780997205.282554:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126947840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997205.282559:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1780997205.282695:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997205.282706:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ada4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997205.282714:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ada4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997205.282787:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997205.282815:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997205.284110:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546e40 going to sleep for 11 seconds 00000100:00100000:3.0:1780997205.284623:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126947968 00000100:00100000:3.0:1780997205.284632:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126947968 00000100:00100000:3.0:1780997205.284724:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1780997205.284734:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126947968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997205.284854:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126947968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (2036us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780997205.284974:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126947968:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1780997205.285026:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1780997205.285036:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ada4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997205.285047:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ada4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997205.285084:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1780997205.577968:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997205.578067:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110396672 00000100:00100000:3.0:1780997205.578082:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110396672 00000100:00100000:3.0:1780997205.578156:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:3.0:1780997205.578169:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110396672:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997205.578194:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997205.578218:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968983ce2c00/0x30fd811c0305adab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d4b expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.578257:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968983ce2c00/0x30fd811c0305adab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d4b expref: 9 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.578299:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968983ce2c00/0x30fd811c0305adab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d4b expref: 9 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997205.578311:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2c00, rc 0) 00000100:00100000:3.0:1780997205.578684:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110396672:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 516us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997205.578693:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1780997205.582687:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997205.582855:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110396800 00000100:00100000:3.0:1780997205.582868:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110396800 00000100:00100000:3.0:1780997205.583109:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:3.0:1780997205.583122:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110396800:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780997205.583160:0:88344:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1780997205.583192:0:88344:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780997205.583196:0:88344:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1780997205.583200:0:88344:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1780997205.583204:0:88344:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1780997205.583206:0:88344:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:3.0:1780997205.586698:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110396800:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 Request processed in 3562us (4009us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997205.586725:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1780997205.589831:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997205.589999:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110396928 00000100:00100000:3.0:1780997205.590011:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110396928 00000100:00100000:3.0:1780997205.590099:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1356 00000100:00100000:3.0:1780997205.590110:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2393:x1867507110396928:12345-192.168.206.51@tcp:38:ll_cfg_requeue.0 00010000:00080000:3.0:1780997205.590151:0:80049:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'e4805cfa-ac6d-4d67-bb97-a6c06740fcd0' at ffff9689ba676000, cookie 0x30fd811c0305ac38 00010000:00080000:3.0:1780997205.590159:0:80049:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp recovering/t0 exp ffff9689ba676000 cur 3733 last 1780997204 00010000:02000400:3.0:1780997205.590168:0:80049:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1780997205.590175:0:80049:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1780997205.590213:0:80049:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1780997205.590476:0:80049:0:(import.c:65:import_set_state_nolock()) ffff9688888d3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780997205.590576:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110396928:12345-192.168.206.51@tcp:38:ll_cfg_requeue.0 Request processed in 455us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997205.590585:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1356 00000100:00100000:3.0:1780997205.595061:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997205.595247:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110397056 00000100:00100000:3.0:1780997205.595260:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110397056 00000100:00100000:3.0:1780997205.595500:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1357 00000100:00100000:3.0:1780997205.595513:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110397056:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1780997205.595542:0:63418:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689b10c0380 x1867507110397056/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:536/0 lens 328/0 e 0 to 0 dl 1780997216 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997205.595578:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110397056:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 68us (535us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997205.595586:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1357 00010000:00080000:0.0:1780997205.595680:0:88373:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1780997205.738974:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997205.797352:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:1.0:1780997205.928626:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00010000:00010000:3.0:1780997206.763500:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997206.821615:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:2.0:1780997206.950658:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00100000:3.0:1780997207.462089:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126948224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997207.462664:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126948096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997207.462732:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997207.463016:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997207.465249:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126948096 00000100:00100000:3.0:1780997207.465289:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126948096 00000100:00100000:2.0:1780997207.465332:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126948224 00000100:00100000:2.0:1780997207.465339:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126948224 00000100:00100000:2.0:1780997207.465394:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:0.0:1780997207.465420:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:2.0:1780997207.465423:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126948224:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997207.465437:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126948096:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1780997207.465440:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997207.465446:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1780997207.465465:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1780997207.465540:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997207.465554:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126948224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 149us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997207.465563:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:0.0:1780997207.465592:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126948096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997207.465600:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:3.0:1780997207.465614:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126948224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997207.465946:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126948096:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1780997207.788703:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997207.848376:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:1.0:1780997207.984389:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000001:02000400:3.0:1780997208.385668:0:88607:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1780997208.806438:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997208.842363:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997208.842417:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997208.842449:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110397312 00000100:00100000:1.0:1780997208.842472:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110397312 00000100:00100000:1.0:1780997208.842536:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1314 00000100:00100000:1.0:1780997208.842549:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2394:x1867507110397312:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997208.842623:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2394:x1867507110397312:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997208.842630:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1314 00000100:00100000:3.0:1780997208.845145:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110397184 00000100:00100000:3.0:1780997208.845158:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110397184 00000100:00100000:3.0:1780997208.845213:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:3.0:1780997208.845222:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110397184:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997208.845305:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110397184:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 83us (2954us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997208.845322:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00080000:3.0:1780997208.845356:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997208.881865:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 0 seconds 00000100:00100000:3.0:1780997209.005859:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 0 seconds 00000100:00080000:2.0:1780997209.511511:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997209.511519:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997209.511523:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997209.511533:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3731 00000100:00080000:2.0:1780997209.511539:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997209.511547:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997209.511572:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968990f1ad80 x1867507126948480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997209.511597:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997209.511600:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997209.511602:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997209.511611:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3731 00000100:00080000:2.0:1780997209.511614:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997209.511618:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997209.511629:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968990f18700 x1867507126948736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997209.511657:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997209.511661:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997209.511663:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997209.511666:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3731 00000100:00080000:2.0:1780997209.511669:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997209.511673:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997209.511689:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968990f19f80 x1867507126948992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997209.511713:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997209.511716:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997209.511718:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997209.511721:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3731 00000100:00080000:2.0:1780997209.511723:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997209.511727:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997209.511738:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689adb8a300 x1867507126949376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997209.511760:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1780997209.511763:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997209.511764:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bc969000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997209.511777:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9689bc969000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997209.511789:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689adb89c00 x1867507126949888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997209.511828:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126948352:0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.511913:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.511961:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126949248:0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.511991:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.512020:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1780997209.512025:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126948608:0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.512051:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.512069:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126949504:0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.512096:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.512128:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126948480:0@lo:38:kworker.0 00000100:00100000:2.0:1780997209.512168:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.512188:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126948736:0@lo:38:kworker.0 00000100:00100000:2.0:1780997209.512209:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.512226:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126948992:0@lo:38:kworker.0 00000100:00100000:2.0:1780997209.512249:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.512264:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126949376:0@lo:38:kworker.0 00000100:00100000:2.0:1780997209.512538:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.512567:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126949888:0@lo:38:kworker.0 00000100:00100000:2.0:1780997209.512596:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.512631:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126948864:0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.512659:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.512687:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126949632:0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.512712:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.512731:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1780997209.512737:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126949120:0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.512758:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.512776:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126949760:0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.512796:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.512848:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126948352 00000100:00100000:2.0:1780997209.512858:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126948352 00000100:00100000:2.0:1780997209.512912:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1780997209.512921:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126948352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.512974:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126948352:12345-0@lo:400:kworker.0 Request processed in 54us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997209.512981:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1780997209.513015:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126949248 00000100:00100000:2.0:1780997209.513019:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126949248 00000100:00100000:2.0:1780997209.513053:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126949632 00000100:00100000:2.0:1780997209.513056:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126949632 00000100:00100000:2.0:1780997209.513073:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126949120 00000100:00100000:2.0:1780997209.513076:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126949120 00000100:00100000:2.0:1780997209.513092:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126949760 00000100:00100000:2.0:1780997209.513094:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126949760 00000100:00100000:2.0:1780997209.513113:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:2.0:1780997209.513119:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126949248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.513213:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126949248:12345-0@lo:400:kworker.0 Request processed in 94us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997209.513219:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00100000:2.0:1780997209.513232:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:2.0:1780997209.513245:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126949632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.513301:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126949632:12345-0@lo:400:kworker.0 Request processed in 57us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997209.513307:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:2.0:1780997209.513378:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:2.0:1780997209.513546:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126949120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.513578:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126949120:12345-0@lo:400:kworker.0 Request processed in 195us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997209.513584:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:2.0:1780997209.513595:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:2.0:1780997209.513600:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126949760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.513623:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126949760:12345-0@lo:400:kworker.0 Request processed in 23us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997209.513629:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00000100:00100000:2.0:1780997209.513651:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126948608 00000100:00100000:2.0:1780997209.513654:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126948608 00000100:00100000:2.0:1780997209.513672:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126948480 00000100:00100000:2.0:1780997209.513675:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126948480 00000100:00100000:2.0:1780997209.513681:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126948736 00000100:00100000:2.0:1780997209.513684:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126948736 00000100:00100000:2.0:1780997209.513690:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126949376 00000100:00100000:2.0:1780997209.513692:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126949376 00000100:00100000:2.0:1780997209.513699:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126949888 00000100:00100000:2.0:1780997209.513701:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126949888 00000100:00100000:2.0:1780997209.513707:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126948864 00000100:00100000:2.0:1780997209.513710:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126948864 00000100:00100000:2.0:1780997209.513721:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:2.0:1780997209.513726:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126948608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.513768:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126948608:12345-0@lo:400:kworker.0 Request processed in 42us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997209.513774:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:2.0:1780997209.513784:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1780997209.513789:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126948864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.513809:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126948864:12345-0@lo:400:kworker.0 Request processed in 20us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997209.513814:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1780997209.513822:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:2.0:1780997209.513825:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126948480:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780997209.513851:0:65272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3737 last 0 00000020:00000080:2.0:1780997209.513894:0:65272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x30fd811c0305adb2 00000004:00100000:2.0:1780997209.513964:0:65272:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1780997209.517048:0:65272:0:(import.c:65:import_set_state_nolock()) ffff9689bc96c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997209.517206:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3495:x1867507126948480:12345-0@lo:38:kworker.0 Request processed in 3374us (5032us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997209.517219:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:2.0:1780997209.517263:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:2.0:1780997209.517285:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126948736:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780997209.518479:0:65272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3737 last 0 00000020:00000080:2.0:1780997209.518526:0:65272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x30fd811c0305adb9 00000004:00100000:2.0:1780997209.518546:0:65272:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1780997209.518593:0:65272:0:(import.c:65:import_set_state_nolock()) ffff9689bc96b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997209.518663:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3495:x1867507126948736:12345-0@lo:38:kworker.0 Request processed in 1392us (6452us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997209.518678:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:2.0:1780997209.518706:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:2.0:1780997209.518712:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126949376:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780997209.518731:0:65272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3737 last 0 00000020:00000080:2.0:1780997209.518756:0:65272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x30fd811c0305adc0 00000004:00100000:2.0:1780997209.518763:0:65272:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1780997209.518777:0:65272:0:(import.c:65:import_set_state_nolock()) ffff9689bc96f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997209.518809:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3495:x1867507126949376:12345-0@lo:38:kworker.0 Request processed in 96us (6270us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997209.518815:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:2.0:1780997209.518827:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:2.0:1780997209.518831:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126949888:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780997209.518844:0:65272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3737 last 0 00000020:00000080:2.0:1780997209.518867:0:65272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x30fd811c0305adc7 00000004:00100000:2.0:1780997209.518873:0:65272:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1780997209.518887:0:65272:0:(import.c:65:import_set_state_nolock()) ffff9689bd36c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997209.518915:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1867507126949888:12345-0@lo:38:kworker.0 Request processed in 82us (6318us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997209.518922:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:2.0:1780997209.518959:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126949504 00000100:00100000:2.0:1780997209.518968:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126949504 00000100:00100000:2.0:1780997209.519011:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126948992 00000100:00100000:2.0:1780997209.519015:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126948992 00000100:00100000:2.0:1780997209.519030:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026 00000100:00100000:2.0:1780997209.519035:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126949504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997209.519089:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126949504:12345-0@lo:400:kworker.0 Request processed in 53us (6992us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997209.519096:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000100:00100000:2.0:1780997209.519108:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027 00000100:00100000:2.0:1780997209.519112:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bf8c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126948992:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780997209.519127:0:8242:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9689ba672800, cookie 0x30fd811c0305ac31 00010000:00080000:2.0:1780997209.519131:0:8242:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411355 exp ffff9689ba672800 cur 3737 last 1780997204 00000100:00080000:3.0:1780997209.522404:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997209.522417:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780997209.522420:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997209.522490:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126950016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997209.522903:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997209.522999:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126948608:0@lo:400:kworker.0 00000100:00100000:3.0:1780997209.523014:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126949504:0@lo:400:kworker.0 00000100:00100000:3.0:1780997209.523025:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126948352:0@lo:400:kworker.0 00000100:00100000:3.0:1780997209.523037:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126949248:0@lo:400:kworker.0 00000100:00100000:3.0:1780997209.523094:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126950016 00000100:00100000:3.0:1780997209.523100:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126950016 00000100:00100000:3.0:1780997209.523138:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:3.0:1780997209.523146:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126950016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780997209.523185:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:3.0:1780997209.523241:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507126950016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997209.523248:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00100000:3.0:1780997209.526970:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126950016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997209.527399:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126949120:0@lo:400:kworker.0 00000100:00100000:3.0:1780997209.527414:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126949760:0@lo:400:kworker.0 00000100:00100000:3.0:1780997209.527444:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126948864:0@lo:400:kworker.0 00000100:00100000:3.0:1780997209.527455:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126949632:0@lo:400:kworker.0 00010000:00080000:3.0:1780997209.527494:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff968990f1ad80 x1867507126948480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00100000:2.0:1780997209.527513:0:8242:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780997209.527520:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00000100:00080000:2.0:1780997209.527996:0:8242:0:(import.c:65:import_set_state_nolock()) ffff96888969f000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1780997209.528060:0:88373:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1780997209.528066:0:88373:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 111669149701 00000020:00080000:2.0:1780997209.528073:0:88373:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997209.528077:0:88373:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149701 00000020:00080000:2.0:1780997209.528080:0:88373:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997209.528083:0:88373:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149701 00000100:00100000:2.0:1780997209.528172:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bf8c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126948992:12345-0@lo:38:kworker.0 Request processed in 9056us (15919us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997209.528184:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000100:00080000:3.0:1780997209.528471:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff968990f1ad80 x1867507126948480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997234 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997209.528481:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1780997209.528488:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1780997209.528494:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1780997209.528502:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126948480:0@lo:38:kworker.0 00010000:00080000:3.0:1780997209.528529:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff968990f18700 x1867507126948736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997209.528541:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00000100:00080000:3.0:1780997209.529434:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff968990f18700 x1867507126948736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997234 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997209.529443:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1780997209.529446:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1780997209.529450:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1780997209.529454:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126948736:0@lo:38:kworker.0 00000001:00100000:3.0:1780997209.531518:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:2.0:1780997209.534724:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:2.0:1780997209.534745:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1780997209.534753:0:3495:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1780997209.534757:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149700 gen 3 00000100:00080000:2.0:1780997209.534763:0:3495:0:(recover.c:53:ptlrpc_replay_next()) import ffff9689ae566000 from lustre-MDT0000_UUID committed 111669149700 last 0 00000100:00080000:2.0:1780997209.534767:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1780997209.536828:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126948992:0@lo:38:kworker.0 00010000:00080000:3.0:1780997209.536888:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689adb8a300 x1867507126949376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997209.536907:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00000001:00100000:1.0:1780997209.537552:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1780997209.538445:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1780997209.540764:0:88653:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1780997209.540773:0:88653:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1780997209.540786:0:88653:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1780997209.541883:0:88653:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:3.0:1780997209.543500:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9689adb8a300 x1867507126949376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997234 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997209.543516:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1780997209.543522:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1780997209.543527:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1780997209.543535:0:3495:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c73d7dcb): req@ffff9689a5d80000 x1867507126933376/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997209.543567:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126949376:0@lo:38:kworker.0 00010000:00080000:3.0:1780997209.543628:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689adb89c00 x1867507126949888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997209.543647:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:3.0:1780997209.543658:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1780997209.543663:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1780997209.543666:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bc969000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1780997209.543671:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126949888:0@lo:38:kworker.0 00000100:00100000:0.0:1780997209.543688:0:63426:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997209.543730:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126950144:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1780997209.543735:0:63426:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546000 going to sleep for 11 seconds 00000100:00100000:3.0:1780997209.543769:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997209.543877:0:63424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126933376 00000100:00100000:1.0:1780997209.543886:0:63424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126933376 00000100:00100000:1.0:1780997209.543943:0:63424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1780997209.543955:0:63424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:63426:x1867507126933376:12345-0@lo:700:mdt_seqm_0000.0 00010000:00080000:1.0:1780997209.543976:0:63424:0:(ldlm_lib.c:3195:target_queue_recovery_request()) @@@ not queueing req@ffff9689b7f11500 x1867507126933376/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:540/0 lens 264/0 e 0 to 0 dl 1780997220 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997209.544778:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126950144 00000100:00100000:0.0:1780997209.544787:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126950144 00000100:00100000:0.0:1780997209.544830:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:0.0:1780997209.544838:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126950144:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1780997209.544856:0:8241:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff9689b10c0700 x1867507126950144/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:540/0 lens 224/0 e 0 to 0 dl 1780997220 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997209.544876:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507126950144:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 40us (1107us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997209.544884:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00000020:00080000:0.0:1780997209.544906:0:88373:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780997209.544910:0:88373:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149701 00010000:00080000:0.0:1780997209.544914:0:88373:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1780997209.544917:0:88373:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780997209.544925:0:88373:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1780997209.544928:0:88373:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1780997209.544937:0:88373:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff9689b10c0380 x1867507110397056/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:536/0 lens 328/0 e 0 to 0 dl 1780997216 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1780997209.544955:0:88373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997209.544990:0:88373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305adce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d05 expref: -99 pid: 88373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.545019:0:88373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305adce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d05 expref: 7 pid: 88373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.545055:0:88373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305adce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d05 expref: 7 pid: 88373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.545064:0:88373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ef000, rc 0) 00010000:00080000:0.0:1780997209.545134:0:88373:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1780997209.545148:0:88373:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:2.0:1780997209.559249:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997209.560784:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110397440 00000100:00100000:0.0:1780997209.560802:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110397440 00000100:00100000:0.0:1780997209.560880:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1317 00000100:00100000:0.0:1780997209.560895:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2393:x1867507110397440:12345-192.168.206.51@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1780997209.560925:0:65272:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff9688895f7800 x1867507110397440/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:540/0 lens 224/0 e 0 to 0 dl 1780997220 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997209.560953:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2393:x1867507110397440:12345-192.168.206.51@tcp:400:ptlrpcd_rcv.0 Request processed in 62us (1719us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997209.560961:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1317 00010000:00080000:2.0:1780997209.561033:0:88373:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1780997209.561189:0:88373:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 40000000:02000000:0.0:1780997209.584970:0:63424:0:(fid_handler.c:117:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000001:00100000:3.0:1780997209.598670:0:88340:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000001:00100000:3.0:1780997209.598690:0:88340:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1780997209.598960:0:88373:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1780997209.599019:0:88373:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1780997209.599038:0:88373:0:(ldlm_lib.c:2924:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9689b10c0700 x1867507126950144/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:540/0 lens 224/0 e 0 to 0 dl 1780997220 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1780997209.600018:0:88373:0:(ldlm_lib.c:2924:target_recovery_thread()) @@@ processing final ping from 192.168.206.51@tcp: req@ffff9688895f7800 x1867507110397440/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:540/0 lens 224/0 e 0 to 0 dl 1780997220 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780997209.600104:0:88373:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:0.0:1780997209.602819:0:63424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:63426:x1867507126933376:12345-0@lo:700:mdt_seqm_0000.0 Request processed in 58849us (59115us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997209.602850:0:63424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1780997209.602938:0:63426:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-lwp-MDT0001_UUID:63426:1867507126933376:0@lo:700:mdt_seqm_0000.0 40000000:02000000:0.0:1780997209.602957:0:63426:0:(fid_request.c:121:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000100:00080000:3.0:1780997209.603180:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1780997209.603193:0:3495:0:(client.c:3253:ptlrpc_resend_req()) @@@ going to resend req@ffff9689b7f10a80 x1867507126950144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997225 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997209.603222:0:3495:0:(client.c:3262:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9689b7f10a80 x1867507126950144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997225 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997209.603229:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1780997209.603251:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1780997209.603258:0:3495:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000029ac7109): req@ffff9689a5d81880 x1867507126930688/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997209.603290:0:3495:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f9b94675): req@ffff9689a568aa00 x1867507126930176/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997193 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997209.603305:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126950144:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1780997209.603454:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126950272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997209.603525:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997209.603581:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126950272 00000100:00100000:1.0:1780997209.603590:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126950272 00000100:00100000:1.0:1780997209.603643:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:1.0:1780997209.603652:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126950272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780997209.603692:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445257216 avail 1299017728 00000100:00100000:1.0:1780997209.603743:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3497:x1867507126950272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997209.603751:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00000100:00100000:1.0:1780997209.603788:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126950272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780997209.603956:0:72369:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997209.603987:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889546f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997209.604047:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126930688 00000100:00100000:1.0:1780997209.604053:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126930688 00000100:00100000:1.0:1780997209.604084:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:1.0:1780997209.604091:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:72369:x1867507126930688:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1780997209.604744:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:72369:x1867507126930688:12345-0@lo:1000:osp_up0-1.0 Request processed in 650us (785us total) trans 115964116993 rc 0/0 00000100:00100000:1.0:1780997209.604752:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00000100:00100000:1.0:1780997209.604793:0:72369:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d81880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126930688:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1780997209.619533:0:63426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:70338:x1867507110390656:12345-192.168.206.51@tcp:700:cp.0 Request processed in 21231369us (21232003us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997209.619553:0:63426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1780997209.620611:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997209.620671:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126930176 00000100:00100000:0.0:1780997209.620681:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126930176 00000100:00100000:0.0:1780997209.620750:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:0.0:1780997209.620760:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3499:x1867507126930176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780997209.620797:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445257216 avail 1299017728 00000100:00100000:0.0:1780997209.620841:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3499:x1867507126930176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997209.622176:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00000100:00100000:0.0:1780997209.622297:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126930176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997209.627711:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997209.627953:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110397696 00000100:00100000:1.0:1780997209.627970:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110397696 00000100:00100000:1.0:1780997209.628050:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1362 00000100:00100000:1.0:1780997209.628066:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:70338:x1867507110397696:12345-192.168.206.51@tcp:101:cp.0 00010000:00010000:1.0:1780997209.628097:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997209.628127:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955000/0x30fd811c0305add5 lrc: 2/0,0 mode: --/CW res: [0x240006991:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d52 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628292:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954400/0x30fd811c0305addc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628302:0:63417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954400/0x30fd811c0305addc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628314:0:63417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954400/0x30fd811c0305addc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997209.628355:0:63417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63417:1867507126950400:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1780997209.628434:0:63417:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997209.628466:0:63417:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5540 going to sleep for 11 seconds 00000100:00100000:1.0:1780997209.628490:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126950400 00000100:00100000:1.0:1780997209.628493:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126950400 00000100:00100000:1.0:1780997209.628529:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00100000:1.0:1780997209.628537:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63417:x1867507126950400:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1780997209.628552:0:8241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997209.628572:0:8241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c0305ade3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30fd811c0305addc expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628598:0:8241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c0305ade3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305addc expref: 8 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628626:0:8241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c0305ade3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305addc expref: 8 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628636:0:8241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:1.0:1780997209.628640:0:8241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780997209.628645:0:8241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03200, rc 0) 00000100:00100000:1.0:1780997209.628687:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63417:x1867507126950400:12345-0@lo:101:mdt00_000.0 Request processed in 150us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997209.628696:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00100000:1.0:1780997209.628751:0:63417:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63417:1867507126950400:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1780997209.628770:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954400/0x30fd811c0305addc lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ade3 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628794:0:63417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954400/0x30fd811c0305addc lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ade3 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780997209.628818:0:63417:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1780997209.628825:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954400/0x30fd811c0305addc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ade3 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628833:0:63417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954400/0x30fd811c0305addc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ade3 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628903:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02c00/0x30fd811c0305adea lrc: 3/0,1 mode: --/CW res: [0x240006991:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628913:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02c00/0x30fd811c0305adea lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628924:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02c00/0x30fd811c0305adea lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628940:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305adf1 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628947:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305adf1 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.628953:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305adf1 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997209.629115:0:63417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad886d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63417:1867507126950528:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1780997209.629156:0:63417:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997209.629173:0:63417:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5240 going to sleep for 11 seconds 00000100:00100000:0.0:1780997209.634872:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126950528 00000100:00100000:0.0:1780997209.634892:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126950528 00000100:00100000:0.0:1780997209.634968:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00100000:0.0:1780997209.634980:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63417:x1867507126950528:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1780997209.635197:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63417:x1867507126950528:12345-0@lo:1000:mdt00_000.0 Request processed in 218us (6040us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997209.635205:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00000100:00100000:0.0:1780997209.635296:0:63417:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad886d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63417:1867507126950528:0@lo:1000:mdt00_000.0 00000004:00000080:2.0:1780997209.639028:0:88373:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8c8c2c33e10 00100000:10000000:2.0:1780997209.639047:0:88373:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1780997209.641252:0:88359:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x302:0x0] 00000100:00100000:2.0:1780997209.641370:0:88359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88359:1867507126950656:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1780997209.641467:0:88359:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.641510:0:88359:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885805600 going to sleep for 11 seconds 00000100:00100000:2.0:1780997209.641535:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126950656 00000100:00100000:2.0:1780997209.641543:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126950656 00000100:00100000:2.0:1780997209.641597:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5957 00000100:00100000:2.0:1780997209.641607:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:88359:x1867507126950656:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1780997209.641646:0:25181:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -63 00002000:02000040:2.0:1780997209.641652:0:25181:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:771 to 0x280000400:833) 00000004:00080000:0.0:1780997209.644330:0:88361:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x303:0x0] 00000100:00100000:0.0:1780997209.644400:0:88361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88361:1867507126950784:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1780997209.644492:0:88361:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997209.644529:0:88361:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888760b300 going to sleep for 11 seconds 00000100:00100000:3.0:1780997209.644935:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126950784 00000100:00100000:3.0:1780997209.644945:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126950784 00000100:00100000:3.0:1780997209.645002:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5958 00000100:00100000:3.0:1780997209.645013:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:88361:x1867507126950784:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1780997209.645047:0:25174:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -62 00002000:02000040:3.0:1780997209.645053:0:25174:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:772 to 0x2c0000401:833) 00000004:00080000:1.0:1780997209.645292:0:63417:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x492:0x0], count =400 00000004:00080000:1.0:1780997209.645304:0:63417:0:(osp_object.c:1640:osp_create()) Writing gap [0x2c0000400:0x492:0x0]+400 in llog 00000004:00080000:1.0:1780997209.645338:0:63417:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x622:0x0], index 1: 0 00010000:00010000:1.0:1780997209.645623:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305adf8 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645643:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305adf8 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645657:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305adf8 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645703:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02c00/0x30fd811c0305adea lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645711:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02c00/0x30fd811c0305adea lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645718:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02c00/0x30fd811c0305adea lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645725:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02c00/0x30fd811c0305adea lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645732:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997209.645738:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02c00/0x30fd811c0305adea lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645747:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02c00/0x30fd811c0305adea lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645773:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898d235900) 00010000:00010000:1.0:1780997209.645776:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997209.645782:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02c00/0x30fd811c0305adea lrc: 3/0,0 mode: --/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645789:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02c00/0x30fd811c0305adea lrc: 0/0,0 mode: --/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997209.645807:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034bde8fd reply state 0000000046d16494 transno 81604378739 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305adf1 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645821:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305adf1 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645828:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0xb1bed465 (ffff96898962f100) 00010000:00010000:1.0:1780997209.645830:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997209.645833:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780997209.645880:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955000/0x30fd811c0305add5 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d52 expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645897:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305adf8 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d52 expref: 9 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.645905:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff96898962fb00) 00010000:00010000:1.0:1780997209.645908:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997209.645911:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03400, rc 0) 00000100:00100000:1.0:1780997209.645989:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:70338:x1867507110397696:12345-192.168.206.51@tcp:101:cp.0 Request processed in 17928us (18290us total) trans 81604378739 rc 0/0 00000100:00100000:1.0:1780997209.645998:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1362 00002000:00010000:2.0:1780997209.651156:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997209.651173:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c0305ae06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.651196:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.651207:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.651214:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c0305ae06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.651235:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c0305ae06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.651249:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c0305ae06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.651259:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c0305ae06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1780997209.651894:0:88660:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780997209.652192:0:88660:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1780997209.652593:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780997209.652741:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997209.652750:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bae26110/0x30fd811c0305ae0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.652763:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.652765:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.652769:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bae26110/0x30fd811c0305ae0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.652781:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bae26110/0x30fd811c0305ae0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.652791:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bae26110/0x30fd811c0305ae0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.652812:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bae26110/0x30fd811c0305ae0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.652829:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780997209.652842:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997209.653788:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c0305ae06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.653801:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc843a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997209.653807:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c0305ae06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.653819:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c0305ae06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.653842:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c0305ae06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.653914:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a85a58/0x30fd811c0305ae06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.653941:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997209.653944:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bae26110/0x30fd811c0305ae0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.653967:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997209.653971:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae26110/0x30fd811c0305ae0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.653979:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae26110/0x30fd811c0305ae0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.653991:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bae26110/0x30fd811c0305ae0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.653999:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bae26110/0x30fd811c0305ae0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.654013:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.654015:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.654017:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997209.654157:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997209.654164:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c0305ae14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.654174:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.654176:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.654179:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c0305ae14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.654191:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c0305ae14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.654207:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c0305ae14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.654215:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c0305ae14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.654235:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997209.654245:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997209.654250:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c0305ae14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.654257:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997209.654260:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c0305ae14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.654267:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c0305ae14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.654809:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c0305ae14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.654817:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000583d24f8/0x30fd811c0305ae14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.654830:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.654839:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.654841:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997209.656076:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997209.656088:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c0305ae1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.656102:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.656104:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.656109:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c0305ae1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.656122:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c0305ae1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.656135:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c0305ae1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.656143:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c0305ae1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.656165:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780997209.656206:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997209.656211:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c0305ae22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.656219:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.656220:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.656223:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c0305ae22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.656248:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c0305ae22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.656256:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c0305ae22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.656263:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c0305ae22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.656787:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780997209.656801:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997209.656808:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c0305ae1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.656819:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc843000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997209.656825:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c0305ae1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.656836:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c0305ae1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.657084:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997209.657092:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c0305ae22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.657116:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.657119:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c0305ae22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.657128:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c0305ae22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.657145:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c0305ae22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.657153:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb3b309c/0x30fd811c0305ae22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.657176:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.657178:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.657180:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.657188:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.657488:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c0305ae1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.657499:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045a7d4ac/0x30fd811c0305ae1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.657523:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.657525:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.657527:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997209.657620:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997209.657626:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4eedb06/0x30fd811c0305ae29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.657636:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.657638:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.657641:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4eedb06/0x30fd811c0305ae29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.657652:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4eedb06/0x30fd811c0305ae29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.657989:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4eedb06/0x30fd811c0305ae29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.657998:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4eedb06/0x30fd811c0305ae29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.658017:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997209.658028:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997209.658034:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4eedb06/0x30fd811c0305ae29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.658056:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997209.658060:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4eedb06/0x30fd811c0305ae29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.658071:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4eedb06/0x30fd811c0305ae29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.658083:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4eedb06/0x30fd811c0305ae29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.658092:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4eedb06/0x30fd811c0305ae29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.658108:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.658110:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.658112:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780997209.658168:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997209.658174:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c0305ae30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.658183:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.658185:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.658188:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c0305ae30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.658197:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c0305ae30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.658212:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c0305ae30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.658220:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c0305ae30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.658236:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997209.658300:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997209.658306:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c0305ae30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.658316:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.658320:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c0305ae30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997209.658329:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.658341:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c0305ae30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.658353:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c0305ae30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.658361:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000900f69ea/0x30fd811c0305ae30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.658375:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.658377:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.658378:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.659499:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051c2606a/0x30fd811c0305ae37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.659517:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.659519:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.659524:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051c2606a/0x30fd811c0305ae37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.659538:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051c2606a/0x30fd811c0305ae37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.659550:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051c2606a/0x30fd811c0305ae37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.659560:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051c2606a/0x30fd811c0305ae37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.659594:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997209.659618:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997209.659626:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051c2606a/0x30fd811c0305ae37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.659636:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.659640:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051c2606a/0x30fd811c0305ae37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.659651:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051c2606a/0x30fd811c0305ae37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.659665:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051c2606a/0x30fd811c0305ae37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.659685:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051c2606a/0x30fd811c0305ae37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997209.659695:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997209.659703:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c0305ae3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.659705:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.659709:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.659712:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.659716:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.659719:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.659724:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c0305ae3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.659735:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c0305ae3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.659743:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c0305ae3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.659751:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c0305ae3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.659777:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780997209.659817:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.659818:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997209.659826:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c0305ae45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.659827:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c0305ae3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.659847:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.659850:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c0305ae3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.659857:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c0305ae3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.659867:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c0305ae3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.659874:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bd0ff29/0x30fd811c0305ae3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.659888:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.659890:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.659898:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.660968:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.660973:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.660977:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c0305ae45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.660992:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c0305ae45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.661012:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c0305ae45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.661019:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c0305ae45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.661041:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780997209.661119:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997209.661125:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c0305ae4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.661132:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.661134:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.661137:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c0305ae4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.661146:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c0305ae4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.661154:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c0305ae4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.661161:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c0305ae4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.661179:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780997209.661227:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997209.661232:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036b01289/0x30fd811c0305ae53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.661240:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.661241:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997209.661244:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036b01289/0x30fd811c0305ae53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.661253:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036b01289/0x30fd811c0305ae53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.661262:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036b01289/0x30fd811c0305ae53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.661312:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036b01289/0x30fd811c0305ae53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.663927:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1780997209.664111:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.664123:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305ae5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664156:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.664159:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.664166:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305ae5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997209.664186:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1780997209.664209:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305ae5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664222:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305ae5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664231:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305ae5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997209.664238:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110397824 00010000:00010000:3.0:1780997209.664248:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1780997209.664252:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110397824 00002000:00010000:3.0:1780997209.664313:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1780997209.664325:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5959 00010000:00010000:3.0:1780997209.664330:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305ae61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997209.664339:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2393:x1867507110397824:12345-192.168.206.51@tcp:8:cp.0 00010000:00010000:3.0:1780997209.664343:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.664346:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.664350:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305ae61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664359:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305ae61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664367:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305ae61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664376:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305ae61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1780997209.664397:0:25173:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp t0 exp 0000000000000000 cur 3737 last 0 00010000:00010000:3.0:1780997209.664404:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000020:00000080:0.0:1780997209.664446:0:25173:0:(genops.c:1406:class_connect()) connect: client e4805cfa-ac6d-4d67-bb97-a6c06740fcd0, cookie 0x30fd811c0305ae68 00002000:00010000:3.0:1780997209.664453:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.664460:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305ae6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1780997209.664464:0:25173:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e4805cfa-ac6d-4d67-bb97-a6c06740fcd0/ffff9689bcc14000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00010000:00010000:3.0:1780997209.664472:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.664474:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.664488:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305ae6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1780997209.664493:0:25173:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00010000:00010000:3.0:1780997209.664500:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305ae6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664509:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305ae6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664516:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305ae6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664525:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1780997209.664570:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.664577:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305ae76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1780997209.664581:0:25173:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00010000:00010000:3.0:1780997209.664586:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.664589:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.664599:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305ae76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664608:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305ae76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664615:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305ae76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664622:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305ae76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1780997209.664625:0:25173:0:(import.c:65:import_set_state_nolock()) ffff9689bcc17000 : changing import state from RECOVER to FULL 00010000:00010000:3.0:1780997209.664636:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1780997209.664679:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.664685:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e387f1d/0x30fd811c0305ae7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664693:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.664695:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.664698:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e387f1d/0x30fd811c0305ae7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664707:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e387f1d/0x30fd811c0305ae7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664715:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e387f1d/0x30fd811c0305ae7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997209.664731:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110397824:12345-192.168.206.51@tcp:8:cp.0 Request processed in 392us (551us total) trans 0 rc 0/0 00010000:00010000:3.0:1780997209.664742:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e387f1d/0x30fd811c0305ae7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997209.664747:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5959 00010000:00010000:3.0:1780997209.664758:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1780997209.664804:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.664807:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780997209.664809:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305ae84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.664817:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c0305ae45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664818:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.664821:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.664826:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305ae84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.664834:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.664840:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305ae84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.664842:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c0305ae45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664861:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305ae84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.664865:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c0305ae45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664873:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305ae84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664885:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1780997209.664909:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c0305ae45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.664918:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc18c993/0x30fd811c0305ae45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997209.664928:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.664935:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305ae8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.664948:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780997209.664953:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.664955:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c0305ae4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664957:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.664962:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305ae8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.664968:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.664973:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c0305ae4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664978:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305ae8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.664987:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c0305ae4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.664992:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305ae8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665002:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c0305ae4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665004:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305ae8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665024:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a38a13d/0x30fd811c0305ae4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665029:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1780997209.665043:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1780997209.665047:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036b01289/0x30fd811c0305ae53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665060:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.665064:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036b01289/0x30fd811c0305ae53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665072:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036b01289/0x30fd811c0305ae53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997209.665075:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.665085:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e8efe3d/0x30fd811c0305ae92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665087:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036b01289/0x30fd811c0305ae53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665099:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.665103:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.665105:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036b01289/0x30fd811c0305ae53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665107:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e8efe3d/0x30fd811c0305ae92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665129:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e8efe3d/0x30fd811c0305ae92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665136:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1780997209.665141:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305ae5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665157:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e8efe3d/0x30fd811c0305ae92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665158:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.665164:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305ae5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665174:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e8efe3d/0x30fd811c0305ae92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665178:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305ae5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665189:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1780997209.665194:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305ae5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665209:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da1df64e/0x30fd811c0305ae5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665229:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1780997209.665233:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305ae61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997209.665236:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.665246:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.665247:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ed15353/0x30fd811c0305ae99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665253:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305ae61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665261:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.665265:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.665301:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305ae61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665316:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305ae61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665324:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d98bc3/0x30fd811c0305ae61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665339:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1780997209.665343:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305ae6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665350:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.665356:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ed15353/0x30fd811c0305ae99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665360:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305ae6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665376:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ed15353/0x30fd811c0305ae99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665378:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305ae6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665407:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ed15353/0x30fd811c0305ae99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665413:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305ae6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665416:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ed15353/0x30fd811c0305ae99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665431:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000635f2ec0/0x30fd811c0305ae6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665436:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1780997209.665446:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1780997209.665450:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305ae76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665456:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956fc00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.665459:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305ae76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665468:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305ae76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665479:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305ae76 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665485:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305ae76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997209.665493:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.665500:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075b5c411/0x30fd811c0305aea0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665513:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.665515:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.665516:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780997209.665519:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075b5c411/0x30fd811c0305aea0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665521:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e387f1d/0x30fd811c0305ae7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665536:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075b5c411/0x30fd811c0305aea0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665537:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956ee00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.665543:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e387f1d/0x30fd811c0305ae7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665553:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075b5c411/0x30fd811c0305aea0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665558:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e387f1d/0x30fd811c0305ae7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665565:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075b5c411/0x30fd811c0305aea0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665576:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e387f1d/0x30fd811c0305ae7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665579:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1780997209.665590:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e387f1d/0x30fd811c0305ae7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665606:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1780997209.665609:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305ae84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665617:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.665621:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305ae84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997209.665625:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.665632:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc04bcc3/0x30fd811c0305aea7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665653:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.665654:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305ae84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665655:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.665661:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc04bcc3/0x30fd811c0305aea7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665669:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305ae84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665673:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc04bcc3/0x30fd811c0305aea7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665678:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b4ca3c/0x30fd811c0305ae84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665700:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc04bcc3/0x30fd811c0305aea7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665704:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780997209.665707:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc04bcc3/0x30fd811c0305aea7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665709:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305ae8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665728:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956ec00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.665732:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1780997209.665733:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305ae8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665743:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305ae8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665753:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305ae8b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665762:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305ae8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997209.665784:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.665788:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780997209.665791:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305aeae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665793:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e8efe3d/0x30fd811c0305ae92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665813:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.665813:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.665818:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.665820:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e8efe3d/0x30fd811c0305ae92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665822:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305aeae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665842:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e8efe3d/0x30fd811c0305ae92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665845:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305aeae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665866:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305aeae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665871:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e8efe3d/0x30fd811c0305ae92 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665874:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305aeae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665892:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e8efe3d/0x30fd811c0305ae92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665895:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1780997209.665907:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1780997209.665912:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ed15353/0x30fd811c0305ae99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665921:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.665924:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ed15353/0x30fd811c0305ae99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665946:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ed15353/0x30fd811c0305ae99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997209.665948:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.665958:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000524b339/0x30fd811c0305aeb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665964:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ed15353/0x30fd811c0305ae99 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665969:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.665972:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.665976:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000524b339/0x30fd811c0305aeb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.665979:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ed15353/0x30fd811c0305ae99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.665997:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000524b339/0x30fd811c0305aeb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666004:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780997209.666007:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000524b339/0x30fd811c0305aeb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666009:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075b5c411/0x30fd811c0305aea0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666025:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000524b339/0x30fd811c0305aeb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666027:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.666034:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075b5c411/0x30fd811c0305aea0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666039:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1780997209.666047:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075b5c411/0x30fd811c0305aea0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666059:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075b5c411/0x30fd811c0305aea0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666067:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075b5c411/0x30fd811c0305aea0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997209.666081:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.666087:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305aebc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666093:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780997209.666096:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.666098:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc04bcc3/0x30fd811c0305aea7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666099:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.666104:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305aebc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666116:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.666122:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc04bcc3/0x30fd811c0305aea7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666123:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305aebc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666130:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc04bcc3/0x30fd811c0305aea7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666146:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305aebc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666152:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc04bcc3/0x30fd811c0305aea7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666158:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305aebc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666168:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc04bcc3/0x30fd811c0305aea7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666173:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1780997209.666187:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1780997209.666191:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305aeae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666198:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956ea00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.666202:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305aeae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997209.666219:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.666221:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305aeae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666227:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e514cc/0x30fd811c0305aec3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666237:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305aeae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666239:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.666242:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.666248:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058e514cc/0x30fd811c0305aec3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666251:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305aeae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666265:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058e514cc/0x30fd811c0305aec3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666298:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997209.666301:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e514cc/0x30fd811c0305aec3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666304:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000524b339/0x30fd811c0305aeb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666321:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058e514cc/0x30fd811c0305aec3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666322:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.666328:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000524b339/0x30fd811c0305aeb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666337:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1780997209.666341:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000524b339/0x30fd811c0305aeb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666356:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000524b339/0x30fd811c0305aeb5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666365:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000524b339/0x30fd811c0305aeb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997209.666401:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.666405:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997209.666408:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305aeca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666410:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305aebc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666430:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.666431:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956fe00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.666435:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.666437:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305aebc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666441:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305aeca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666455:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305aebc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666460:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305aeca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666470:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305aebc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666473:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305aeca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666489:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305aebc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666492:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305aeca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666508:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1780997209.666511:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780997209.666516:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058e514cc/0x30fd811c0305aec3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666524:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.666527:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e514cc/0x30fd811c0305aec3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666547:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e514cc/0x30fd811c0305aec3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997209.666548:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.666557:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf2ef847/0x30fd811c0305aed1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666564:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058e514cc/0x30fd811c0305aec3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666567:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.666570:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.666574:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf2ef847/0x30fd811c0305aed1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666580:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058e514cc/0x30fd811c0305aec3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666588:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf2ef847/0x30fd811c0305aed1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666598:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997209.666605:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305aeca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666609:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf2ef847/0x30fd811c0305aed1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666618:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956fa00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.666624:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305aeca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666625:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf2ef847/0x30fd811c0305aed1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666645:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305aeca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666647:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997209.666660:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305aeca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666668:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305aeca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997209.666691:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.666694:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997209.666698:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305aed8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666700:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf2ef847/0x30fd811c0305aed1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666718:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.666720:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.666722:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.666725:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf2ef847/0x30fd811c0305aed1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666727:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305aed8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.666747:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf2ef847/0x30fd811c0305aed1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666750:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305aed8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666763:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305aed8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666770:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305aed8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666778:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997209.666821:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.666826:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305aedf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666833:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.666835:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.666838:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305aedf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666847:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305aedf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666854:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305aedf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666861:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305aedf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666868:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1780997209.666902:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.666907:0:25181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305aee6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666914:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.666916:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.666919:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305aee6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666926:0:25181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305aee6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666939:0:25181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305aee6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666946:0:25181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305aee6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.666954:0:25181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:3.0:1780997209.667219:0:25181:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:770 00000100:00100000:3.0:1780997209.667362:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:88359:x1867507126950656:12345-0@lo:5:osp-pre-0-0.0 Request processed in 25753us (25892us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997209.667373:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5957 00000100:00100000:2.0:1780997209.668173:0:88359:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88359:1867507126950656:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1780997209.668194:0:88359:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x341:0x0] from OST, last_created [0x280000400:0x341:0x0]last_used is [0x280000400:0x302:0x0] 00000100:00100000:2.0:1780997209.668323:0:88359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88359:1867507126951040:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1780997209.668605:0:88359:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780997209.668606:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780997209.668619:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305aed8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668643:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.668648:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305aed8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997209.668654:0:88359:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885805600 going to sleep for 11 seconds 00010000:00010000:1.0:1780997209.668659:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305aed8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997209.668680:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126950912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1780997209.668682:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305aed8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668694:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305aed8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997209.668718:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780997209.668721:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997209.668727:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305aedf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668735:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.668738:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305aedf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668746:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305aedf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997209.668772:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126951040 00010000:00010000:1.0:1780997209.668776:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305aedf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668787:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029cab9fc/0x30fd811c0305aedf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997209.668790:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126951040 00010000:00010000:1.0:1780997209.668806:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997209.668809:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305aee6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668815:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.668819:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305aee6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668826:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305aee6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668833:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305aee6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668840:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040d4b986/0x30fd811c0305aee6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668851:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.668852:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.668858:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780997209.668891:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997209.668898:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8de7500/0x30fd811c0305aeed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668909:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.668910:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.668915:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8de7500/0x30fd811c0305aeed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668930:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8de7500/0x30fd811c0305aeed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668939:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8de7500/0x30fd811c0305aeed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668949:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8de7500/0x30fd811c0305aeed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668963:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997209.668970:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997209.668973:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8de7500/0x30fd811c0305aeed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.668979:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.668982:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8de7500/0x30fd811c0305aeed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669000:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8de7500/0x30fd811c0305aeed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669010:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8de7500/0x30fd811c0305aeed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669016:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8de7500/0x30fd811c0305aeed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669030:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.669032:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.669033:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780997209.669147:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997209.669153:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c0305aef4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669160:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.669162:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.669165:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c0305aef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669174:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c0305aef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669182:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c0305aef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669200:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c0305aef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669210:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997209.669216:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997209.669219:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c0305aef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669225:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.669229:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c0305aef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669236:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c0305aef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669246:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c0305aef4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669253:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff6bade/0x30fd811c0305aef4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669265:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.669267:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.669290:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780997209.669333:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997209.669343:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000737bc130/0x30fd811c0305aefb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669351:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.669353:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.669356:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000737bc130/0x30fd811c0305aefb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669365:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000737bc130/0x30fd811c0305aefb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669372:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000737bc130/0x30fd811c0305aefb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669380:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000737bc130/0x30fd811c0305aefb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669402:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997209.669409:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997209.669412:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000737bc130/0x30fd811c0305aefb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669418:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.669422:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000737bc130/0x30fd811c0305aefb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669428:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000737bc130/0x30fd811c0305aefb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669447:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000737bc130/0x30fd811c0305aefb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669453:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000737bc130/0x30fd811c0305aefb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669465:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.669466:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.669468:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780997209.669514:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997209.669519:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bed558eb/0x30fd811c0305af02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669525:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.669527:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.669529:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bed558eb/0x30fd811c0305af02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669537:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bed558eb/0x30fd811c0305af02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669544:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bed558eb/0x30fd811c0305af02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669552:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bed558eb/0x30fd811c0305af02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669573:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997209.669580:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997209.669583:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bed558eb/0x30fd811c0305af02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669590:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.669594:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bed558eb/0x30fd811c0305af02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669602:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bed558eb/0x30fd811c0305af02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669613:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bed558eb/0x30fd811c0305af02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669621:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bed558eb/0x30fd811c0305af02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669633:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.669635:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.669637:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780997209.669680:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997209.669685:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305af09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669693:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.669699:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.669702:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305af09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669710:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305af09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669718:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305af09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669725:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305af09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669736:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997209.669744:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997209.669747:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305af09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669754:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.669758:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305af09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669765:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305af09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669774:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305af09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669790:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305af09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669801:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.669803:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.669804:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780997209.669845:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997209.669850:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305af10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669857:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.669858:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.669861:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305af10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669869:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305af10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669875:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305af10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669882:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305af10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669903:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997209.669927:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997209.669934:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305af10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997209.669937:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.669944:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.669948:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305af17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.669950:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305af10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669969:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.669972:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305af10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669974:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.669979:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305af17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.669994:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305af10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.669995:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305af17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670016:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305af17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670028:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305af17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670043:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005015db48/0x30fd811c0305af10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670044:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997209.670076:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997209.670081:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305af17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997209.670084:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.670093:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.670095:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305af1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670098:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305af17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670112:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.670115:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305af17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670116:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.670121:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305af1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670137:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305af1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670145:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305af17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670157:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305af1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670160:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a774bf5/0x30fd811c0305af17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670176:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305af1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670182:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997209.670186:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997209.670190:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997209.670191:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1780997209.670194:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305af1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670214:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.670218:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305af1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670226:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305af1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997209.670234:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.670239:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305af1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670242:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305af25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670255:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025c5156e/0x30fd811c0305af1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670258:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.670261:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.670266:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305af25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670300:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305af25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670309:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305af25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670318:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305af25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670326:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997209.670371:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997209.670376:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305af2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670385:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.670386:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.670401:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305af2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670410:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305af2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670418:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305af2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670424:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305af2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670432:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780997209.670467:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997209.670472:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305af33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670479:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.670481:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.670483:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305af33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670492:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305af33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670506:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305af33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670513:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305af33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670522:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997209.670531:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997209.670538:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305af25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670547:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.670551:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305af25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670559:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305af25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997209.670560:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997209.670570:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a65ab7d3/0x30fd811c0305af3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670576:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305af25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670580:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.670581:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.670586:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a65ab7d3/0x30fd811c0305af3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670596:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea79c821/0x30fd811c0305af25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670603:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a65ab7d3/0x30fd811c0305af3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670613:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a65ab7d3/0x30fd811c0305af3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670614:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997209.670621:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305af2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670627:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a65ab7d3/0x30fd811c0305af3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670632:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.670638:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305af2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670645:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997209.670649:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305af2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670665:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305af2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670674:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a3a34e9/0x30fd811c0305af2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670687:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997209.670690:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305af33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997209.670695:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.670697:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.670702:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c471ea7d/0x30fd811c0305af41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670710:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305af33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670715:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.670719:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.670724:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305af33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670724:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c471ea7d/0x30fd811c0305af41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670749:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c471ea7d/0x30fd811c0305af41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670751:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305af33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670764:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c471ea7d/0x30fd811c0305af41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670767:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd582d53/0x30fd811c0305af33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670779:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c471ea7d/0x30fd811c0305af41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670790:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997209.670791:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997209.670796:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a65ab7d3/0x30fd811c0305af3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670804:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.670808:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a65ab7d3/0x30fd811c0305af3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670816:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a65ab7d3/0x30fd811c0305af3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670827:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a65ab7d3/0x30fd811c0305af3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997209.670831:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.670838:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a65ab7d3/0x30fd811c0305af3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670841:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e82227e9/0x30fd811c0305af48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670849:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.670852:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.670858:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e82227e9/0x30fd811c0305af48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670867:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997209.670870:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e82227e9/0x30fd811c0305af48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670873:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c471ea7d/0x30fd811c0305af41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670891:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.670897:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c471ea7d/0x30fd811c0305af41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670898:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e82227e9/0x30fd811c0305af48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670918:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c471ea7d/0x30fd811c0305af41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670919:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e82227e9/0x30fd811c0305af48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.670942:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997209.670943:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c471ea7d/0x30fd811c0305af41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670953:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c471ea7d/0x30fd811c0305af41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670969:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997209.670973:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e82227e9/0x30fd811c0305af48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.670981:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.670984:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e82227e9/0x30fd811c0305af48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997209.670986:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997209.670997:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000012f60ee/0x30fd811c0305af4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671017:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.671020:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.671021:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e82227e9/0x30fd811c0305af48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671023:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000012f60ee/0x30fd811c0305af4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671047:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000012f60ee/0x30fd811c0305af4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671048:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e82227e9/0x30fd811c0305af48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671059:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000012f60ee/0x30fd811c0305af4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671067:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000012f60ee/0x30fd811c0305af4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671077:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997209.671124:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997209.671130:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cc89c22/0x30fd811c0305af56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671138:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.671140:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1780997209.671143:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5960 00010000:00010000:1.0:1780997209.671144:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cc89c22/0x30fd811c0305af56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671158:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cc89c22/0x30fd811c0305af56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997209.671164:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:88359:x1867507126951040:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1780997209.671172:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cc89c22/0x30fd811c0305af56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671180:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cc89c22/0x30fd811c0305af56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671189:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997209.671210:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e82227e9/0x30fd811c0305af48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671226:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00080000:2.0:1780997209.671227:0:25177:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 834 00010000:00010000:3.0:1780997209.671229:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000012f60ee/0x30fd811c0305af4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997209.671234:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.671237:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.671241:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005298fbc2/0x30fd811c0305af5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671242:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000012f60ee/0x30fd811c0305af4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671264:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000012f60ee/0x30fd811c0305af4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671265:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.671292:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.671295:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005298fbc2/0x30fd811c0305af5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671296:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000012f60ee/0x30fd811c0305af4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671319:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005298fbc2/0x30fd811c0305af5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671335:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005298fbc2/0x30fd811c0305af5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671343:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005298fbc2/0x30fd811c0305af5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.671352:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997209.671375:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000012f60ee/0x30fd811c0305af4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671410:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997209.671414:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cc89c22/0x30fd811c0305af56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671421:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.671424:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cc89c22/0x30fd811c0305af56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671433:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cc89c22/0x30fd811c0305af56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671443:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cc89c22/0x30fd811c0305af56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671451:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cc89c22/0x30fd811c0305af56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671462:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997209.671466:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005298fbc2/0x30fd811c0305af5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671473:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2055e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.671515:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf2ef847/0x30fd811c0305aed1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.671524:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf2ef847/0x30fd811c0305aed1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671541:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005298fbc2/0x30fd811c0305af5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671562:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005298fbc2/0x30fd811c0305af5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671575:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005298fbc2/0x30fd811c0305af5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.671582:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997209.671584:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005298fbc2/0x30fd811c0305af5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.671603:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997209.671605:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997209.671608:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.671615:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.671623:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.671625:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.671627:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997209.672584:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126950912 00000100:00100000:3.0:1780997209.672598:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126950912 00000100:00100000:3.0:1780997209.672654:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:3.0:1780997209.672664:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126950912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780997209.672687:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 896 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997209.672787:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126950912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (4070us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997209.672795:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00100000:2.0:1780997209.675064:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:88359:x1867507126951040:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3902us (6454us total) trans 4294969455 rc 0/0 00000100:00100000:2.0:1780997209.675079:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5960 00000100:00100000:2.0:1780997209.675188:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126950912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780997209.675307:0:88359:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88359:1867507126951040:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1780997209.675333:0:88359:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x341:0x0]-[0x280000400:0x361:0x0] 00002000:00010000:1.0:1780997209.676076:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997209.676090:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305af64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.676114:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.676117:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.676500:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305af64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.676521:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305af64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.676533:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305af64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.676542:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305af64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676622:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997209.676742:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.676749:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305af6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676768:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.676770:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.676773:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305af6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676783:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305af6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676790:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305af6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676798:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305af6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676814:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1780997209.676825:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780997209.676832:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305af64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676839:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.676844:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305af64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676853:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305af64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676881:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305af64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676889:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002347e9cc/0x30fd811c0305af64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676911:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997209.676914:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305af6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676922:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ef600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.676925:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305af6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676932:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305af6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676941:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305af6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676947:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000beebc7ca/0x30fd811c0305af6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.676960:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.676962:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.676968:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997209.677013:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.677020:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305af72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677027:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.677029:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.677032:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305af72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677041:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305af72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677048:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305af72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677055:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305af72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677068:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997209.677074:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997209.677079:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305af72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677085:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4efc00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.677088:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305af72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677106:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305af72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677116:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305af72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677215:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b3f2e5c/0x30fd811c0305af72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677230:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.677231:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.677233:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997209.677291:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.677296:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305af79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677304:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.677305:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.677308:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305af79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677319:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305af79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677328:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305af79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677346:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305af79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677358:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997209.677413:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.677418:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004782dfa1/0x30fd811c0305af80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677425:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.677427:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.677431:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004782dfa1/0x30fd811c0305af80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677439:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004782dfa1/0x30fd811c0305af80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677446:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004782dfa1/0x30fd811c0305af80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677453:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004782dfa1/0x30fd811c0305af80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677470:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1780997209.677514:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.677519:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305af87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677532:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.677533:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.677537:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305af87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677546:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305af87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677555:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305af87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677562:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305af87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677576:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1780997209.677584:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1780997209.677588:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305af79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.677596:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780997209.677597:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4efa00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.677602:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305af79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.677606:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004782dfa1/0x30fd811c0305af80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677617:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305af79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.677634:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.677639:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004782dfa1/0x30fd811c0305af80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677652:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305af79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.677653:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004782dfa1/0x30fd811c0305af80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677678:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021ec6d15/0x30fd811c0305af79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.677683:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004782dfa1/0x30fd811c0305af80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.677693:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004782dfa1/0x30fd811c0305af80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677698:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997209.677703:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305af87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.677711:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.677712:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.677715:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997209.677718:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.677718:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305af87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677730:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305af87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677741:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305af87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677749:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a95b68ca/0x30fd811c0305af87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677762:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.677764:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.677771:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.677779:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997209.677824:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.677830:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000179ace1c/0x30fd811c0305af8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677838:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.677839:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.677843:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000179ace1c/0x30fd811c0305af8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677852:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000179ace1c/0x30fd811c0305af8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677859:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000179ace1c/0x30fd811c0305af8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677866:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000179ace1c/0x30fd811c0305af8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677887:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997209.677922:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.677927:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305af95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677935:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.677937:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.677940:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305af95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677958:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305af95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677966:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305af95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677973:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305af95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.677986:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1780997209.677992:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780997209.677996:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000179ace1c/0x30fd811c0305af8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678002:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ef400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.678005:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000179ace1c/0x30fd811c0305af8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678013:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000179ace1c/0x30fd811c0305af8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678022:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000179ace1c/0x30fd811c0305af8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678029:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000179ace1c/0x30fd811c0305af8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678052:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997209.678055:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305af95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678062:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4eee00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.678065:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305af95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678072:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305af95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678081:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305af95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678088:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af72f9d2/0x30fd811c0305af95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678099:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.678100:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.678102:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997209.678468:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.678475:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305af9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678484:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.678490:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.678493:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305af9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678503:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305af9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678511:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305af9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678519:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305af9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678533:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997209.678573:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.678579:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305afa3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678587:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.678589:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.678592:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305afa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.678594:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997209.678602:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305af9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678605:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305afa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.678619:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.678624:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305af9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.678632:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305af9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.678646:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305af9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.678651:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e69fd9/0x30fd811c0305af9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.678661:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997209.678662:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997209.678663:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.678671:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305afa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.678694:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305afa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997209.678895:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997209.678958:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110397952 00000100:00100000:1.0:1780997209.678975:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110397952 00000100:00100000:1.0:1780997209.679043:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5961 00000100:00100000:1.0:1780997209.679056:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:0:x1867507110397952:12345-192.168.206.51@tcp:101:cp.0 00010000:00010000:1.0:1780997209.679087:0:8233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997209.679111:0:8233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085d3fbcb/0x30fd811c0305afaa lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d59 expref: -99 pid: 8233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997209.679532:0:8233:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x622:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997209.679575:0:8233:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.679577:0:8233:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.679585:0:8233:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085d3fbcb/0x30fd811c0305afaa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d59 expref: 7 pid: 8233 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.679600:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997209.679605:0:8233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085d3fbcb/0x30fd811c0305afaa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d59 expref: 7 pid: 8233 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.679610:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305afa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.679622:0:8233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02c00, rc 0) 00010000:00010000:2.0:1780997209.679633:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997209.679637:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305afa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.679647:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305afa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.679661:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305afa3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997209.679670:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.679671:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.679673:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.679851:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780997209.679857:0:25174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000350cedf7/0x30fd811c0305afa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.679903:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780997209.679975:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.679981:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e45526f/0x30fd811c0305afb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.679990:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.679991:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.679994:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e45526f/0x30fd811c0305afb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.680005:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e45526f/0x30fd811c0305afb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.680015:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e45526f/0x30fd811c0305afb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.680023:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e45526f/0x30fd811c0305afb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.680053:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997209.680090:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.680094:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a14ea63/0x30fd811c0305afb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.680101:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.680103:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.680106:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a14ea63/0x30fd811c0305afb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.680115:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a14ea63/0x30fd811c0305afb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680149:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997209.680155:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e45526f/0x30fd811c0305afb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680164:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4eea00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.680167:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e45526f/0x30fd811c0305afb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680175:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e45526f/0x30fd811c0305afb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680185:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e45526f/0x30fd811c0305afb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680191:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e45526f/0x30fd811c0305afb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680213:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997209.680215:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997209.680216:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997209.680263:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:0:x1867507110397952:12345-192.168.206.51@tcp:101:cp.0 Request processed in 1209us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997209.680325:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5961 00000100:00080000:1.0:1780997209.680358:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1780997209.680373:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.680460:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a14ea63/0x30fd811c0305afb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.680469:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a14ea63/0x30fd811c0305afb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.680734:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780997209.680792:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780997209.680799:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4f0299/0x30fd811c0305afbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.680808:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.680810:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.680819:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4f0299/0x30fd811c0305afbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.680830:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb4f0299/0x30fd811c0305afbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680831:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997209.680839:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a14ea63/0x30fd811c0305afb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.680843:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4f0299/0x30fd811c0305afbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680853:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffc200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997209.680860:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4f0299/0x30fd811c0305afbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680861:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a14ea63/0x30fd811c0305afb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680882:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a14ea63/0x30fd811c0305afb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680896:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a14ea63/0x30fd811c0305afb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680904:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a14ea63/0x30fd811c0305afb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680921:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997209.680925:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb4f0299/0x30fd811c0305afbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.680930:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1780997209.680931:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffde00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997209.680942:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4f0299/0x30fd811c0305afbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680950:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4f0299/0x30fd811c0305afbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680962:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb4f0299/0x30fd811c0305afbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.680968:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb4f0299/0x30fd811c0305afbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997209.680977:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.680982:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997209.680985:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.680985:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9b491ae/0x30fd811c0305afc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.680996:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.680998:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.681001:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9b491ae/0x30fd811c0305afc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.681017:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9b491ae/0x30fd811c0305afc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.681026:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9b491ae/0x30fd811c0305afc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.681044:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9b491ae/0x30fd811c0305afc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.685809:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997209.685826:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9b491ae/0x30fd811c0305afc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.685843:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffc800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.685858:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9b491ae/0x30fd811c0305afc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.685873:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9b491ae/0x30fd811c0305afc6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.685899:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9b491ae/0x30fd811c0305afc6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.685910:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.685912:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.685915:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997209.699652:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997209.701126:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997209.702896:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780997209.702914:0:25174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9b491ae/0x30fd811c0305afc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997209.706582:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997209.707704:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110398080 00000100:00100000:1.0:1780997209.707721:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110398080 00000100:00100000:1.0:1780997209.707783:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5962 00000100:00100000:1.0:1780997209.707796:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:70338:x1867507110398080:12345-192.168.206.51@tcp:101:cp.0 00010000:00010000:1.0:1780997209.707822:0:25170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997209.707847:0:25170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305afcd lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d60 expref: -99 pid: 25170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.707890:0:25170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085d3fbcb/0x30fd811c0305afaa lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d59 expref: 8 pid: 8233 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.707900:0:25170:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.707903:0:25170:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997209.707908:0:25170:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305afcd lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d60 expref: 8 pid: 25170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.707968:0:25170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085d3fbcb/0x30fd811c0305afaa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d59 expref: 8 pid: 8233 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.707985:0:25170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085d3fbcb/0x30fd811c0305afaa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d59 expref: 8 pid: 8233 timeout: 3837 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997209.708001:0:25170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25170:1867507126951168:192.168.206.51@tcp:104: 00000100:00100000:1.0:1780997209.708101:0:25170:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb59c0 going to sleep for 11 seconds 00002000:00010000:3.0:1780997209.710649:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997209.710663:0:25174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305afd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.710693:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.710695:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997209.710701:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305afd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.710718:0:25174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305afd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.710730:0:25174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305afd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.710747:0:25174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305afd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997209.710777:0:25174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1780997209.711307:0:25174:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:771 00000100:00100000:3.0:1780997209.711446:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:88361:x1867507126950784:12345-0@lo:5:osp-pre-1-0.0 Request processed in 66431us (66949us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997209.711460:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5958 00000100:00100000:3.0:1780997209.711545:0:88361:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88361:1867507126950784:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1780997209.711569:0:88361:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x341:0x0] from OST, last_created [0x2c0000401:0x341:0x0]last_used is [0x2c0000401:0x303:0x0] 00000100:00100000:3.0:1780997209.711664:0:88361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88361:1867507126951424:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1780997209.711680:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126951296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780997209.711702:0:88361:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997209.711718:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997209.711727:0:88361:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688875b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1780997209.711753:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126951424 00000100:00100000:2.0:1780997209.711760:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126951424 00000100:00100000:2.0:1780997209.711808:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5963 00000100:00100000:2.0:1780997209.711818:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:88361:x1867507126951424:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1780997209.711991:0:25180:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 834 00010000:00010000:1.0:1780997209.712360:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997209.712371:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305afd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.712384:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997209.712398:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305afd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.712411:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305afd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.712434:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305afd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.712441:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305afd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.712484:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.712486:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997209.712488:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997209.716046:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126951296 00000100:00100000:3.0:1780997209.716076:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126951296 00000100:00100000:3.0:1780997209.716167:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:3.0:1780997209.716181:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126951296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780997209.716217:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 896 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997209.716344:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126951296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (4623us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997209.716351:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:2.0:1780997209.716696:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:88361:x1867507126951424:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4877us (4992us total) trans 4294969454 rc 0/0 00000100:00100000:2.0:1780997209.716706:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5963 00000100:00100000:2.0:1780997209.716770:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126951296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780997209.718961:0:88361:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88361:1867507126951424:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1780997209.718986:0:88361:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x341:0x0]-[0x2c0000401:0x361:0x0] 00000100:00100000:0.0:1780997209.730038:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997209.730106:0:6337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110398208 00000100:00100000:0.0:1780997209.730127:0:6337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110398208 00010000:00010000:0.0:1780997209.730184:0:6337:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085d3fbcb/0x30fd811c0305afaa lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d59 expref: 9 pid: 8233 timeout: 3837 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997209.730234:0:6337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2564 00000100:00100000:0.0:1780997209.730248:0:6337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b6208450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2394:x1867507110398208:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780997209.730289:0:6337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997209.730318:0:6337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085d3fbcb/0x30fd811c0305afaa lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d59 expref: 9 pid: 8233 timeout: 3837 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.730355:0:6337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085d3fbcb/0x30fd811c0305afaa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d59 expref: 9 pid: 8233 timeout: 3837 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.730396:0:6337:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.730408:0:6337:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997209.730421:0:6337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305afcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d60 expref: 9 pid: 25170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.730433:0:6337:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305afcd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d60 expref: 9 pid: 25170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997209.730485:0:6337:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305afcd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d60 expref: 9 pid: 25170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997209.730502:0:6337:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6337:1867507126951552:192.168.206.51@tcp:105: 00000100:00100000:0.0:1780997209.730616:0:6337:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689c2064600 going to sleep for 11 seconds 00000100:00100000:0.0:1780997209.733844:0:6337:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6337:1867507126951552:192.168.206.51@tcp:105: 00010000:00010000:0.0:1780997209.733877:0:6337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997209.733946:0:6337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b6208450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2394:x1867507110398208:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 3701us (3923us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997209.733961:0:6337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2564 00010000:00010000:1.0:1780997209.734845:0:25170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085d3fbcb/0x30fd811c0305afaa lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d59 expref: 8 pid: 8233 timeout: 3837 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997209.734866:0:25170:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:25170:1867507126951168:192.168.206.51@tcp:104: 00010000:00010000:1.0:1780997209.734910:0:25170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305afcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d60 expref: 7 pid: 25170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997209.734928:0:25170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03000, rc 0) 00000100:00100000:1.0:1780997209.734969:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:70338:x1867507110398080:12345-192.168.206.51@tcp:101:cp.0 Request processed in 27177us (28401us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997209.734977:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5962 00000100:00100000:0.0:1780997209.762096:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997209.762175:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110398464 00000100:00100000:3.0:1780997209.762189:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110398464 00000100:00100000:3.0:1780997209.762254:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 231 00000100:00100000:3.0:1780997209.762267:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:70338:x1867507110398464:12345-192.168.206.51@tcp:35:cp.0 00000001:00080000:3.0:1780997209.762599:0:63421:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378740 00000100:00100000:3.0:1780997209.762734:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:70338:x1867507110398464:12345-192.168.206.51@tcp:35:cp.0 Request processed in 469us (654us total) trans 81604378741 rc 0/0 00000100:00100000:3.0:1780997209.762742:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 231 00000020:00080000:3.0:1780997209.762748:0:63421:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1780997209.831696:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997209.864882:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997209.864943:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997209.864982:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110398592 00000100:00100000:1.0:1780997209.864995:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110398592 00000100:00100000:1.0:1780997209.865062:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:1.0:1780997209.865074:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110398592:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997209.865170:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110398592:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 98us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997209.865179:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:1.0:1780997209.865228:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110398720 00000100:00100000:1.0:1780997209.865246:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110398720 00000100:00100000:1.0:1780997209.865316:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1318 00000100:00100000:1.0:1780997209.865324:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110398720:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997209.865489:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110398720:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 165us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997209.865497:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1318 00010000:00010000:0.0:1780997210.854579:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1780997211.087173:0:88711:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1780997211.087670:0:88711:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1780997211.250973:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997211.251144:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110398848 00000100:00100000:3.0:1780997211.251158:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110398848 00000100:00100000:3.0:1780997211.251242:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1363 00000100:00100000:3.0:1780997211.251254:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:70605:x1867507110398848:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:3.0:1780997211.251303:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1780997211.251433:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1780997211.251783:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968980031c00/0x30fd811c0305afdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d67 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780997211.257158:0:65272:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5302us 00010000:00010000:1.0:1780997211.283695:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305afe2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.283726:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305afe2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.283743:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305afe2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.283763:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305afe9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.283770:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305afe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.283777:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305afe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997211.283974:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:65272:1867507126951680:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997211.284064:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997211.284128:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997211.284262:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126951680 00000100:00100000:3.0:1780997211.284299:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126951680 00000100:00100000:3.0:1780997211.284363:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035 00000100:00100000:3.0:1780997211.284373:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65272:x1867507126951680:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1780997211.284473:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65272:x1867507126951680:12345-0@lo:1000:mdt00_004.0 Request processed in 101us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997211.284481:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035 00000100:00100000:1.0:1780997211.285122:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:65272:1867507126951680:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1780997211.285190:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305aff0 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285205:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305aff0 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285216:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305aff0 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997211.285257:0:65272:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305aff0 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285297:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305afe2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285365:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305afe2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285372:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305afe2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285400:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305afe2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285408:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997211.285413:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305afe2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285421:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305afe2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285450:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:1.0:1780997211.285453:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997211.285459:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305afe2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285468:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305afe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285481:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305afe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285488:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305afe9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285494:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305afe9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285500:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997211.285503:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305afe9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285508:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305afe9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285514:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9689882bd200) 00010000:00010000:1.0:1780997211.285516:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997211.285519:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305afe9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285525:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305afe9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285580:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968980031c00/0x30fd811c0305afdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d67 expref: 9 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285596:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305aff0 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d67 expref: 8 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.285605:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9689882bd300) 00010000:00010000:1.0:1780997211.285607:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780997211.285609:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02800, rc 0) 00000100:00100000:1.0:1780997211.285682:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:70605:x1867507110398848:12345-192.168.206.51@tcp:101:rm.0 Request processed in 34431us (34724us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997211.285691:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1363 00000100:00100000:0.0:1780997211.290774:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997211.295447:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110398976 00000100:00100000:3.0:1780997211.295479:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110398976 00000100:00100000:3.0:1780997211.295568:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1364 00000100:00100000:3.0:1780997211.295580:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:70605:x1867507110398976:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:3.0:1780997211.295612:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997211.295639:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305aff7 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d6e expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.295732:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968980031600/0x30fd811c0305affe lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.295749:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968980031600/0x30fd811c0305affe lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.295763:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968980031600/0x30fd811c0305affe lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997211.295827:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00000004:00200000:3.0:1780997211.295832:0:63419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1780997211.295878:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305aff7 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d6e expref: 14 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.295901:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968980031600/0x30fd811c0305affe lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d6e expref: 13 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.295911:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898962f900) 00010000:00010000:3.0:1780997211.295914:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1780997211.295919:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968980031600, rc 0) 00000100:00100000:3.0:1780997211.296002:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:70605:x1867507110398976:12345-192.168.206.51@tcp:101:rm.0 Request processed in 424us (5242us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997211.296020:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1364 00000100:00080000:3.0:1780997211.296047:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997211.316424:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997211.316604:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110399232 00000100:00100000:1.0:1780997211.316618:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110399232 00000100:00100000:1.0:1780997211.316693:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1365 00000100:00100000:1.0:1780997211.316705:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:70605:x1867507110399232:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:1.0:1780997211.316735:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997211.316766:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d75 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997211.316906:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1780997211.317029:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b005 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d75 expref: 15 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.317045:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd200) 00010000:00010000:1.0:1780997211.317048:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780997211.317066:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d75 expref: 15 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.317091:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03e00, rc 0) 00000100:00100000:1.0:1780997211.317176:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:70605:x1867507110399232:12345-192.168.206.51@tcp:101:rm.0 Request processed in 472us (765us total) trans 81604378742 rc 301/301 00000100:00100000:1.0:1780997211.317184:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1365 00000100:00100000:2.0:1780997211.327424:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997211.327560:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110399360 00000100:00100000:0.0:1780997211.327573:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110399360 00000100:00100000:0.0:1780997211.327637:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 232 00000100:00100000:0.0:1780997211.327648:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:70605:x1867507110399360:12345-192.168.206.51@tcp:37:rm.0 00000100:00100000:2.0:1780997211.349671:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:70605:x1867507110399360:12345-192.168.206.51@tcp:37:rm.0 Request processed in 22008us (22244us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997211.349690:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 232 00000100:00100000:1.0:1780997211.371627:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997211.371670:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110399616 00000100:00100000:1.0:1780997211.371683:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110399616 00000100:00100000:1.0:1780997211.371741:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 233 00000100:00100000:1.0:1780997211.371751:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889fe5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:70605:x1867507110399616:12345-192.168.206.51@tcp:35:rm.0 00000100:00100000:1.0:1780997211.372040:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889fe5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+15:70605:x1867507110399616:12345-192.168.206.51@tcp:35:rm.0 Request processed in 289us (423us total) trans 81604378743 rc 0/0 00000100:00100000:1.0:1780997211.372048:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 233 00000100:00100000:2.0:1780997211.408645:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997211.408740:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110399872 00000100:00100000:0.0:1780997211.408754:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110399872 00000100:00100000:0.0:1780997211.408846:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1366 00000100:00100000:0.0:1780997211.408858:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+15:70605:x1867507110399872:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1780997211.408891:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997211.408922:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc600/0x30fd811c0305b013 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d7c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.409060:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b01a lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.409078:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b01a lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.409092:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b01a lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997211.409105:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:0.0:1780997211.409234:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc600/0x30fd811c0305b013 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d7c expref: 18 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.409265:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b01a lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d7c expref: 17 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.409310:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898962f900) 00010000:00010000:0.0:1780997211.409313:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780997211.409317:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffdc00, rc 0) 00000100:00100000:0.0:1780997211.409401:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+17:70605:x1867507110399872:12345-192.168.206.51@tcp:101:rm.0 Request processed in 544us (769us total) trans 81604378744 rc 0/0 00000100:00100000:0.0:1780997211.409409:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1366 00000100:00100000:1.0:1780997211.416949:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997211.417038:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110400000 00000100:00100000:3.0:1780997211.417051:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110400000 00000100:00100000:3.0:1780997211.417128:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1367 00000100:00100000:3.0:1780997211.417140:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+17:70605:x1867507110400000:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:3.0:1780997211.417174:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997211.417200:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305b028 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d83 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.417329:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968980031000/0x30fd811c0305b02f lrc: 3/1,0 mode: --/PR res: [0x240006991:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.417346:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968980031000/0x30fd811c0305b02f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.417359:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968980031000/0x30fd811c0305b02f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997211.417422:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xd:0x0]: returning size 4096 00000004:00200000:3.0:1780997211.417426:0:63419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780997211.417449:0:63419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff968980031000/0x30fd811c0305b02f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.417607:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305b028 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d83 expref: 19 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.417629:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968980031000/0x30fd811c0305b02f lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d83 expref: 18 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.417655:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898d235900) 00010000:00010000:3.0:1780997211.417659:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780997211.417663:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968980031000, rc 0) 00000100:00100000:3.0:1780997211.417775:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+18:70605:x1867507110400000:12345-192.168.206.51@tcp:101:rm.0 Request processed in 636us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997211.417784:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1367 00000100:00100000:3.0:1780997211.427744:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997211.427871:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110400256 00000100:00100000:1.0:1780997211.427885:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110400256 00000100:00100000:1.0:1780997211.427958:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1368 00000100:00100000:1.0:1780997211.427970:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+18:70605:x1867507110400256:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:1.0:1780997211.427998:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997211.428024:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b036 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d8a expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997211.428168:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xd:0x0]: returning size 4096 00010000:00010000:1.0:1780997211.428345:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b036 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d8a expref: 20 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.428396:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898962f900) 00010000:00010000:1.0:1780997211.428400:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780997211.428406:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b036 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d8a expref: 20 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.428425:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02a00, rc 0) 00000100:00100000:1.0:1780997211.428500:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+19:70605:x1867507110400256:12345-192.168.206.51@tcp:101:rm.0 Request processed in 532us (770us total) trans 81604378745 rc 301/301 00000100:00100000:1.0:1780997211.428507:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1368 00000100:00100000:2.0:1780997211.439912:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997211.440032:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110400384 00000100:00100000:1.0:1780997211.440047:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110400384 00000100:00100000:1.0:1780997211.440158:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 234 00000100:00100000:1.0:1780997211.440170:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+19:70605:x1867507110400384:12345-192.168.206.51@tcp:37:rm.0 00000100:00100000:1.0:1780997211.451098:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+19:70605:x1867507110400384:12345-192.168.206.51@tcp:37:rm.0 Request processed in 10910us (11181us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997211.451120:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 234 00000100:00100000:3.0:1780997211.457422:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997211.457659:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110400640 00000100:00100000:2.0:1780997211.457681:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110400640 00000100:00100000:2.0:1780997211.457745:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 235 00000100:00100000:2.0:1780997211.457758:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+19:70605:x1867507110400640:12345-192.168.206.51@tcp:35:rm.0 00000100:00100000:2.0:1780997211.458059:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+20:70605:x1867507110400640:12345-192.168.206.51@tcp:35:rm.0 Request processed in 302us (648us total) trans 81604378746 rc 0/0 00000100:00100000:2.0:1780997211.458068:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 235 00000100:00100000:2.0:1780997211.463267:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997211.463418:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110400896 00000100:00100000:0.0:1780997211.463447:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110400896 00000100:00100000:0.0:1780997211.463520:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1369 00000100:00100000:0.0:1780997211.463533:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb4f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+20:70605:x1867507110400896:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1780997211.463565:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997211.463593:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc600/0x30fd811c0305b044 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d91 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.463760:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd800/0x30fd811c0305b04b lrc: 3/1,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.463778:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd800/0x30fd811c0305b04b lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.463799:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd800/0x30fd811c0305b04b lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997211.463811:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xd:0x0]: returning size 4096 00010000:00010000:0.0:1780997211.464086:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc600/0x30fd811c0305b044 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d91 expref: 23 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.464109:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd800/0x30fd811c0305b04b lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d91 expref: 22 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.464119:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898d235900) 00010000:00010000:0.0:1780997211.464127:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1780997211.464132:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffd800, rc 0) 00000100:00100000:0.0:1780997211.464325:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb4f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:70605:x1867507110400896:12345-192.168.206.51@tcp:101:rm.0 Request processed in 793us (1072us total) trans 81604378747 rc 0/0 00000100:00100000:0.0:1780997211.464335:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1369 00000100:00100000:3.0:1780997211.468927:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997211.469300:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110401024 00000100:00100000:1.0:1780997211.469324:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110401024 00000100:00100000:1.0:1780997211.469410:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1370 00000100:00100000:1.0:1780997211.469423:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:70605:x1867507110401024:12345-192.168.206.51@tcp:41:rm.0 00000004:00000024:1.0:1780997211.469502:0:63417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382958080 00000100:00100000:1.0:1780997211.469599:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:70605:x1867507110401024:12345-192.168.206.51@tcp:41:rm.0 Request processed in 179us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997211.469608:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1370 00000100:00100000:3.0:1780997211.475703:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997211.476049:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110401280 00000100:00100000:1.0:1780997211.476064:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110401280 00000100:00100000:1.0:1780997211.476175:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1371 00000100:00100000:1.0:1780997211.476186:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:70605:x1867507110401280:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:1.0:1780997211.476265:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1780997211.476344:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305adf8 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d52 expref: 22 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.476371:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff96898962fb00) 00010000:00010000:1.0:1780997211.476401:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968980031000/0x30fd811c0305b02f lrc: 0/0,0 mode: --/PR res: [0x240006991:0xd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d83 expref: 21 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.476414:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898d235900) 00010000:00010000:1.0:1780997211.476417:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780997211.476442:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b059 lrc: 3/0,1 mode: --/CW res: [0x240006991:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.476458:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b059 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.476469:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b059 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.476492:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03600/0x30fd811c0305b060 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.476500:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03600/0x30fd811c0305b060 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.476508:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03600/0x30fd811c0305b060 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.476633:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b067 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.476641:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b067 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.476649:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b067 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1780997211.476914:0:63584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4e:0x0].2, 64 off8320 00000004:00080000:1.0:1780997211.476925:0:63584:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3739022654111ns, next at 3740022651642ns, rc = 0 00010000:00010000:1.0:1780997211.476975:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b06e lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.476985:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b06e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.476992:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b06e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477001:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b06e lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477007:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b06e lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477015:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b06e lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477044:0:63584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997211.477064:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b067 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477077:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b067 lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477084:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b067 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477090:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997211.477096:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b067 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477104:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b067 lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477115:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9689882bd200) 00010000:00010000:1.0:1780997211.477118:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1780997211.477122:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b067 lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477128:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b067 lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477147:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b059 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477152:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b059 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477158:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b059 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477163:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b059 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477175:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997211.477178:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b059 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477184:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b059 lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477193:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898d235900) 00010000:00010000:1.0:1780997211.477195:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997211.477198:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b059 lrc: 3/0,0 mode: --/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477204:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b059 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997211.477214:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000642fe602 reply state 00000000377a567d transno 81604378748 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03600/0x30fd811c0305b060 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477225:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03600/0x30fd811c0305b060 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.477231:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0xb1bed465 (ffff96898962f100) 00010000:00010000:1.0:1780997211.477233:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997211.477236:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780997211.477364:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:70605:x1867507110401280:12345-192.168.206.51@tcp:36:rm.0 Request processed in 1178us (1674us total) trans 81604378748 rc 0/0 00000100:00100000:1.0:1780997211.477373:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1371 00010000:00010000:2.0:1780997211.477870:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997211.477881:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b06e lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.477898:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997211.477903:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b06e lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.477909:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b06e lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.477921:0:6339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9689882bd200) 00010000:00010000:2.0:1780997211.477923:0:6339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1780997211.477926:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b06e lrc: 1/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.477932:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b06e lrc: 0/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.477951:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997211.477953:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997211.477955:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997211.483391:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997211.483513:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110401536 00000100:00100000:1.0:1780997211.483526:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110401536 00000100:00100000:1.0:1780997211.483590:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 236 00000100:00100000:1.0:1780997211.483618:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:70605:x1867507110401536:12345-192.168.206.51@tcp:35:rm.0 00000100:00100000:1.0:1780997211.484102:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+23:70605:x1867507110401536:12345-192.168.206.51@tcp:35:rm.0 Request processed in 483us (732us total) trans 81604378749 rc 0/0 00000100:00100000:1.0:1780997211.484112:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 236 00000100:00100000:3.0:1780997211.487252:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997211.487447:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110401792 00000100:00100000:0.0:1780997211.487460:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110401792 00000100:00100000:0.0:1780997211.487773:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1372 00000100:00100000:0.0:1780997211.487788:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+23:70605:x1867507110401792:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:0.0:1780997211.487867:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1780997211.487911:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd800/0x30fd811c0305b04b lrc: 0/0,0 mode: --/CR res: [0x240006991:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d91 expref: 23 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.487937:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3600/0x30fd811c0305ab5f lrc: 0/0,0 mode: --/PR res: [0x240006991:0xd:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d1a expref: 22 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.487951:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898d235900) 00010000:00010000:0.0:1780997211.487967:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968980031600/0x30fd811c0305affe lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d6e expref: 21 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.487977:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898962f900) 00010000:00010000:0.0:1780997211.487981:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997211.488004:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305b075 lrc: 3/0,1 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488019:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305b075 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488029:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305b075 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488047:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b07c lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488054:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b07c lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488078:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b07c lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488189:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305b083 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488197:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305b083 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488205:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305b083 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997211.488822:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xd:0x0]: returning size 4096 00010000:00010000:0.0:1780997211.488842:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305b083 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488852:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305b083 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488859:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305b083 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488866:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffc000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997211.488871:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305b083 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488878:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305b083 lrc: 4/0,0 mode: EX/EX res: [0x240006991:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488890:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0x0 (ffff96898d864f00) 00010000:00010000:0.0:1780997211.488893:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1780997211.488906:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305b083 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488913:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305b083 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488937:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305b075 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488943:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305b075 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488948:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305b075 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488955:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305b075 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488959:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffcc00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997211.488962:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305b075 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488968:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305b075 lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488975:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898962f900) 00010000:00010000:0.0:1780997211.488977:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997211.488980:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305b075 lrc: 3/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.488987:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305b075 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997211.488996:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093ece101 reply state 00000000c8d570df transno 81604378750 ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b07c lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.489013:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b07c lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.489019:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xf7117594 (ffff96898d864500) 00010000:00010000:0.0:1780997211.489022:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997211.489025:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997211.489123:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:70605:x1867507110401792:12345-192.168.206.51@tcp:36:rm.0 Request processed in 1336us (1879us total) trans 81604378750 rc 0/0 00000100:00100000:0.0:1780997211.489132:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1372 00000100:00100000:0.0:1780997211.492467:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997211.492704:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997211.493086:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110402176 00000100:00100000:2.0:1780997211.493099:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110402176 00000100:00100000:2.0:1780997211.493175:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 237 00000100:00100000:2.0:1780997211.493187:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:70605:x1867507110402176:12345-192.168.206.51@tcp:35:rm.0 00000100:00100000:1.0:1780997211.493683:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110401920 00000100:00100000:1.0:1780997211.493690:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110401920 00000100:00100000:1.0:1780997211.493742:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 689 00000100:00100000:1.0:1780997211.493751:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2395:x1867507110401920:12345-192.168.206.51@tcp:103:rm.0 00010000:00010000:1.0:1780997211.493764:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997211.493797:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305aff0 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d67 expref: 8 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.493818:0:8261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9689882bd300) 00010000:00010000:1.0:1780997211.493831:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997211.494058:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110401920:12345-192.168.206.51@tcp:103:rm.0 Request processed in 306us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997211.494067:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 689 00000100:00100000:2.0:1780997211.494619:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+23:70605:x1867507110402176:12345-192.168.206.51@tcp:35:rm.0 Request processed in 1432us (1912us total) trans 81604378751 rc 0/0 00000100:00100000:2.0:1780997211.494630:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 237 00000100:00100000:2.0:1780997211.496854:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997211.496979:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110402432 00000100:00100000:3.0:1780997211.496993:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110402432 00000100:00100000:3.0:1780997211.497054:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1373 00000100:00100000:3.0:1780997211.497065:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+23:70605:x1867507110402432:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:3.0:1780997211.497148:0:63419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1780997211.497183:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b01a lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d7c expref: 23 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.497211:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305ab43 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d13 expref: 22 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.497224:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898962f900) 00010000:00010000:3.0:1780997211.497236:0:63419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997211.497768:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.497956:0:63419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.497969:0:63419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997211.498000:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126951808:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1780997211.498063:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997211.498105:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885805240 going to sleep for 11 seconds 00000100:00100000:0.0:1780997211.498122:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126951808 00000100:00100000:0.0:1780997211.498132:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126951808 00000100:00100000:0.0:1780997211.498184:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036 00000100:00100000:0.0:1780997211.498192:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63419:x1867507126951808:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1780997211.498205:0:80061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997211.498222:0:80061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305b091 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b08a expref: -99 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.498250:0:80061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305adce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d05 expref: 6 pid: 88373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.498261:0:80061:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305b091 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b08a expref: 9 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.498451:0:80061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305adce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d05 expref: 6 pid: 88373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.498482:0:80061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305adce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d05 expref: 6 pid: 88373 timeout: 3839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997211.498495:0:80061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:80061:1867507126951936:192.168.206.51@tcp:104: 00000100:00100000:0.0:1780997211.498603:0:80061:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898506eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997211.501351:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997211.501448:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110402560 00000100:00100000:2.0:1780997211.501459:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110402560 00000100:00100000:0.0:1780997211.501472:0:80061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:80061:1867507126951936:192.168.206.51@tcp:104: 00010000:00010000:0.0:1780997211.501510:0:80061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305b091 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b08a expref: 9 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.501524:0:80061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:0.0:1780997211.501527:0:80061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997211.501532:0:80061:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305b091 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b08a expref: 9 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.501544:0:80061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffcc00, rc 0) 00010000:00010000:2.0:1780997211.501571:0:6338:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305adce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d05 expref: 7 pid: 88373 timeout: 3839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997211.501611:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2565 00000100:00100000:0.0:1780997211.501618:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63419:x1867507126951808:12345-0@lo:101:mdt00_002.0 Request processed in 3423us (3551us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997211.501626:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110402560:12345-192.168.206.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1780997211.501632:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036 00010000:00010000:2.0:1780997211.501645:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997211.501739:0:6338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305adce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d05 expref: 7 pid: 88373 timeout: 3839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.501756:0:6338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305adce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d05 expref: 7 pid: 88373 timeout: 3839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997211.501788:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126951808:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1780997211.501796:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ef000/0x30fd811c0305adce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d05 expref: 7 pid: 88373 timeout: 3839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.501812:0:63419:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.501815:0:6338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:3.0:1780997211.501825:0:63419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.501839:0:6338:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305b091 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b08a expref: 8 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.501853:0:6338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305b091 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x30fd811c0305b08a expref: 8 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.501863:0:6338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305b091 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x30fd811c0305b08a expref: 8 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.502429:0:6338:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305b091 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b08a expref: 8 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997211.502449:0:6338:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6338:1867507126952064:0@lo:105: 00000100:00100000:2.0:1780997211.502564:0:6338:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997211.502617:0:6338:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688858050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997211.502620:0:9303:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1780997211.502640:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126952064 00000100:00100000:3.0:1780997211.502646:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126952064 00000100:00100000:3.0:1780997211.502769:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1780997211.502778:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968885e75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6338:x1867507126952064:12345-0@lo:105: 00010000:00010000:3.0:1780997211.502789:0:9303:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.502799:0:9303:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.502809:0:9303:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.502819:0:9303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.502828:0:9303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.502838:0:9303:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.502913:0:9303:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9689ba454000) 00000100:00100000:3.0:1780997211.502959:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968885e75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6338:x1867507126952064:12345-0@lo:105: Request processed in 182us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997211.502967:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1780997211.503057:0:6338:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6338:1867507126952064:0@lo:105: 00010000:00010000:1.0:1780997211.503072:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997211.503117:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2394:x1867507110402560:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 1496us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997211.503126:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2565 00010000:00010000:2.0:1780997211.503471:0:63419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.503484:0:63419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780997211.503508:0:63419:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1780997211.503558:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454800/0x30fd811c0305b098 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.503566:0:63419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454800/0x30fd811c0305b098 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.503576:0:63419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454800/0x30fd811c0305b098 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997211.503605:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126952192:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1780997211.503639:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997211.503710:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885805480 going to sleep for 11 seconds 00000100:00100000:1.0:1780997211.504602:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126952192 00000100:00100000:1.0:1780997211.504612:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126952192 00000100:00100000:1.0:1780997211.504697:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037 00000100:00100000:1.0:1780997211.504716:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63419:x1867507126952192:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1780997211.504740:0:8241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997211.504764:0:8241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305b09f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b098 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.504795:0:8241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305b09f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b098 expref: 10 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.504813:0:8241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305b09f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b098 expref: 10 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.504822:0:8241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9689882bd300) 00010000:00010000:1.0:1780997211.504826:0:8241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997211.504830:0:8241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02800, rc 0) 00000100:00100000:1.0:1780997211.504885:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63419:x1867507126952192:12345-0@lo:101:mdt00_002.0 Request processed in 171us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997211.504891:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037 00000100:00100000:2.0:1780997211.504955:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126952192:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1780997211.504973:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454800/0x30fd811c0305b098 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b09f expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.504984:0:63419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454800/0x30fd811c0305b098 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b09f expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780997211.505002:0:63419:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1780997211.505051:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126952320:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1780997211.505087:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997211.505667:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885805840 going to sleep for 11 seconds 00000100:00100000:3.0:1780997211.505819:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126952320 00000100:00100000:3.0:1780997211.505826:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126952320 00000100:00100000:3.0:1780997211.505872:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038 00000100:00100000:3.0:1780997211.505880:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63419:x1867507126952320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997211.506063:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63419:x1867507126952320:12345-0@lo:1000:mdt00_002.0 Request processed in 183us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997211.506071:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038 00000100:00100000:2.0:1780997211.506133:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126952320:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1780997211.506184:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126952448:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1780997211.506211:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997211.506232:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885805840 going to sleep for 11 seconds 00000100:00100000:3.0:1780997211.506292:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126952448 00000100:00100000:3.0:1780997211.506296:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126952448 00000100:00100000:3.0:1780997211.506327:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039 00000100:00100000:3.0:1780997211.506333:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63419:x1867507126952448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997211.506430:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63419:x1867507126952448:12345-0@lo:1000:mdt00_002.0 Request processed in 96us (219us total) trans 0 rc 1/1 00000100:00100000:3.0:1780997211.506683:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039 00000100:00100000:3.0:1780997211.506714:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126952448:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1780997211.506772:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.506782:0:63419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.506792:0:63419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997211.506818:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126952576:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1780997211.506844:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997211.506867:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034180 going to sleep for 11 seconds 00000100:00100000:2.0:1780997211.507030:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126952576 00000100:00100000:2.0:1780997211.507035:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126952576 00000100:00100000:2.0:1780997211.507062:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040 00000100:00100000:2.0:1780997211.507068:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63419:x1867507126952576:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1780997211.507079:0:23042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997211.507096:0:23042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455c00/0x30fd811c0305b0ad lrc: 2/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b0a6 expref: -99 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.507136:0:23042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455c00/0x30fd811c0305b0ad lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b0a6 expref: 11 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.507150:0:23042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455c00/0x30fd811c0305b0ad lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b0a6 expref: 11 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.507160:0:23042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9689964dc600) 00010000:00010000:2.0:1780997211.507163:0:23042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780997211.507166:0:23042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455c00, rc 0) 00000100:00100000:2.0:1780997211.507196:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126952576:12345-0@lo:101:mdt00_002.0 Request processed in 129us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997211.507203:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040 00000100:00100000:3.0:1780997211.507261:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126952576:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1780997211.507300:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b0ad expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.507320:0:63419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b0ad expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.507349:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305b0b4 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.507358:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305b0b4 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.507366:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305b0b4 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1780997211.507998:0:63419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].4, 432 off38504 00000040:00080000:3.0:1780997211.508059:0:63419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].3, 512 off36784 00000004:00080000:3.0:1780997211.508065:0:63419:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff968986034180 with version 14 00000004:00080000:2.0:1780997211.508547:0:72369:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff968889e33300 version 14 rpc_version 14 00000020:00100000:2.0:1780997211.508579:0:72369:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1780997211.508589:0:72369:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9689a5c44e00 x1867507126952832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997211.508612:0:72369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c44e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126952832:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1780997211.508662:0:72369:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997211.508777:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885805480 going to sleep for 11 seconds 00000100:00100000:3.0:1780997211.508808:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126952832 00000100:00100000:3.0:1780997211.508815:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126952832 00000100:00100000:3.0:1780997211.509030:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041 00000100:00100000:3.0:1780997211.509042:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:72369:x1867507126952832:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1780997211.513851:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:72369:x1867507126952832:12345-0@lo:1000:osp_up0-1.0 Request processed in 4797us (5174us total) trans 115964116994 rc 0/0 00000100:00100000:2.0:1780997211.513871:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041 00000100:00100000:1.0:1780997211.514012:0:72369:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c44e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126952832:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1780997211.514101:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:3.0:1780997211.514136:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305b0b4 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.514158:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305b0b4 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.514167:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305b0b4 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.514174:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980030000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997211.514179:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305b0b4 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.514187:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305b0b4 lrc: 4/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.514208:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff96898712d800) 00010000:00010000:3.0:1780997211.514211:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997211.514218:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305b0b4 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.514224:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305b0b4 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.514253:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b0ad expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.514263:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b0ad expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.514313:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b0ad expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.514396:0:63419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1780997211.514414:0:63419:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1780997211.514421:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.514442:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.514452:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.514454:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997211.514465:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x30fd811c0305b0ad expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.514475:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031a00 already unused, calling callback (ffffffffc1b42ee0) 00010000:00010000:1.0:1780997211.514480:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x30fd811c0305b0ad expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997211.514490:0:6340:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x30fd811c0305b0ad expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.514542:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b0ad expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.514550:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1780997211.514602:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126952960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997211.514654:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780997211.514777:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 1/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b0ad expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.514786:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980031a00/0x30fd811c0305b0a6 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b0ad expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997211.514804:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997211.514805:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997211.514807:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997211.514988:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126952960 00000100:00100000:0.0:1780997211.514997:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126952960 00000100:00100000:0.0:1780997211.515078:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1780997211.515089:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:3496:x1867507126952960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997211.515090:0:63419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1780997211.515101:0:63419:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1780997211.515107:0:18812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997211.515108:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454800/0x30fd811c0305b098 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b09f expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997211.515128:0:63419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454800/0x30fd811c0305b098 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b09f expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.515132:0:18812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455c00/0x30fd811c0305b0ad lrc: 0/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305b0a6 expref: 12 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.515160:0:18812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9689964dc600) 00010000:00010000:0.0:1780997211.515170:0:18812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997211.515209:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997211.515216:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997211.515217:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:70605:x1867507110402432:12345-192.168.206.51@tcp:36:rm.0 Request processed in 18151us (18370us total) trans 81604378752 rc 0/0 00010000:00010000:3.0:1780997211.515233:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454000 already unused, calling callback (ffffffffc1b42ee0) 00000100:00100000:2.0:1780997211.515233:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1373 00010000:00010000:3.0:1780997211.515240:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997211.515250:0:14480:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.515299:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.515316:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997211.515337:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.515346:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454000/0x30fd811c0305b08a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b091 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997211.515359:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997211.515360:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997211.515362:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997211.515371:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780997211.515394:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126953088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997211.515630:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3496:x1867507126952960:12345-0@lo:103:ldlm_bl.0 Request processed in 543us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997211.515638:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:3.0:1780997211.516299:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997211.516348:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126952960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997211.517619:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126953088 00000100:00100000:0.0:1780997211.517635:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126953088 00000100:00100000:0.0:1780997211.517699:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1780997211.517709:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3496:x1867507126953088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997211.517728:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997211.517755:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305b091 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305b08a expref: 11 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997211.517776:0:25183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:0.0:1780997211.517782:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997211.517851:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3496:x1867507126953088:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997211.517859:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1780997211.517930:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126953088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997211.880523:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997212.581526:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780997212.581556:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126953216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997212.581650:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997212.581717:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126953216 00000100:00100000:0.0:1780997212.581725:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126953216 00000100:00100000:0.0:1780997212.581797:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:0.0:1780997212.581809:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126953216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997212.581869:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997212.581920:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126953216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997212.581929:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00080000:0.0:1780997212.581954:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780997212.582005:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126953216:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1780997212.593112:0:72375:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3740138837982ns, next at 3741138834257ns, rc = 0 00000100:00100000:2.0:1780997212.593198:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126953344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997212.593333:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997212.593475:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126953344 00000100:00100000:0.0:1780997212.593486:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126953344 00000100:00100000:0.0:1780997212.593558:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:0.0:1780997212.593572:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126953344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997212.593610:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997212.593664:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126953344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997212.593684:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00100000:0.0:1780997212.593748:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126953344:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1780997212.593981:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780997212.908999:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997213.935386:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997214.630569:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126953472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997214.630966:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997214.631040:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780997214.631049:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126953600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997214.631080:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126953472 00000100:00100000:3.0:1780997214.631083:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997214.631093:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126953472 00000100:00100000:1.0:1780997214.631177:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126953600 00000100:00100000:1.0:1780997214.631182:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126953600 00000100:00100000:1.0:1780997214.631212:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042 00000100:00100000:1.0:1780997214.631223:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126953472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780997214.631290:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1780997214.631348:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126953472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997214.631355:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042 00000100:00100000:1.0:1780997214.631385:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043 00000100:00100000:1.0:1780997214.631391:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3496:x1867507126953600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780997214.631441:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445261312 avail 1299021824 00000100:00100000:1.0:1780997214.631473:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3496:x1867507126953600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997214.631480:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043 00000100:00100000:0.0:1780997214.632086:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126953856:0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.632136:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997214.632160:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126954368:0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.632187:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997214.632208:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1780997214.632213:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126953728:0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.632248:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997214.632303:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126954240:0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.632326:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997214.632358:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126954752:0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.632394:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997214.632427:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126953728 00000100:00100000:0.0:1780997214.632433:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126953728 00000100:00100000:0.0:1780997214.632473:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1780997214.632480:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126953728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.632525:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126953728:12345-0@lo:400:kworker.0 Request processed in 46us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997214.632532:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1780997214.632598:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126953728:0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.632650:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126953856 00000100:00100000:0.0:1780997214.632655:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126953856 00000100:00100000:0.0:1780997214.633052:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126954240 00000100:00100000:0.0:1780997214.633059:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126954240 00000100:00100000:0.0:1780997214.633091:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1780997214.633098:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126953856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997214.633156:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126954112:0@lo:400:kworker.0 00000100:00100000:2.0:1780997214.633197:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997214.633224:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507126954624:0@lo:400:kworker.0 00000100:00100000:2.0:1780997214.633262:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997214.633300:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1780997214.633309:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126953984:0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.633379:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126953856:12345-0@lo:400:kworker.0 Request processed in 281us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997214.633387:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1780997214.633401:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126954112 00000100:00100000:0.0:1780997214.633405:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126954112 00000100:00100000:0.0:1780997214.633420:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126954624 00000100:00100000:0.0:1780997214.633423:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126954624 00000100:00100000:0.0:1780997214.633435:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1780997214.633440:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126954240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.633472:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126954240:12345-0@lo:400:kworker.0 Request processed in 32us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997214.633489:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1780997214.633501:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1780997214.633507:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126954112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.633534:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507126954112:12345-0@lo:400:kworker.0 Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997214.633540:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1780997214.633548:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1780997214.633553:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3497:x1867507126954624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.633575:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3497:x1867507126954624:12345-0@lo:400:kworker.0 Request processed in 22us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997214.633580:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00080000:0.0:1780997214.633597:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780997214.633602:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780997214.633649:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126954880:0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.633679:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997214.633733:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126954240:0@lo:400:kworker.0 00000100:00100000:3.0:1780997214.634306:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126954368 00000100:00100000:3.0:1780997214.634315:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126954368 00000100:00100000:3.0:1780997214.634379:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126954752 00000100:00100000:3.0:1780997214.634383:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126954752 00000100:00100000:3.0:1780997214.634407:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126954880 00000100:00100000:3.0:1780997214.634411:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126954880 00000100:00100000:3.0:1780997214.634439:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:3.0:1780997214.634449:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126954368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997214.634511:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126954368:12345-0@lo:400:kworker.0 Request processed in 65us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997214.634518:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00100000:3.0:1780997214.634534:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00000100:00100000:3.0:1780997214.634541:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126954752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997214.634570:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126954752:12345-0@lo:400:kworker.0 Request processed in 30us (2176us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997214.634577:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00000100:00100000:3.0:1780997214.634587:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:3.0:1780997214.634594:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126954880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997214.634655:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126954880:12345-0@lo:400:kworker.0 Request processed in 62us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997214.634661:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00000100:00080000:3.0:1780997214.634849:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997214.634854:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997214.634902:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126953600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997214.635256:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126954752:0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.635286:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126953856:0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.635300:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126954368:0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.635339:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126954880:0@lo:400:kworker.0 00000100:00100000:3.0:1780997214.635466:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126953472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997214.636648:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997214.638240:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126954496:0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.638573:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126953984 00000100:00100000:0.0:1780997214.638588:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126953984 00000100:00100000:0.0:1780997214.638713:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1780997214.638758:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126953984:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1780997214.639661:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997214.644558:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126953984:12345-0@lo:400:kworker.0 Request processed in 5787us (7896us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997214.644579:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:2.0:1780997214.647577:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997214.647680:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507126955008:0@lo:400:kworker.0 00000100:00100000:2.0:1780997214.648216:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997214.648858:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126954112:0@lo:400:kworker.0 00000100:00100000:2.0:1780997214.648880:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507126954624:0@lo:400:kworker.0 00000100:00100000:2.0:1780997214.648940:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126953984:0@lo:400:kworker.0 00000100:00100000:3.0:1780997214.650374:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126954496 00000100:00100000:3.0:1780997214.650392:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126954496 00000100:00100000:3.0:1780997214.650516:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:3.0:1780997214.650528:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126954496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997214.650645:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126954496:12345-0@lo:400:kworker.0 Request processed in 119us (3077us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997214.650654:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00080000:1.0:1780997214.651188:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997214.654472:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126954496:0@lo:400:kworker.0 00000100:00100000:0.0:1780997214.659825:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126955008 00000100:00100000:0.0:1780997214.659849:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126955008 00000100:00100000:1.0:1780997214.660190:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:1.0:1780997214.660205:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507126955008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997214.660404:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507126955008:12345-0@lo:400:kworker.0 Request processed in 202us (12187us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997214.660413:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1780997214.660853:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507126955008:0@lo:400:kworker.0 00010000:00010000:3.0:1780997214.951507:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997214.993230:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997214.993313:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997214.993337:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997214.993382:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997214.993427:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110402944 00000100:00100000:1.0:1780997214.993441:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110402944 00000100:00100000:1.0:1780997214.993530:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110402816 00000100:00100000:1.0:1780997214.993534:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110402816 00000100:00100000:1.0:1780997214.993568:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1325 00000100:00100000:1.0:1780997214.993583:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:2394:x1867507110402944:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997214.993719:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:2394:x1867507110402944:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 139us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997214.993729:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1325 00000100:00100000:1.0:1780997214.993762:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1326 00000100:00100000:1.0:1780997214.993771:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2394:x1867507110402816:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997214.993802:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2394:x1867507110402816:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997214.993818:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1326 00000100:00100000:1.0:1780997214.993847:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110403072 00000100:00100000:1.0:1780997214.993851:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110403072 00000100:00100000:1.0:1780997214.993886:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2628 00000100:00100000:1.0:1780997214.993893:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110403072:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997214.993922:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110403072:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 31us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997214.993929:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2628 00000100:00080000:1.0:1780997214.993947:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997214.993953:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780997214.993955:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997214.994748:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110402688 00000100:00100000:3.0:1780997214.994758:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110402688 00000100:00100000:3.0:1780997214.994810:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:3.0:1780997214.994819:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110402688:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997214.994920:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110402688:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 103us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997214.994927:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:2.0:1780997215.143107:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126955136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997215.143243:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997215.143415:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997215.143444:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126955264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780997215.143511:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997215.143595:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126955136 00000100:00100000:2.0:1780997215.143604:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126955136 00000100:00100000:2.0:1780997215.143724:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126955264 00000100:00100000:2.0:1780997215.143728:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126955264 00000100:00100000:2.0:1780997215.143829:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110 00000100:00100000:2.0:1780997215.143857:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126955136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780997215.143954:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997215.144032:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126955136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 190us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997215.144043:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110 00000100:00100000:2.0:1780997215.144084:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00100000:2.0:1780997215.144091:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126955264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780997215.144114:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997215.144199:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507126955264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997215.144206:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000100:00100000:2.0:1780997215.144314:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126955264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780997215.144373:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126955136:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1780997215.662215:0:72364:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00010000:00010000:1.0:1780997215.662317:0:72364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454800/0x30fd811c0305b098 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x30fd811c0305b09f expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997215.662337:0:72364:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454800/0x30fd811c0305b098 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x30fd811c0305b09f expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662411:0:72364:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454800/0x30fd811c0305b098 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b09f expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662420:0:72364:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997215.662451:0:72364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689ba454800/0x30fd811c0305b098 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b09f expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780997215.662479:0:72364:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378752 is committed 00000004:00080000:1.0:1780997215.662513:0:72364:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00010000:00010000:1.0:1780997215.662572:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305adf1 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662594:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305adf1 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662602:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305adf1 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662611:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997215.662616:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305adf1 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662624:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305adf1 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662648:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0xb1bed465 (ffff96898962f100) 00010000:00010000:1.0:1780997215.662652:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997215.662660:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305adf1 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662667:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305adf1 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662689:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03600/0x30fd811c0305b060 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662697:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03600/0x30fd811c0305b060 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662704:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03600/0x30fd811c0305b060 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662710:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997215.662720:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03600/0x30fd811c0305b060 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662727:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03600/0x30fd811c0305b060 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662736:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xd:0x0].0xb1bed465 (ffff96898962f100) 00010000:00010000:1.0:1780997215.662739:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997215.662742:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03600/0x30fd811c0305b060 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662748:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03600/0x30fd811c0305b060 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662771:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b07c lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662778:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b07c lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662783:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b07c lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662789:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffce00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997215.662791:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b07c lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662797:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b07c lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662804:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xf7117594 (ffff96898d864500) 00010000:00010000:1.0:1780997215.662806:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997215.662815:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b07c lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.662821:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b07c lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997215.662878:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126955392:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1780997215.663024:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997215.663110:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126955392 00000100:00100000:1.0:1780997215.663120:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126955392 00000100:00100000:1.0:1780997215.663180:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1780997215.663192:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3499:x1867507126955392:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1780997215.663213:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997215.663239:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02800/0x30fd811c0305b09f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305b098 expref: 10 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.663252:0:6336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9689882bd300) 00010000:00010000:1.0:1780997215.663263:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997215.663400:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3499:x1867507126955392:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 209us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997215.663412:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1780997215.663487:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126955392:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1780997215.663895:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126955520:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1780997215.663949:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997215.664016:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126955520 00000100:00100000:3.0:1780997215.664023:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126955520 00000100:00100000:3.0:1780997215.664071:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5964 00000100:00100000:3.0:1780997215.664080:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126955520:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1780997215.664117:0:25177:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1570 count 1 00010000:00010000:3.0:1780997215.664156:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997215.664189:0:25177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305afcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d60 expref: 6 pid: 25170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997215.664199:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1780997215.664202:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1780997215.664206:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997215.664244:0:25177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305afcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d60 expref: 6 pid: 25170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997215.664266:0:25177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305afcd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d60 expref: 6 pid: 25170 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997215.666028:0:25177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:25177:1867507126955648:192.168.206.51@tcp:104: 00000100:00100000:3.0:1780997215.666169:0:25177:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997215.678778:0:25177:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:25177:1867507126955648:192.168.206.51@tcp:104: 00010000:00010000:3.0:1780997215.678830:0:25177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1780997215.679630:0:88340:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116994 is committed 00000001:00080000:3.0:1780997215.679953:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969455 is committed 00000100:00100000:3.0:1780997215.683917:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997215.690109:0:6337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110403200 00000100:00100000:1.0:1780997215.690132:0:6337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110403200 00010000:00010000:1.0:1780997215.690199:0:6337:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305afcd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d60 expref: 7 pid: 25170 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997215.690253:0:6337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2566 00000100:00100000:1.0:1780997215.690322:0:6337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110403200:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780997215.690344:0:6337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997215.690351:0:6337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305afcd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d60 expref: 7 pid: 25170 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.690377:0:6337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305afcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d60 expref: 7 pid: 25170 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.690413:0:6337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039fa3218/0x30fd811c0305afcd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d60 expref: 7 pid: 25170 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.690438:0:6337:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997215.690441:0:6337:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997215.690447:0:6337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.690460:0:6337:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.690501:0:6337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997215.690589:0:6337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2395:x1867507110403200:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 271us (6689us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997215.690599:0:6337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2566 00010000:00010000:1.0:1780997215.690724:0:25177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.690736:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.690755:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.690765:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.690786:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1780997215.691060:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507126955520:12345-0@lo:6:osp-syn-1-1.0 Request processed in 26981us (27109us total) trans 4294969455 rc 0/0 00000100:00100000:1.0:1780997215.691071:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5964 00010000:00010000:1.0:1780997215.691099:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997215.691106:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.691115:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980030000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997215.691120:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.691130:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.691145:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.691154:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b0bb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997215.691187:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997215.691189:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997215.691191:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1780997215.691241:0:3496:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9689adb89880/2, rc 0, transno 4294969455 00000100:00100000:1.0:1780997215.691249:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126955520:0@lo:6:osp-syn-1-1.0 00000001:00080000:1.0:1780997215.705963:0:9294:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969454 is committed 00000001:00100000:1.0:1780997215.706087:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00010000:00010000:2.0:1780997215.974305:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997216.998401:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997217.701891:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126955776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997217.701976:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997217.702681:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126955904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997217.702720:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997217.705482:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126955776 00000100:00100000:2.0:1780997217.705499:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126955776 00000100:00100000:2.0:1780997217.705557:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126955904 00000100:00100000:2.0:1780997217.705561:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126955904 00000100:00100000:2.0:1780997217.705599:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112 00000100:00100000:2.0:1780997217.705612:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126955776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997217.705667:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997217.705762:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126955776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 155us (3786us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997217.705771:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112 00000100:00100000:2.0:1780997217.705788:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:2.0:1780997217.705795:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126955904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780997217.705825:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997217.705861:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126955904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (3140us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997217.705867:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00100000:2.0:1780997217.705928:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126955904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997217.705974:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126955776:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1780997217.706069:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997217.706074:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1780997218.021542:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997219.050554:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997219.754112:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997219.754144:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126956032:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.754238:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997219.754356:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997219.754366:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126956160:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.754402:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997219.754446:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126956288:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.754471:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997219.754506:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126956160 00000100:00100000:2.0:1780997219.754515:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126956160 00000100:00100000:2.0:1780997219.754575:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126956288 00000100:00100000:2.0:1780997219.754578:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126956288 00000100:00100000:2.0:1780997219.754599:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:2.0:1780997219.754609:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126956160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.754670:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126956160:12345-0@lo:400:kworker.0 Request processed in 62us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997219.754677:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:2.0:1780997219.754695:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1780997219.754701:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126956288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.754749:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126956288:12345-0@lo:400:kworker.0 Request processed in 48us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997219.754756:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1780997219.754792:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126956288:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.754802:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126956160:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.754837:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126956416:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.754859:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997219.754892:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997219.754912:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126956544:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.754936:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997219.754959:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126956416 00000100:00100000:2.0:1780997219.754963:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126956416 00000100:00100000:2.0:1780997219.754985:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126956544 00000100:00100000:2.0:1780997219.754988:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126956544 00000100:00100000:2.0:1780997219.755003:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1780997219.755009:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507126956416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755043:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507126956416:12345-0@lo:400:kworker.0 Request processed in 34us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997219.755048:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1780997219.755059:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1780997219.755065:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126956544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755091:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126956544:12345-0@lo:400:kworker.0 Request processed in 26us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997219.755098:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1780997219.755126:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126956544:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755147:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507126956416:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755177:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997219.755184:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126956672:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755213:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997219.755257:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126956800:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755307:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997219.755363:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126956928:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755386:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997219.755425:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997219.755431:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126957056:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755455:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997219.755476:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126957056 00000100:00100000:2.0:1780997219.755479:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126957056 00000100:00100000:2.0:1780997219.755502:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1780997219.755508:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126957056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755540:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507126957056:12345-0@lo:400:kworker.0 Request processed in 32us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997219.755546:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1780997219.755572:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507126957056:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755602:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997219.755608:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126957184:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755633:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997219.755671:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126957312:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755694:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997219.755735:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126956800 00000100:00100000:2.0:1780997219.755738:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126956800 00000100:00100000:2.0:1780997219.755778:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126956928 00000100:00100000:2.0:1780997219.755781:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126956928 00000100:00100000:2.0:1780997219.755800:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126957312 00000100:00100000:2.0:1780997219.755803:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126957312 00000100:00100000:2.0:1780997219.755825:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00000100:00100000:2.0:1780997219.755832:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126956800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755868:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126956800:12345-0@lo:400:kworker.0 Request processed in 37us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997219.755874:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00000100:00100000:2.0:1780997219.755887:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:2.0:1780997219.755893:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126956928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755931:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3498:x1867507126956928:12345-0@lo:400:kworker.0 Request processed in 38us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997219.755937:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000100:00100000:2.0:1780997219.755948:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:2.0:1780997219.755954:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126957312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.755980:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126957312:12345-0@lo:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997219.755986:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:2.0:1780997219.756019:0:3497:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 2 00000100:00100000:2.0:1780997219.756033:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126957312:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.756044:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126956800:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.756066:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126956928:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.756093:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126957440:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.756126:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997219.756167:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997219.756172:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126957568:0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.756195:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997219.756215:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126957568 00000100:00100000:2.0:1780997219.756219:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126957568 00000100:00100000:2.0:1780997219.756240:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1780997219.756246:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126957568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997219.756299:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507126957568:12345-0@lo:400:kworker.0 Request processed in 53us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997219.756305:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1780997219.756343:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507126957568:0@lo:400:kworker.0 00000100:00100000:1.0:1780997219.756787:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126956672 00000100:00100000:1.0:1780997219.756792:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126956672 00000100:00100000:1.0:1780997219.756833:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126957184 00000100:00100000:1.0:1780997219.756836:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126957184 00000100:00100000:1.0:1780997219.756858:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044 00000100:00100000:1.0:1780997219.756864:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3497:x1867507126956672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997219.756924:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3497:x1867507126956672:12345-0@lo:400:kworker.0 Request processed in 60us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997219.756932:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044 00000100:00100000:1.0:1780997219.756947:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045 00000100:00100000:1.0:1780997219.756953:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126957184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997219.756981:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126957184:12345-0@lo:400:kworker.0 Request processed in 28us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997219.756988:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045 00000100:00100000:1.0:1780997219.757007:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126957440 00000100:00100000:1.0:1780997219.757019:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126957440 00000100:00100000:1.0:1780997219.757051:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:1.0:1780997219.757057:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126957440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997219.757095:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126957440:12345-0@lo:400:kworker.0 Request processed in 38us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997219.757101:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:1.0:1780997219.757154:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126957184:0@lo:400:kworker.0 00000100:00100000:1.0:1780997219.757165:0:3497:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116994 gen 3 00000004:00080000:1.0:1780997219.757171:0:3497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964116993 committed transno 115964116994 00000004:00080000:1.0:1780997219.757194:0:3497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964116994 committed transno 115964116994 00000020:00080000:1.0:1780997219.757202:0:3497:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff968986034480 refcount 2 committed 0 result 0 batchid 77309411388 00000020:00080000:1.0:1780997219.757206:0:3497:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9689bc72a800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff968986034180 00000020:00080000:1.0:1780997219.757210:0:3497:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].3 00000020:00080000:1.0:1780997219.757213:0:3497:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9689bc72a500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff968888b5da00 00000020:00080000:1.0:1780997219.757216:0:3497:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].4 00000100:00100000:1.0:1780997219.757241:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126956672:0@lo:400:kworker.0 00000020:00080000:1.0:1780997219.757266:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411388 committed batchid 77309411387 00000020:00080000:1.0:1780997219.757403:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000100:00100000:1.0:1780997219.757422:0:3498:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 2 00000100:00100000:1.0:1780997219.757433:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126957440:0@lo:400:kworker.0 00000100:00100000:1.0:1780997219.757483:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126956032 00000100:00100000:1.0:1780997219.757488:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126956032 00000100:00100000:1.0:1780997219.757521:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1780997219.757529:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126956032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997219.757573:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126956032:12345-0@lo:400:kworker.0 Request processed in 45us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997219.757587:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1780997219.757628:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126956032:0@lo:400:kworker.0 00000100:00080000:1.0:1780997219.757654:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997219.757659:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997219.757662:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997219.757666:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780997219.762073:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126957696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997219.762170:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997219.762234:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126957696 00000100:00100000:0.0:1780997219.762244:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126957696 00000100:00100000:0.0:1780997219.762317:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046 00000100:00100000:0.0:1780997219.762329:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126957696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780997219.762382:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780997219.762436:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126957696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997219.762444:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046 00000100:00100000:0.0:1780997219.762506:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126957696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997219.762978:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997219.762989:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126957824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997219.763021:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997219.763106:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126957824 00000100:00100000:1.0:1780997219.763111:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126957824 00000100:00100000:1.0:1780997219.763153:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047 00000100:00100000:1.0:1780997219.763162:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507126957824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780997219.763185:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445261312 avail 1299021824 00000100:00100000:1.0:1780997219.763222:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507126957824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997219.763228:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047 00000100:00100000:0.0:1780997219.763937:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126957824:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1780997220.075764:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997220.112173:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997220.112225:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997220.112262:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997220.112546:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110403328 00000100:00100000:1.0:1780997220.112558:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110403328 00000100:00100000:1.0:1780997220.112619:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:1.0:1780997220.112630:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2397:x1867507110403328:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997220.112728:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2397:x1867507110403328:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 99us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997220.112736:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:2.0:1780997220.113500:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110403584 00000100:00100000:2.0:1780997220.113508:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110403584 00000100:00080000:1.0:1780997220.113762:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997220.115570:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997220.118743:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110403456 00000100:00100000:3.0:1780997220.118764:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110403456 00000100:00100000:3.0:1780997220.118861:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1333 00000100:00100000:3.0:1780997220.118873:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110403584:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997220.118967:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110403584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 97us (6740us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997220.118975:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1333 00000100:00100000:3.0:1780997220.118994:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1334 00000100:00100000:3.0:1780997220.118999:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2397:x1867507110403456:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997220.119022:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2397:x1867507110403456:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 23us (6761us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997220.119028:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1334 00000100:00080000:0.0:1780997220.122917:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997220.129478:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110403712 00000100:00100000:1.0:1780997220.129503:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110403712 00000100:00080000:1.0:1780997220.129557:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997220.130248:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2633 00000100:00100000:1.0:1780997220.130265:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110403712:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997220.133292:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110403712:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 2986us (19318us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997220.134019:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2633 00000100:00100000:2.0:1780997220.261455:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126957952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997220.261550:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997220.261643:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126957952 00000100:00100000:2.0:1780997220.261653:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126957952 00000100:00100000:2.0:1780997220.261714:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1780997220.261725:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126957952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780997220.261772:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997220.261824:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126957952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997220.261832:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1780997220.261901:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126957952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997220.262384:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126958080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780997220.262419:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997220.262503:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126958080 00000100:00100000:3.0:1780997220.262511:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126958080 00000100:00100000:3.0:1780997220.262550:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:3.0:1780997220.262558:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126958080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780997220.262578:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997220.262616:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126958080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997220.262698:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:2.0:1780997220.263772:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126958080:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1780997220.605721:0:88908:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 05:26:58 (1780997218) 00010000:00010000:2.0:1780997221.097168:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1780997221.287947:0:9294:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969455 is committed 00000020:00000080:0.0:1780997221.431088:0:88956:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffdb01e6320 20000000:00000080:0.0:1780997221.431110:0:88956:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9689bc845400 uarg=0000000000000000 00000040:00100000:0.0:1780997221.432214:0:88956:0:(llog.c:1067:llog_reverse_process()) index 51 : idx 49 00000040:00100000:0.0:1780997221.432229:0:88956:0:(llog.c:1067:llog_reverse_process()) index 47 : idx 1 00000040:00080000:0.0:1780997221.432414:0:88956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:0.0:1780997221.432442:0:88956:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:0.0:1780997221.432457:0:88956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:0.0:1780997221.432472:0:88956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:0.0:1780997221.432696:0:88956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:0.0:1780997221.432708:0:88956:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:0.0:1780997221.432725:0:88956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:0.0:1780997221.433028:0:88956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:0.0:1780997221.433783:0:88956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:0.0:1780997221.433798:0:88956:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:0.0:1780997221.433820:0:88956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:0.0:1780997221.433929:0:88956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:0.0:1780997221.433947:0:88956:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1780997221.434792:0:88956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.434820:0:88956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968983ce3000/0x30fd811c0305abba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d36 expref: 8 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.434830:0:88956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305abc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d44 expref: 8 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.434839:0:88956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968983ce3c00/0x30fd811c0305abf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305abeb expref: 22 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.434845:0:88956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968983ce2600/0x30fd811c0305accb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305acc4 expref: 22 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.434863:0:88956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968888955600/0x30fd811c0305acfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305acf5 expref: 22 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.434871:0:88956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bc842800/0x30fd811c0305ad18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad11 expref: 22 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.434878:0:88956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968983ce2a00/0x30fd811c0305ad42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad3b expref: 22 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.434886:0:88956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968983ce2000/0x30fd811c0305ad50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad49 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.434893:0:88956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968983ce3400/0x30fd811c0305ad6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad65 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.434901:0:88956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bc842e00/0x30fd811c0305ad7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad73 expref: 22 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.434909:0:88956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968888954000/0x30fd811c0305ada4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ad9d expref: 22 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.434916:0:88956:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.434986:0:88956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968888954000/0x30fd811c0305ada4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305ad9d expref: 22 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.435006:0:88956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968888954000/0x30fd811c0305ada4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305ad9d expref: 22 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997221.435038:0:88956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958208:0@lo:104: 00000100:00100000:0.0:1780997221.435129:0:88956:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780997221.435204:0:88956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bc842e00/0x30fd811c0305ad7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305ad73 expref: 22 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.435212:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126958208 00010000:00010000:0.0:1780997221.435214:0:88956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bc842e00/0x30fd811c0305ad7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305ad73 expref: 22 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.435225:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126958208 00000100:00100000:0.0:1780997221.435227:0:88956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c44000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958336:0@lo:104: 00000100:00100000:0.0:1780997221.435262:0:88956:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997221.435312:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126958336 00000100:00100000:1.0:1780997221.435316:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126958336 00010000:00010000:0.0:1780997221.435345:0:88956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968983ce3400/0x30fd811c0305ad6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305ad65 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.435349:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00010000:00010000:0.0:1780997221.435360:0:88956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968983ce3400/0x30fd811c0305ad6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305ad65 expref: 22 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.435365:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:88956:x1867507126958208:12345-0@lo:104: 00000100:00100000:0.0:1780997221.435375:0:88956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c46680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958464:0@lo:104: 00010000:00010000:1.0:1780997221.435384:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ada4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997221.435403:0:88956:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780997221.435423:0:88956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968983ce2000/0x30fd811c0305ad50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305ad49 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.435432:0:88956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968983ce2000/0x30fd811c0305ad50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305ad49 expref: 22 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997221.435442:0:88956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c44e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958592:0@lo:104: 00010000:00010000:1.0:1780997221.435455:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1780997221.435466:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:88956:x1867507126958208:12345-0@lo:104: Request processed in 103us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997221.435467:0:88956:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997221.435479:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00010000:0.0:1780997221.435489:0:88956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968983ce2a00/0x30fd811c0305ad42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305ad3b expref: 22 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.435499:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126958464 00000100:00100000:1.0:1780997221.435504:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126958464 00010000:00010000:0.0:1780997221.435514:0:88956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968983ce2a00/0x30fd811c0305ad42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305ad3b expref: 22 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.435517:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126958592 00000100:00100000:1.0:1780997221.435521:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126958592 00000100:00100000:0.0:1780997221.435527:0:88956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958720:0@lo:104: 00000100:00100000:1.0:1780997221.435535:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1780997221.435543:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:88956:x1867507126958336:12345-0@lo:104: 00010000:00010000:1.0:1780997221.435552:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ad7a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997221.435771:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1780997221.435782:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:88956:x1867507126958464:12345-0@lo:104: 00010000:00010000:3.0:1780997221.435791:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ad6c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.436239:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1780997221.436247:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:88956:x1867507126958336:12345-0@lo:104: Request processed in 704us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997221.436264:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1780997221.436291:0:88956:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997221.436315:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126958720 00000100:00100000:1.0:1780997221.436332:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126958720 00010000:00010000:0.0:1780997221.436354:0:88956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bc842800/0x30fd811c0305ad18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305ad11 expref: 22 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.436357:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1780997221.436368:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:88956:x1867507126958592:12345-0@lo:104: 00010000:00010000:0.0:1780997221.436369:0:88956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bc842800/0x30fd811c0305ad18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305ad11 expref: 22 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.436382:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ad50 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997221.436385:0:88956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958848:0@lo:104: 00000100:00100000:0.0:1780997221.436423:0:88956:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780997221.436442:0:88956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968888955600/0x30fd811c0305acfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305acf5 expref: 22 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.436451:0:88956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968888955600/0x30fd811c0305acfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305acf5 expref: 22 pid: 88345 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997221.436465:0:88956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958976:0@lo:104: 00000100:00100000:0.0:1780997221.436488:0:88956:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780997221.436503:0:88956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968983ce2600/0x30fd811c0305accb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305acc4 expref: 22 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.436510:0:88956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968983ce2600/0x30fd811c0305accb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305acc4 expref: 22 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997221.436519:0:88956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126959104:0@lo:104: 00010000:00010000:0.0:1780997221.436649:0:88956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968983ce3c00/0x30fd811c0305abf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305abeb expref: 22 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.436658:0:88956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968983ce3c00/0x30fd811c0305abf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305abeb expref: 22 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997221.436667:0:88956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126959232:0@lo:104: 00010000:00010000:0.0:1780997221.436692:0:88956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305abc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d44 expref: 8 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.436701:0:88956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305abc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d44 expref: 8 pid: 88345 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997221.436717:0:88956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126959360:192.168.206.51@tcp:104: 00010000:00010000:0.0:1780997221.436781:0:88956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968983ce3000/0x30fd811c0305abba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d36 expref: 8 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.436790:0:88956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968983ce3000/0x30fd811c0305abba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d36 expref: 8 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997221.436798:0:88956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126959488:192.168.206.51@tcp:104: 00000100:00100000:0.0:1780997221.436817:0:88956:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898d9ae900 going to sleep for 11 seconds 00000100:00100000:0.0:1780997221.436846:0:88956:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958208:0@lo:104: 00000100:00100000:0.0:1780997221.436855:0:88956:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c44000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958336:0@lo:104: 00000100:00100000:0.0:1780997221.436862:0:88956:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c46680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958464:0@lo:104: 00000100:00100000:0.0:1780997221.436869:0:88956:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c44e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958592:0@lo:104: 00010000:00010000:3.0:1780997221.438668:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1780997221.438686:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:88956:x1867507126958464:12345-0@lo:104: Request processed in 2902us (3281us total) trans 0 rc 0/0 00010000:00010000:1.0:1780997221.438689:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1780997221.438702:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:88956:x1867507126958592:12345-0@lo:104: Request processed in 2334us (3233us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997221.438704:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1780997221.438715:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1780997221.438755:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126958848 00000100:00100000:1.0:1780997221.438764:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126958848 00000100:00100000:3.0:1780997221.438770:0:9303:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1780997221.438798:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126958976 00000100:00100000:1.0:1780997221.438803:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126958976 00000100:00100000:3.0:1780997221.438816:0:9303:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997221.438823:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1780997221.438831:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:88956:x1867507126958720:12345-0@lo:104: 00000100:00100000:3.0:1780997221.438844:0:9303:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780997221.438851:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ad42 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997221.438853:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126959104 00000100:00100000:3.0:1780997221.438858:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126959104 00000100:00100000:3.0:1780997221.438875:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126959232 00000100:00100000:3.0:1780997221.438878:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126959232 00000100:00100000:3.0:1780997221.438892:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1780997221.438899:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:88956:x1867507126958848:12345-0@lo:104: 00010000:00010000:3.0:1780997221.438908:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ad18 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.438945:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1780997221.438952:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:88956:x1867507126958720:12345-0@lo:104: Request processed in 122us (2683us total) trans 0 rc 0/0 00010000:00010000:3.0:1780997221.438954:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1780997221.438964:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:88956:x1867507126958848:12345-0@lo:104: Request processed in 65us (2541us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997221.438965:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1780997221.438976:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1780997221.438985:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1780997221.438993:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1780997221.438996:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:88956:x1867507126958976:12345-0@lo:104: 00000100:00100000:3.0:1780997221.439004:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:88956:x1867507126959104:12345-0@lo:104: 00010000:00010000:3.0:1780997221.439024:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305accb expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439039:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305acfc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997221.439053:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1780997221.439059:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:88956:x1867507126959104:12345-0@lo:104: Request processed in 58us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997221.439066:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1780997221.439081:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00010000:00010000:1.0:1780997221.439085:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1780997221.439090:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:88956:x1867507126959232:12345-0@lo:104: 00000100:00100000:1.0:1780997221.439095:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:88956:x1867507126958976:12345-0@lo:104: Request processed in 101us (2604us total) trans 0 rc 0/0 00010000:00010000:3.0:1780997221.439100:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305abf2 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.439105:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00010000:00010000:3.0:1780997221.439135:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1780997221.439142:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:88956:x1867507126959232:12345-0@lo:104: Request processed in 54us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997221.439148:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00010000:00010000:1.0:1780997221.439174:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1780997221.439182:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ada4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439191:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc842400 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997221.439196:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305ada4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439207:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305ada4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997221.439217:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305ada4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997221.439224:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997221.439286:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ada4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439294:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997221.439318:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ada4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439338:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc842400/0x30fd811c0305ad9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ada4 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439363:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1780997221.439366:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ad7a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439372:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954c00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997221.439375:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305ad7a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439383:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305ad7a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997221.439389:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305ad7a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997221.439395:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997221.439409:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad7a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439416:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997221.439422:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad7a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439430:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968888954c00/0x30fd811c0305ad73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad7a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439441:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1780997221.439444:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ad6c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439460:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954a00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997221.439463:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305ad6c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439470:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305ad6c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997221.439476:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305ad6c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997221.439482:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997221.439498:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad6c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439504:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780997221.439511:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1780997221.439522:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad6c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439525:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ad50 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439536:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968888954a00/0x30fd811c0305ad65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad6c expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439539:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee800 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:0.0:1780997221.439551:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305ad50 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439554:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1780997221.439559:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ad42 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439563:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305ad50 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439568:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ef800 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997221.439574:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305ad42 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997221.439576:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305ad50 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997221.439586:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997221.439599:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305ad42 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439606:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad50 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997221.439608:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305ad42 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439622:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1780997221.439624:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997221.439634:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad50 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439642:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee800/0x30fd811c0305ad49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad50 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439644:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad42 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439657:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780997221.439658:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1780997221.439664:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ad18 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439665:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad42 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439679:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954600 already unused, calling callback (ffffffffc14fac20) 00010000:00010000:1.0:1780997221.439682:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef800/0x30fd811c0305ad3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad42 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997221.439684:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305ad18 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439702:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780997221.439709:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305accb expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439714:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305ad18 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439717:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc843600 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997221.439723:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305accb expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997221.439726:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305ad18 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439737:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305accb expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997221.439738:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1780997221.439749:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305accb expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439756:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad18 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997221.439770:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997221.439771:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780997221.439779:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad18 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439786:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968888954600/0x30fd811c0305ad11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ad18 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439791:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305accb expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439796:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997221.439803:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780997221.439803:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305acfc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439812:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305accb expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439813:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3a00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:0.0:1780997221.439818:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305acfc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439827:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc843600/0x30fd811c0305acc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305accb expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439831:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305acfc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439842:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1780997221.439842:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305acfc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439846:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305abf2 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439864:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2200 already unused, calling callback (ffffffffc14fac20) 10000000:01000000:0.0:1780997221.439866:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1780997221.439871:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305abf2 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439881:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305abf2 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439882:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305acfc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997221.439895:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305abf2 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439896:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780997221.439904:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305acfc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997221.439905:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780997221.439916:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968983ce3a00/0x30fd811c0305acf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305acfc expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439923:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305abf2 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.439927:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997221.439930:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997221.439933:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780997221.439934:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997221.439948:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305abf2 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439955:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968983ce2200/0x30fd811c0305abeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305abf2 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.439975:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997221.439978:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997221.439980:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997221.439987:0:88956:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958720:0@lo:104: 00000100:00100000:1.0:1780997221.440000:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126959616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997221.440001:0:88956:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958848:0@lo:104: 00000100:00100000:0.0:1780997221.440015:0:88956:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126958976:0@lo:104: 00000100:00100000:0.0:1780997221.440022:0:88956:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126959104:0@lo:104: 00000100:00100000:0.0:1780997221.440031:0:88956:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126959232:0@lo:104: 00000100:00100000:1.0:1780997221.440056:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997221.440108:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126960128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997221.440131:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997221.440150:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126960640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997221.440170:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997221.440192:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1780997221.440198:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126959744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997221.440216:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997221.440232:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126960256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997221.440250:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997221.440299:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126959616 00000100:00100000:1.0:1780997221.440305:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126959616 00010000:00010000:1.0:1780997221.440344:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968888954000/0x30fd811c0305ada4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305ad9d expref: 23 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.440369:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126960128 00000100:00100000:1.0:1780997221.440372:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126960128 00010000:00010000:1.0:1780997221.440385:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968983ce2a00/0x30fd811c0305ad42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305ad3b expref: 24 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.440403:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126960640 00000100:00100000:1.0:1780997221.440405:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126960640 00010000:00010000:1.0:1780997221.440416:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968983ce3c00/0x30fd811c0305abf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305abeb expref: 25 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.440423:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126959744 00000100:00100000:1.0:1780997221.440426:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126959744 00010000:00010000:1.0:1780997221.440435:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bc842e00/0x30fd811c0305ad7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305ad73 expref: 26 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.440445:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126960256 00000100:00100000:1.0:1780997221.440448:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126960256 00010000:00010000:1.0:1780997221.440459:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bc842800/0x30fd811c0305ad18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305ad11 expref: 27 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.440471:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:1.0:1780997221.440478:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b6209450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+27:3496:x1867507126959616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997221.440491:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997221.440496:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968888954000/0x30fd811c0305ada4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305ad9d expref: 27 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440508:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968888954000/0x30fd811c0305ada4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305ad9d expref: 27 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440525:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888954000/0x30fd811c0305ada4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305ad9d expref: 27 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440540:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997221.440570:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b6209450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+26:3496:x1867507126959616:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997221.440583:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:1.0:1780997221.440624:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:1.0:1780997221.440630:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+25:3496:x1867507126960128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997221.440637:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997221.440641:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968983ce2a00/0x30fd811c0305ad42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305ad3b expref: 25 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440650:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968983ce2a00/0x30fd811c0305ad42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305ad3b expref: 25 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440660:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce2a00/0x30fd811c0305ad42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305ad3b expref: 25 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440669:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997221.440688:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+24:3496:x1867507126960128:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997221.440695:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:1.0:1780997221.440705:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:1.0:1780997221.440711:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126960640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997221.440718:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997221.440722:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968983ce3c00/0x30fd811c0305abf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305abeb expref: 23 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440731:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968983ce3c00/0x30fd811c0305abf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305abeb expref: 23 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440742:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce3c00/0x30fd811c0305abf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305abeb expref: 23 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440760:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997221.440783:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3496:x1867507126960640:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997221.440790:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:1.0:1780997221.440810:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:1.0:1780997221.440817:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3496:x1867507126959744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997221.440824:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997221.440828:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bc842e00/0x30fd811c0305ad7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305ad73 expref: 21 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440837:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bc842e00/0x30fd811c0305ad7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305ad73 expref: 21 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440846:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc842e00/0x30fd811c0305ad7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305ad73 expref: 21 pid: 88344 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440855:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997221.440875:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3496:x1867507126959744:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997221.440882:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:1.0:1780997221.440893:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1780997221.440899:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3496:x1867507126960256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997221.440905:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997221.440909:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bc842800/0x30fd811c0305ad18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305ad11 expref: 19 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440918:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bc842800/0x30fd811c0305ad18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305ad11 expref: 19 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440933:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc842800/0x30fd811c0305ad18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305ad11 expref: 19 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.440941:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997221.440964:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3496:x1867507126960256:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997221.440970:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1780997221.441012:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126959744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997221.441021:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126960256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997221.441030:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126959616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997221.441038:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126960128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997221.441044:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126960640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997221.441859:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997221.442054:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997221.442074:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126959872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997221.442128:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997221.442178:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126960384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997221.442197:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997221.442318:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1780997221.442333:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126960000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997221.442357:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997221.442706:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126960512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997221.442729:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997221.442767:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126959872 00000100:00100000:3.0:1780997221.442776:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126959872 00010000:00010000:3.0:1780997221.442811:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968983ce3400/0x30fd811c0305ad6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305ad65 expref: 18 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997221.442838:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126960384 00000100:00100000:3.0:1780997221.442841:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126960384 00010000:00010000:3.0:1780997221.442851:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968983ce2600/0x30fd811c0305accb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305acc4 expref: 19 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997221.442864:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126960000 00000100:00100000:3.0:1780997221.442866:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126960000 00010000:00010000:3.0:1780997221.442889:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968983ce2000/0x30fd811c0305ad50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305ad49 expref: 20 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997221.442908:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:3.0:1780997221.442915:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3498:x1867507126959872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997221.442930:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997221.442935:0:6336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968983ce3400/0x30fd811c0305ad6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305ad65 expref: 20 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997221.442947:0:6336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968983ce3400/0x30fd811c0305ad6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305ad65 expref: 20 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997221.442965:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce3400/0x30fd811c0305ad6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305ad65 expref: 20 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997221.442981:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997221.443013:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3498:x1867507126959872:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997221.443021:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:3.0:1780997221.443035:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:3.0:1780997221.443041:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3498:x1867507126960384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997221.443048:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997221.443051:0:6336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968983ce2600/0x30fd811c0305accb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305acc4 expref: 18 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997221.443060:0:6336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968983ce2600/0x30fd811c0305accb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305acc4 expref: 18 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997221.443069:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce2600/0x30fd811c0305accb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305acc4 expref: 18 pid: 88351 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997221.443084:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997221.443103:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:3498:x1867507126960384:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997221.443109:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:3.0:1780997221.443120:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:3.0:1780997221.443125:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b620a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:3498:x1867507126960000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997221.443131:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997221.443135:0:6336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968983ce2000/0x30fd811c0305ad50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305ad49 expref: 16 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997221.443144:0:6336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968983ce2000/0x30fd811c0305ad50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305ad49 expref: 16 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997221.443154:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce2000/0x30fd811c0305ad50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305ad49 expref: 16 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997221.443162:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997221.443181:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b620a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:3498:x1867507126960000:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997221.443187:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:2.0:1780997221.443968:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126959872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997221.443980:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126960384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997221.444005:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126960000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997221.444078:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126960512 00000100:00100000:3.0:1780997221.444085:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126960512 00010000:00010000:3.0:1780997221.444110:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968888955600/0x30fd811c0305acfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305acf5 expref: 15 pid: 88345 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997221.444145:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:3.0:1780997221.444154:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:3498:x1867507126960512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997221.444178:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997221.444183:0:6336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968888955600/0x30fd811c0305acfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305acf5 expref: 15 pid: 88345 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997221.444193:0:6336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968888955600/0x30fd811c0305acfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305acf5 expref: 15 pid: 88345 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997221.444206:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888955600/0x30fd811c0305acfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305acf5 expref: 15 pid: 88345 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997221.444218:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997221.444297:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:3498:x1867507126960512:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997221.444304:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:1.0:1780997221.444413:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126960512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997221.454969:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997221.455013:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997221.455312:0:88956:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126959360:192.168.206.51@tcp:104: 00000100:00100000:0.0:1780997221.455342:0:88956:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88956:1867507126959488:192.168.206.51@tcp:104: 00010000:00010000:0.0:1780997221.455409:0:88956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.455896:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110403840 00000100:00100000:1.0:1780997221.455907:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110403840 00010000:00010000:1.0:1780997221.455955:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305abc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d44 expref: 9 pid: 88345 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.456002:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2576 00000100:00100000:1.0:1780997221.456012:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110403840:12345-192.168.206.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1780997221.456013:0:6337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110403968 00000100:00100000:2.0:1780997221.456070:0:6337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110403968 00010000:00010000:1.0:1780997221.456083:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997221.456091:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305abc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d44 expref: 10 pid: 88345 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997221.456096:0:6337:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968983ce3000/0x30fd811c0305abba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d36 expref: 10 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456143:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305abc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d44 expref: 10 pid: 88345 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456164:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305abc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d44 expref: 10 pid: 88345 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456182:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997221.456250:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110403840:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 239us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997221.456260:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2576 00000100:00100000:1.0:1780997221.456308:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2577 00000100:00100000:1.0:1780997221.456318:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:2395:x1867507110403968:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780997221.456339:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997221.456345:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff968983ce3000/0x30fd811c0305abba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d36 expref: 8 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456356:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968983ce3000/0x30fd811c0305abba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d36 expref: 8 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456366:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce3000/0x30fd811c0305abba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d36 expref: 8 pid: 88346 timeout: 3848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456380:0:25183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456388:0:25183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456415:0:25183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456424:0:25183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456431:0:25183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456439:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456446:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffc200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997221.456451:0:25183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456461:0:25183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456478:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997221.456489:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997221.456504:0:88956:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997221.456513:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:2395:x1867507110403968:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 196us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997221.456523:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2577 00010000:00010000:0.0:1780997221.456534:0:88956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997221.456542:0:88956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffc200/0x30fd811c0305b0c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997222.117555:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997222.821665:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126960768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997222.821772:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1780997222.824579:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780997222.824591:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689a5870800 from 52 10000000:01000000:2.0:1780997222.824600:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780997222.824668:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997222.824683:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997222.824698:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997222.824730:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126960896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997222.825477:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997222.825590:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126961024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997222.826611:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99e40 going to sleep for 11 seconds 00000100:00100000:3.0:1780997222.826696:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997222.827143:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126960768 00000100:00100000:0.0:1780997222.827157:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126960768 00000100:00100000:0.0:1780997222.827250:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126961024 00000100:00100000:0.0:1780997222.827253:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126961024 00000100:00100000:2.0:1780997222.827304:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1780997222.827335:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126960768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997222.827387:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00080000:3.0:1780997222.827855:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997222.827862:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997222.828218:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126960768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 887us (6443us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997222.830496:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126960896 00000100:00100000:1.0:1780997222.830516:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126960896 00000100:00100000:1.0:1780997222.830601:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1780997222.830612:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507126960896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997222.830651:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997222.830677:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff02e00/0x30fd811c0305b0d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b0c9 expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997222.830714:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02e00/0x30fd811c0305b0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b0c9 expref: 15 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997222.830728:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff02e00/0x30fd811c0305b0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b0c9 expref: 15 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997222.830739:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02e00, rc 0) 00000100:00100000:1.0:1780997222.830835:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126960896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (5360us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997222.830843:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1780997222.830982:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:0.0:1780997222.830999:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126961024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997222.831028:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997222.831078:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126961024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (4383us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997222.831084:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:0.0:1780997222.831557:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126960768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997222.831601:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126960896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997222.831623:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b0d0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997222.831635:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b0d0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997222.831730:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126961152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997222.831779:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997222.833010:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1780997222.833129:0:3498:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969455 gen 2 00000004:00080000:2.0:1780997222.833137:0:3498:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9689adb89880, transno 4294969455 00000100:00100000:2.0:1780997222.833525:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126961024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997222.833820:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898d9ae900 going to sleep for 11 seconds 00000100:00100000:1.0:1780997222.835712:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126961152 00000100:00100000:1.0:1780997222.835730:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126961152 00000100:00100000:1.0:1780997222.835793:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1780997222.835804:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126961152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997222.836038:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126961152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (4258us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997222.836047:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1780997222.836410:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126961152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997222.836664:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126961280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997222.836737:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997222.836783:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968983bc79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997222.837791:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126961280 00000100:00100000:2.0:1780997222.837805:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126961280 00000100:00100000:2.0:1780997222.837865:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1780997222.837875:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126961280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997222.838783:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126961280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 907us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997222.838792:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1780997222.839134:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126961280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997222.840953:0:88957:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88957:1867507126961408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997222.841054:0:88957:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997222.841107:0:88957:0:(client.c:2692:ptlrpc_set_wait()) set ffff968983bc79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997222.841859:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126961408 00000100:00100000:1.0:1780997222.841870:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126961408 00000100:00100000:1.0:1780997222.841936:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1780997222.841947:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:88957:x1867507126961408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997222.842156:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:88957:x1867507126961408:12345-0@lo:502:llog_process_th.0 Request processed in 210us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997222.842183:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1780997222.842838:0:88957:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88957:1867507126961408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997222.843107:0:88957:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88957:1867507126961536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997222.843171:0:88957:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997222.843205:0:88957:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034900 going to sleep for 11 seconds 00000100:00100000:0.0:1780997222.843293:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126961536 00000100:00100000:0.0:1780997222.843300:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126961536 00000100:00100000:0.0:1780997222.843363:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1780997222.843372:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:88957:x1867507126961536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997222.843501:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:88957:x1867507126961536:12345-0@lo:502:llog_process_th.0 Request processed in 131us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997222.843508:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1780997222.843824:0:88957:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88957:1867507126961536:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780997222.843848:0:88957:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1780997222.844923:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1780997222.844975:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780997222.844992:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b0d0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997222.845007:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b0d0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997222.845019:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1780997222.845023:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:2.0:1780997222.845026:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1780997222.845071:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997222.845081:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997222.845092:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997222.845115:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126961664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997222.845205:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997222.845309:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126961664 00000100:00100000:1.0:1780997222.845328:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126961664 00000100:00100000:1.0:1780997222.845386:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1780997222.845395:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126961664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997222.845409:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997222.845426:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff02c00/0x30fd811c0305b0de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b0d7 expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997222.845457:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02c00/0x30fd811c0305b0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b0d7 expref: 16 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997222.845470:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff02c00/0x30fd811c0305b0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b0d7 expref: 16 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997222.845481:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02c00, rc 0) 00000100:00100000:1.0:1780997222.845522:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126961664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997222.845530:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1780997222.845554:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997222.845580:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126961664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997222.845595:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b0de expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997222.845606:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b0de expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997222.845831:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126961792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997222.845858:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997222.845888:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997222.845957:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126961792 00000100:00100000:3.0:1780997222.845962:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126961792 00000100:00100000:3.0:1780997222.845995:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1780997222.846002:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126961792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997222.846133:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126961792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997222.846139:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1780997222.846560:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126961792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997222.846595:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126961920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997222.846847:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997222.846892:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997222.847180:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126961920 00000100:00100000:0.0:1780997222.847188:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126961920 00000100:00100000:0.0:1780997222.847233:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1780997222.847251:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126961920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997222.847719:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126961920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 468us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997222.847728:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1780997222.847889:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126961920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997222.848906:0:88958:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88958:1867507126962048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997222.848964:0:88958:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997222.849004:0:88958:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034180 going to sleep for 11 seconds 00000100:00100000:2.0:1780997222.849094:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126962048 00000100:00100000:2.0:1780997222.849102:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126962048 00000100:00100000:2.0:1780997222.849148:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1780997222.849164:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:88958:x1867507126962048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997222.849579:0:88958:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88958:1867507126962048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780997222.849628:0:88958:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997222.849766:0:88958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997222.849770:0:88958:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:3.0:1780997222.849776:0:88958:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1780997222.849854:0:88958:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:2.0:1780997222.850226:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:88958:x1867507126962048:12345-0@lo:502:llog_process_th.0 Request processed in 1067us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997222.850236:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00080000:10000000:2.0:1780997222.854049:0:88958:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00080000:10000000:2.0:1780997222.875074:0:88958:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:2.0:1780997222.908219:0:88958:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00000100:00100000:1.0:1780997222.926803:0:88958:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88958:1867507126962176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997222.926933:0:88958:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997222.927057:0:88958:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689898b5480 going to sleep for 11 seconds 00000100:00100000:0.0:1780997222.932565:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126962176 00000100:00100000:0.0:1780997222.932589:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126962176 00000100:00100000:1.0:1780997222.937602:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1780997222.937634:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:88958:x1867507126962176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997222.937899:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:88958:x1867507126962176:12345-0@lo:502:llog_process_th.0 Request processed in 273us (10966us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997222.937919:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1780997222.938033:0:88958:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88958:1867507126962176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997222.938112:0:88958:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88958:1867507126962304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997222.938162:0:88958:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997222.949688:0:88958:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99f00 going to sleep for 11 seconds 00000100:00100000:3.0:1780997222.954628:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126962304 00000100:00100000:3.0:1780997222.954888:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126962304 00000100:00100000:3.0:1780997222.954987:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1780997222.954999:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:88958:x1867507126962304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997222.956763:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:88958:x1867507126962304:12345-0@lo:502:llog_process_th.0 Request processed in 1758us (18593us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997222.956778:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1780997222.957829:0:88958:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88958:1867507126962304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780997222.957883:0:88958:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997222.957894:0:88958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997222.957897:0:88958:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:2.0:1780997222.957901:0:88958:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:1.0:1780997222.959207:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:1.0:1780997222.959257:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1780997222.959305:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b0de expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997222.959329:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b0de expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997222.959341:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780997222.959345:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968886f5e000 from 52 10000000:01000000:1.0:1780997222.959348:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780997222.959401:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997222.959409:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997222.959420:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997222.959603:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126962432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997222.959751:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997222.959803:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f000 going to sleep for 11 seconds 00000100:00100000:2.0:1780997222.960251:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126962432 00000100:00100000:2.0:1780997222.960262:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126962432 00000100:00100000:2.0:1780997222.960356:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1780997222.960369:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126962432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997222.960386:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997222.960403:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455a00/0x30fd811c0305b0ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b0e5 expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997222.960434:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455a00/0x30fd811c0305b0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b0e5 expref: 17 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997222.960459:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455a00/0x30fd811c0305b0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b0e5 expref: 17 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997222.960468:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455a00, rc 0) 00000100:00100000:2.0:1780997222.960518:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126962432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997222.960526:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1780997222.961207:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126962432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997222.961229:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b0ec expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997222.961266:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b0ec expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997222.961408:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126962560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997222.961785:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997222.961830:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f000 going to sleep for 11 seconds 00000100:00100000:2.0:1780997222.961920:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126962560 00000100:00100000:2.0:1780997222.961927:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126962560 00000100:00100000:2.0:1780997222.961962:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1780997222.961971:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126962560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997222.962148:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126962560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997222.962165:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1780997222.962373:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126962560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997222.962416:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126962688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997222.962482:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997222.962506:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034780 going to sleep for 11 seconds 00000100:00100000:1.0:1780997222.962836:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126962688 00000100:00100000:1.0:1780997222.962842:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126962688 00000100:00100000:1.0:1780997222.962883:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1780997222.962890:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126962688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997222.962985:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126962688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997222.962992:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1780997222.964744:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126962688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997222.967737:0:88959:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88959:1867507126962816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997222.967858:0:88959:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997222.967903:0:88959:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997222.968087:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126962816 00000100:00100000:1.0:1780997222.968096:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126962816 00000100:00100000:1.0:1780997222.968165:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1780997222.968174:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:88959:x1867507126962816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997222.968364:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:88959:x1867507126962816:12345-0@lo:502:llog_process_th.0 Request processed in 190us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997222.968373:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1780997222.968620:0:88959:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88959:1867507126962816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997222.968687:0:88959:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88959:1867507126962944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997222.968722:0:88959:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997222.968753:0:88959:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a5f5d240 going to sleep for 11 seconds 00000100:00100000:1.0:1780997222.969011:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126962944 00000100:00100000:1.0:1780997222.969016:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126962944 00000100:00100000:1.0:1780997222.969049:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1780997222.969056:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:88959:x1867507126962944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997222.969124:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:88959:x1867507126962944:12345-0@lo:502:llog_process_th.0 Request processed in 68us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997222.969137:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1780997222.971650:0:88959:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88959:1867507126962944:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1780997222.971718:0:88959:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1780997222.972122:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1780997222.972167:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780997222.972184:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b0ec expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997222.972198:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b0ec expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997222.972210:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1780997222.972213:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1780997222.972217:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1780997222.972354:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997222.972378:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997222.972390:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997222.972418:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126963072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997222.972743:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997222.972794:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997222.972968:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126963072 00000100:00100000:1.0:1780997222.972976:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126963072 00000100:00100000:1.0:1780997222.973038:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1780997222.973048:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126963072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997222.973064:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997222.973082:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff02600/0x30fd811c0305b0fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b0f3 expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997222.973110:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02600/0x30fd811c0305b0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b0f3 expref: 18 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997222.973123:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff02600/0x30fd811c0305b0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b0f3 expref: 18 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997222.973133:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02600, rc 0) 00000100:00100000:1.0:1780997222.973188:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126963072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997222.973196:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1780997222.974050:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126963072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997222.974072:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b0fa expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997222.974098:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b0fa expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997222.974209:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126963200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997222.974541:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997222.974579:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5540 going to sleep for 11 seconds 00000100:00100000:3.0:1780997222.975429:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126963200 00000100:00100000:3.0:1780997222.975619:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126963200 00000100:00100000:3.0:1780997222.975758:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1780997222.975770:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126963200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997222.975986:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126963200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997222.975995:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1780997222.976066:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126963200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997222.976126:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126963328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997222.976188:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997222.976215:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997222.976310:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126963328 00000100:00100000:1.0:1780997222.976326:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126963328 00000100:00100000:1.0:1780997222.976375:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1780997222.976382:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126963328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997222.976715:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126963328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 333us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997222.976723:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1780997222.977824:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126963328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997222.986046:0:88960:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88960:1867507126963456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997222.995803:0:88960:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997222.995921:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126963456 00000100:00100000:0.0:1780997222.995934:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126963456 00000100:00100000:0.0:1780997222.996012:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1780997222.996024:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:88960:x1867507126963456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997222.998829:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:88960:x1867507126963456:12345-0@lo:502:llog_process_th.0 Request processed in 2795us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997222.998846:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1780997223.013748:0:88960:0:(client.c:2692:ptlrpc_set_wait()) set ffff968983699e40 going to sleep for 10 seconds 00000100:00100000:3.0:1780997223.013833:0:88960:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88960:1867507126963456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780997223.013893:0:88960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997223.013927:0:88960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997223.013930:0:88960:0:(obd_config.c:1561:class_process_config()) marker 43 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:3.0:1780997223.013936:0:88960:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1780997223.014021:0:88960:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:3.0:1780997223.014072:0:88960:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88960:1867507126963584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997223.015976:0:88960:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997223.016045:0:88960:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780997223.016807:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126963584 00000100:00100000:0.0:1780997223.016829:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126963584 00000100:00100000:0.0:1780997223.016926:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1780997223.016938:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:88960:x1867507126963584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997223.017195:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:88960:x1867507126963584:12345-0@lo:502:llog_process_th.0 Request processed in 258us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997223.017205:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1780997223.023886:0:88960:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88960:1867507126963584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997223.025027:0:88960:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88960:1867507126963712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997223.025138:0:88960:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997223.025206:0:88960:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997223.025743:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126963712 00000100:00100000:1.0:1780997223.025754:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126963712 00000100:00100000:1.0:1780997223.025824:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1780997223.025835:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:88960:x1867507126963712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997223.026011:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:88960:x1867507126963712:12345-0@lo:502:llog_process_th.0 Request processed in 177us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997223.026021:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1780997223.026173:0:88960:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88960:1867507126963712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780997223.026205:0:88960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997223.026214:0:88960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997223.026217:0:88960:0:(obd_config.c:1561:class_process_config()) marker 43 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:2.0:1780997223.026222:0:88960:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:3.0:1780997223.029007:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:3.0:1780997223.029065:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1780997223.029083:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b0fa expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997223.029098:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b0fa expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997223.029247:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780997223.029252:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689bfa99000 from 52 10000000:01000000:2.0:1780997223.029256:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780997223.029361:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997223.029370:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997223.029383:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997223.029418:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126963840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997223.029541:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997223.029591:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99600 going to sleep for 11 seconds 00000100:00100000:0.0:1780997223.029887:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126963840 00000100:00100000:0.0:1780997223.029898:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126963840 00000100:00100000:0.0:1780997223.029970:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1780997223.029982:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126963840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997223.030000:0:88344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997223.030022:0:88344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968889ffc200/0x30fd811c0305b108 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b101 expref: -99 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997223.030051:0:88344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffc200/0x30fd811c0305b108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b101 expref: 19 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997223.030063:0:88344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968889ffc200/0x30fd811c0305b108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b101 expref: 19 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997223.030074:0:88344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffc200, rc 0) 00000100:00100000:0.0:1780997223.030131:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126963840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997223.030139:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1780997223.030789:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126963840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997223.030811:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b108 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997223.030821:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b108 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997223.030912:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126963968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997223.030954:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997223.030991:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997223.031715:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126963968 00000100:00100000:1.0:1780997223.031725:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126963968 00000100:00100000:1.0:1780997223.031769:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1780997223.031778:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126963968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997223.031956:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126963968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997223.031964:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1780997223.032143:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126963968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997223.032200:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126964096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997223.032295:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997223.032329:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99600 going to sleep for 11 seconds 00000100:00100000:3.0:1780997223.032559:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126964096 00000100:00100000:3.0:1780997223.032566:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126964096 00000100:00100000:3.0:1780997223.032602:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1780997223.032620:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126964096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997223.032729:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126964096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997223.032737:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1780997223.032986:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126964096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997223.034216:0:88961:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88961:1867507126964224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997223.034902:0:88961:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997223.034952:0:88961:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689836996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997223.035010:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126964224 00000100:00100000:1.0:1780997223.035018:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126964224 00000100:00100000:1.0:1780997223.035066:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1780997223.035075:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:88961:x1867507126964224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997223.035227:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:88961:x1867507126964224:12345-0@lo:502:llog_process_th.0 Request processed in 154us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997223.035241:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1780997223.036500:0:88961:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88961:1867507126964224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997223.036586:0:88961:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba186d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88961:1867507126964352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997223.037393:0:88961:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997223.037455:0:88961:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689836996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997223.037895:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126964352 00000100:00100000:1.0:1780997223.037917:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126964352 00000100:00100000:1.0:1780997223.037967:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1780997223.037976:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:88961:x1867507126964352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997223.038121:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:88961:x1867507126964352:12345-0@lo:502:llog_process_th.0 Request processed in 145us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997223.038129:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1780997223.041086:0:88961:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba186d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88961:1867507126964352:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780997223.041170:0:88961:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1780997223.041633:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1780997223.041678:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780997223.041693:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b108 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997223.041706:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b108 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997223.041717:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1780997223.041720:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1780997223.041741:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1780997223.041794:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997223.041803:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997223.041813:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997223.041844:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126964480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997223.041936:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997223.041994:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898d160f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997223.042309:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126964480 00000100:00100000:1.0:1780997223.042328:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126964480 00000100:00100000:1.0:1780997223.042403:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1780997223.042414:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126964480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997223.042431:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997223.042459:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff02a00/0x30fd811c0305b116 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b10f expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997223.042490:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02a00/0x30fd811c0305b116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b10f expref: 20 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997223.042501:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff02a00/0x30fd811c0305b116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b10f expref: 20 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997223.042513:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02a00, rc 0) 00000100:00100000:1.0:1780997223.042563:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126964480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997223.042570:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1780997223.045363:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126964480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997223.045402:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b116 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997223.045418:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b116 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997223.045564:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126964608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997223.046020:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997223.046076:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898d160f00 going to sleep for 11 seconds 00000100:00100000:3.0:1780997223.048778:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126964608 00000100:00100000:3.0:1780997223.048796:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126964608 00000100:00100000:3.0:1780997223.048962:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1780997223.048975:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126964608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997223.049250:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126964608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (3218us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997223.049260:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1780997223.051046:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997223.051131:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126964608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997223.051226:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126964736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997223.051552:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997223.051624:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898d160f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997223.051831:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110404096 00000100:00100000:1.0:1780997223.051841:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110404096 00000100:00100000:1.0:1780997223.051904:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126964736 00000100:00100000:1.0:1780997223.051908:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126964736 00000100:00100000:1.0:1780997223.051935:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:1.0:1780997223.051953:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70253:x1867507110404096:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997223.051970:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997223.051992:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff03a00/0x30fd811c0305b11d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d98 expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997223.052030:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03a00/0x30fd811c0305b11d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d98 expref: 8 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997223.052043:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff03a00/0x30fd811c0305b11d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d98 expref: 8 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997223.052055:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03a00, rc 0) 00000100:00100000:1.0:1780997223.052111:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110404096:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 160us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997223.052119:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:1.0:1780997223.052148:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1780997223.052168:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126964736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997223.052335:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126964736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997223.052858:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1780997223.054432:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126964736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997223.057818:0:88962:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1780997223.058683:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1780997223.058723:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1780997223.058739:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b116 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997223.058754:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b116 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997223.058766:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780997223.058785:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968990f90000 from 52 10000000:01000000:2.0:1780997223.058789:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780997223.058849:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997223.058858:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997223.058869:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997223.058901:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126964864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997223.058987:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997223.059037:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997223.059249:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126964864 00000100:00100000:1.0:1780997223.059260:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126964864 00000100:00100000:1.0:1780997223.059373:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1780997223.059385:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126964864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997223.059402:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997223.059417:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff03400/0x30fd811c0305b12b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b124 expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997223.059460:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03400/0x30fd811c0305b12b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b124 expref: 21 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997223.059472:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff03400/0x30fd811c0305b12b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b124 expref: 21 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997223.059482:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03400, rc 0) 00000100:00100000:1.0:1780997223.059532:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126964864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997223.059540:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1780997223.060385:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126964864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997223.060406:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b12b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997223.060416:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b12b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997223.060502:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126964992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997223.060543:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997223.060565:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780997223.060842:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126964992 00000100:00100000:2.0:1780997223.060849:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126964992 00000100:00100000:2.0:1780997223.060887:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1780997223.060894:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126964992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997223.061038:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126964992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997223.061046:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1780997223.061191:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997223.061357:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110404224 00000100:00100000:0.0:1780997223.061362:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110404224 00000100:00100000:0.0:1780997223.061396:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:0.0:1780997223.061403:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110404224:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997223.061494:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110404224:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 91us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997223.061501:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:3.0:1780997223.063166:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126964992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997223.063580:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997223.063670:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110404352 00000100:00100000:1.0:1780997223.063679:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110404352 00000100:00100000:1.0:1780997223.063736:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:1.0:1780997223.063746:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110404352:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997223.063911:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110404352:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 166us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997223.063919:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:3.0:1780997223.065002:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126965120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997223.065077:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997223.065125:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997223.066456:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126965120 00000100:00100000:1.0:1780997223.066471:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126965120 00000100:00100000:1.0:1780997223.066578:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1780997223.066590:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126965120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997223.066798:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126965120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997223.066807:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1780997223.068265:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126965120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997223.071922:0:88963:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88963:1867507126965248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997223.072039:0:88963:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997223.072878:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997223.073881:0:88963:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689a5f5d240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997223.074097:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126965248 00000100:00100000:2.0:1780997223.074111:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126965248 00000100:00100000:2.0:1780997223.074199:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1780997223.074210:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:88963:x1867507126965248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997223.074604:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:88963:x1867507126965248:12345-0@lo:502:llog_process_th.0 Request processed in 394us (2563us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997223.074778:0:88963:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88963:1867507126965248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997223.074864:0:88963:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88963:1867507126965376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997223.074929:0:88963:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997223.074955:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126965376 00000100:00100000:0.0:1780997223.074960:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126965376 00000100:00100000:0.0:1780997223.074986:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1780997223.074994:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:88963:x1867507126965376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997223.075080:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:88963:x1867507126965376:12345-0@lo:502:llog_process_th.0 Request processed in 86us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997223.075098:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1780997223.075148:0:88963:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc784300 going to sleep for 11 seconds 00000100:00100000:0.0:1780997223.075174:0:88963:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:88963:1867507126965376:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1780997223.075192:0:88963:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000100:00100000:2.0:1780997223.075586:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000020:01000000:3.0:1780997223.075875:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 00000100:00100000:0.0:1780997223.076295:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110404480 00000100:00100000:0.0:1780997223.076303:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110404480 00000100:00100000:0.0:1780997223.076352:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:0.0:1780997223.076360:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:71197:x1867507110404480:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1780997223.076498:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:71197:x1867507110404480:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 139us (3624us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997223.076506:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 10000000:01000000:3.0:1780997223.079535:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780997223.079559:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b12b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997223.079577:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b12b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997223.079612:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1780997223.079626:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1780997223.079630:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000100:00100000:0.0:1780997223.079825:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997223.079865:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110404608 00000100:00100000:0.0:1780997223.079877:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110404608 00000100:00100000:0.0:1780997223.079933:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:0.0:1780997223.079944:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:71197:x1867507110404608:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1780997223.080120:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:71197:x1867507110404608:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 177us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997223.080128:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00010000:00010000:3.0:1780997223.080431:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997223.080443:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997223.080453:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997223.080480:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126965504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997223.080527:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997223.080566:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034780 going to sleep for 11 seconds 00000100:00100000:2.0:1780997223.082103:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126965504 00000100:00100000:2.0:1780997223.082119:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126965504 00000100:00100000:2.0:1780997223.082199:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1780997223.082211:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126965504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997223.082229:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997223.082262:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b139 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b132 expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997223.082322:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b132 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997223.082335:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b132 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997223.082345:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454e00, rc 0) 00000100:00100000:2.0:1780997223.082415:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126965504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997223.082422:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1780997223.084899:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126965504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997223.084936:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b139 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997223.084950:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b139 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997223.087986:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126965632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997223.088089:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997223.088318:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318300 going to sleep for 11 seconds 00000100:00100000:0.0:1780997223.090099:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997223.097772:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126965632 00000100:00100000:2.0:1780997223.097795:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126965632 00000100:00100000:2.0:1780997223.097886:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110404736 00000100:00100000:2.0:1780997223.097891:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110404736 00000100:00100000:2.0:1780997223.097928:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1780997223.097940:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968886f06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126965632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997223.098406:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:3.0:1780997223.098419:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110404736:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997223.098432:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997223.098457:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968980031a00/0x30fd811c0305b140 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8d9f expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997223.098514:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968980031a00/0x30fd811c0305b140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d9f expref: 9 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997223.098526:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968980031a00/0x30fd811c0305b140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d9f expref: 9 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997223.098537:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968980031a00, rc 0) 00000100:00100000:3.0:1780997223.098595:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110404736:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 180us (8506us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997223.098602:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:2.0:1780997223.098774:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968886f06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126965632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (10146us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997223.098785:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1780997223.098895:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126965632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997223.098979:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126965760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997223.099036:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997223.099077:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1780997223.099259:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126965760 00000100:00100000:3.0:1780997223.099266:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126965760 00000100:00100000:3.0:1780997223.099332:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1780997223.099339:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126965760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997223.099451:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126965760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997223.099457:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1780997223.099502:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126965760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997223.109095:0:88964:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000100:00100000:3.0:1780997223.113089:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997223.113222:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110404864 00000100:00100000:2.0:1780997223.113237:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110404864 00000100:00100000:2.0:1780997223.113363:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:2.0:1780997223.113376:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110404864:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997223.113539:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110404864:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 165us (464us total) trans 0 rc -2/-2 00000100:00100000:2.0:1780997223.113548:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00000020:01000000:0.0:1780997223.118210:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1780997223.118264:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1780997223.118303:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b139 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997223.118354:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b139 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997223.118491:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1780997223.118496:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9689b6283380 from 1 10000000:01000000:1.0:1780997223.118499:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1780997223.118554:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997223.118562:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997223.118575:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997223.118617:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126965888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997223.118710:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997223.118756:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318a80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997223.119450:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126965888 00000100:00100000:2.0:1780997223.119462:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126965888 00000100:00100000:2.0:1780997223.119532:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1780997223.119545:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126965888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997223.119564:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997223.119584:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455200/0x30fd811c0305b14e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b147 expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997223.119628:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455200/0x30fd811c0305b14e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b147 expref: 23 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997223.119649:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455200/0x30fd811c0305b14e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b147 expref: 23 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997223.119660:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455200, rc 0) 00000100:00100000:2.0:1780997223.119724:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126965888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997223.119746:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1780997223.120098:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126965888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997223.120120:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b14e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997223.120132:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b14e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997223.120425:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126966016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997223.120466:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997223.120493:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318a80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997223.122775:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126966016 00000100:00100000:2.0:1780997223.122797:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126966016 00000100:00100000:2.0:1780997223.122940:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1780997223.122954:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126966016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997223.123146:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126966016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (2678us total) trans 0 rc -2/-2 00000100:00100000:2.0:1780997223.123165:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1780997223.123825:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126966016:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1780997223.123910:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1780997223.123925:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b14e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997223.123936:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b14e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997223.145804:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997224.186443:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997224.870535:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997224.870561:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126966144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997224.870631:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997224.870680:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997224.870690:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126966272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997224.870717:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997224.870739:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126966144 00000100:00100000:0.0:1780997224.870742:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126966272 00000100:00100000:2.0:1780997224.870746:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126966144 00000100:00100000:0.0:1780997224.870746:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126966272 00000100:00100000:0.0:1780997224.871507:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048 00000100:00100000:0.0:1780997224.871519:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126966272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780997224.872256:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1780997224.872368:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126966272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 851us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997224.872377:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048 00000100:00100000:2.0:1780997224.874467:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4049 00000100:00100000:2.0:1780997224.874623:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507126966144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780997224.874661:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00000100:00100000:2.0:1780997224.874736:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507126966144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 258us (4104us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997224.874743:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4049 00000100:00100000:2.0:1780997224.874883:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507126966784:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.874918:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997224.874941:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126967296:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.874961:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997224.874979:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1780997224.874984:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126966400:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.875013:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997224.875037:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126966912:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.875057:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997224.875082:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126967424:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.875105:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997224.875130:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126966656:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.875153:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997224.875169:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126967168:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.875189:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997224.875203:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126967680:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.875224:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997224.875403:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1780997224.875409:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126966528:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.875434:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997224.875449:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126967040:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.875465:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997224.875481:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126967552:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.875581:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997224.875611:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126966400 00000100:00100000:2.0:1780997224.875618:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126966400 00000100:00100000:2.0:1780997224.875647:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1780997224.875653:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126966400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997224.875671:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126966144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997224.875689:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126966400:12345-0@lo:400:kworker.0 Request processed in 36us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997224.875695:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1780997224.875716:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126966784 00000100:00100000:2.0:1780997224.875719:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126967424 00000100:00100000:0.0:1780997224.875720:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126966784 00000100:00100000:2.0:1780997224.875721:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126967424 00000100:00100000:1.0:1780997224.875820:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126967296 00000100:00100000:1.0:1780997224.875825:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126967296 00000100:00100000:0.0:1780997224.875867:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126966912 00000100:00100000:0.0:1780997224.875870:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126966912 00000100:00100000:1.0:1780997224.879652:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126966656 00000100:00100000:1.0:1780997224.879668:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126966656 00000100:00100000:2.0:1780997224.879986:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126967168 00000100:00100000:2.0:1780997224.879991:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126967168 00000100:00100000:2.0:1780997224.880033:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126967040 00000100:00100000:2.0:1780997224.880036:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126967040 00000100:00100000:2.0:1780997224.880057:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126967552 00000100:00100000:2.0:1780997224.880060:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126967552 00000100:00100000:2.0:1780997224.880086:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634 00000100:00100000:2.0:1780997224.880096:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126967424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.880186:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126967424:12345-0@lo:400:kworker.0 Request processed in 92us (5079us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997224.880193:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634 00000100:00100000:2.0:1780997224.880209:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00000100:00100000:2.0:1780997224.880215:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126967168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.880471:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126967168:12345-0@lo:400:kworker.0 Request processed in 255us (5280us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997224.880478:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:2.0:1780997224.880829:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00100000:2.0:1780997224.880837:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126967040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.880874:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126967040:12345-0@lo:400:kworker.0 Request processed in 38us (5407us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997224.880879:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00000100:00100000:2.0:1780997224.880890:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637 00000100:00100000:2.0:1780997224.880895:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126967552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.880922:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126967552:12345-0@lo:400:kworker.0 Request processed in 27us (5341us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997224.880927:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00000100:00100000:2.0:1780997224.881010:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126966400:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.881027:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126967424:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.881075:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126967040:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.881088:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126967552:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.881101:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126967168:0@lo:400:kworker.0 00000100:00080000:2.0:1780997224.882058:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997224.882064:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997224.882067:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997224.882070:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780997224.882085:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126967680 00000100:00100000:2.0:1780997224.882092:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126967680 00000100:00100000:2.0:1780997224.882119:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126966528 00000100:00100000:2.0:1780997224.882122:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126966528 00000100:00100000:3.0:1780997224.882445:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1780997224.882460:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507126966784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997224.882703:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507126966784:12345-0@lo:400:kworker.0 Request processed in 247us (7783us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997224.882711:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1780997224.882740:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:3.0:1780997224.882748:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126967296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997224.882780:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507126967296:12345-0@lo:400:kworker.0 Request processed in 34us (7818us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997224.882787:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:3.0:1780997224.882799:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1780997224.882806:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126967680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997224.883088:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126967680:12345-0@lo:400:kworker.0 Request processed in 282us (7863us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997224.883096:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1780997224.883111:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1780997224.883118:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126966528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997224.883147:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507126966528:12345-0@lo:400:kworker.0 Request processed in 30us (7712us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997224.883152:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1780997224.883195:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507126966784:0@lo:400:kworker.0 00000100:00100000:3.0:1780997224.883207:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507126967296:0@lo:400:kworker.0 00000100:00100000:3.0:1780997224.883242:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507126966528:0@lo:400:kworker.0 00000100:00100000:3.0:1780997224.883254:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126967680:0@lo:400:kworker.0 00000100:00080000:2.0:1780997224.884076:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780997224.888456:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:0.0:1780997224.888475:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126966912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997224.888605:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507126966912:12345-0@lo:400:kworker.0 Request processed in 137us (13546us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997224.888612:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1780997224.888694:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507126966912:0@lo:400:kworker.0 00000100:00100000:2.0:1780997224.888808:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126966272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997224.895996:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1780997224.896016:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126966656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997224.896109:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126966656:12345-0@lo:400:kworker.0 Request processed in 101us (20955us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997224.896118:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1780997224.896171:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126966656:0@lo:400:kworker.0 00010000:00010000:3.0:1780997225.189765:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997225.225209:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997225.225295:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997225.225340:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997225.225387:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997225.225690:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110404992 00000100:00100000:3.0:1780997225.225705:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110404992 00000100:00100000:3.0:1780997225.225786:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:3.0:1780997225.225800:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110404992:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997225.225920:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110404992:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 124us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997225.225929:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:1.0:1780997225.226856:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110405248 00000100:00100000:1.0:1780997225.226879:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110405248 00000100:00100000:1.0:1780997225.226976:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110405120 00000100:00100000:1.0:1780997225.226980:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110405120 00000100:00100000:1.0:1780997225.227008:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1341 00000100:00100000:1.0:1780997225.227021:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110405248:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997225.227121:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110405248:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 103us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.227129:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1341 00000100:00100000:1.0:1780997225.227150:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1342 00000100:00100000:1.0:1780997225.227157:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2395:x1867507110405120:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997225.227179:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2395:x1867507110405120:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.227185:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1342 00000100:00100000:1.0:1780997225.227206:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110405376 00000100:00100000:1.0:1780997225.227210:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110405376 00000100:00100000:1.0:1780997225.227256:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2638 00000100:00100000:1.0:1780997225.227263:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110405376:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997225.227337:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110405376:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 74us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.227345:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2638 00000100:00080000:3.0:1780997225.227803:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997225.227809:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780997225.227811:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997225.383363:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126967808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780997225.383432:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997225.383492:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126967808 00000100:00100000:0.0:1780997225.383499:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126967808 00000100:00100000:0.0:1780997225.383543:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:0.0:1780997225.383552:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126967808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780997225.383579:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997225.383622:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126967808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997225.383629:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00100000:0.0:1780997225.383682:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126967808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780997225.386002:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780997225.386021:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126967936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780997225.386089:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997225.386889:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126967936 00000100:00100000:2.0:1780997225.386899:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126967936 00000100:00100000:2.0:1780997225.386954:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1780997225.386964:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126967936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780997225.386992:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997225.387048:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126967936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997225.387055:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1780997225.387098:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126967936:0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1780997225.392619:0:72364:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411388 batchid updated 00000020:00080000:1.0:1780997225.392699:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411388 00000004:00080000:1.0:1780997225.392789:0:72384:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff968888318a80 with version 15 00000020:00080000:1.0:1780997225.392814:0:72384:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411388 cancel update log [0x2000088d1:0x2:0x0].3: rc = 0 00000020:00080000:1.0:1780997225.392995:0:72384:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411388 cancel update log [0x2400090a0:0x2:0x0].4: rc = 0 00000020:00080000:1.0:1780997225.393005:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411388 00000004:00080000:3.0:1780997225.394607:0:72369:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff968889e33300 version 15 rpc_version 15 00000020:00100000:3.0:1780997225.394650:0:72369:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1780997225.394662:0:72369:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff968990f19880 x1867507126968192/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997225.394688:0:72369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126968192:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1780997225.394755:0:72369:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997225.394800:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034480 going to sleep for 11 seconds 00000100:00100000:0.0:1780997225.394832:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126968192 00000100:00100000:0.0:1780997225.394847:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126968192 00000100:00100000:0.0:1780997225.395016:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050 00000100:00100000:0.0:1780997225.395030:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:72369:x1867507126968192:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1780997225.395329:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:72369:x1867507126968192:12345-0@lo:1000:osp_up0-1.0 Request processed in 301us (572us total) trans 115964116995 rc 0/0 00000100:00100000:0.0:1780997225.395338:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050 00000100:00100000:3.0:1780997225.395452:0:72369:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126968192:0@lo:1000:osp_up0-1.0 00000020:00000080:0.0:1780997225.954213:0:89061:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffef77e41a0 20000000:00000080:0.0:1780997225.954230:0:89061:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9689bc847800 uarg=0000000000000000 00000040:00100000:0.0:1780997225.956806:0:89061:0:(llog.c:1067:llog_reverse_process()) index 54 : idx 49 20000000:01000000:0.0:1780997225.956816:0:89061:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:0.0:1780997225.956907:0:89061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:0.0:1780997225.956925:0:89061:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1780997225.956941:0:89061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:0.0:1780997225.956959:0:89061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:0.0:1780997225.957024:0:89061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:0.0:1780997225.957033:0:89061:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1780997225.957048:0:89061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:0.0:1780997225.957063:0:89061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:0.0:1780997225.957120:0:89061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:0.0:1780997225.957128:0:89061:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1780997225.957142:0:89061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:0.0:1780997225.957156:0:89061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:0.0:1780997225.957169:0:89061:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1780997225.957190:0:89061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957211:0:89061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bff02e00/0x30fd811c0305b0d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b0c9 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957239:0:89061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bff02c00/0x30fd811c0305b0de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b0d7 expref: 22 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957246:0:89061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689ba455a00/0x30fd811c0305b0ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b0e5 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957252:0:89061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bff02600/0x30fd811c0305b0fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b0f3 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957258:0:89061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968889ffc200/0x30fd811c0305b108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b101 expref: 22 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957264:0:89061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bff02a00/0x30fd811c0305b116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b10f expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957455:0:89061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bff03a00/0x30fd811c0305b11d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d98 expref: 8 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957463:0:89061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bff03400/0x30fd811c0305b12b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b124 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957469:0:89061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b132 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957476:0:89061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968980031a00/0x30fd811c0305b140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d9f expref: 8 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957482:0:89061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689ba455200/0x30fd811c0305b14e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b147 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957501:0:89061:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957549:0:89061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689ba455200/0x30fd811c0305b14e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b147 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.957568:0:89061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689ba455200/0x30fd811c0305b14e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b147 expref: 22 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.957853:0:89061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126968320:0@lo:104: 00000100:00100000:0.0:1780997225.957919:0:89061:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780997225.958023:0:89061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968980031a00/0x30fd811c0305b140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d9f expref: 8 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.958032:0:89061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968980031a00/0x30fd811c0305b140 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d9f expref: 8 pid: 88351 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.958041:0:89061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126968448:192.168.206.51@tcp:104: 00010000:00010000:0.0:1780997225.958136:0:89061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b132 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.958144:0:89061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b139 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b132 expref: 22 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.958152:0:89061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5688000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126968576:0@lo:104: 00000100:00100000:0.0:1780997225.958172:0:89061:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780997225.958438:0:89061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bff03400/0x30fd811c0305b12b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b124 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.958461:0:89061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bff03400/0x30fd811c0305b12b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b124 expref: 22 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.958470:0:89061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126968704:0@lo:104: 00000100:00100000:0.0:1780997225.958495:0:89061:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997225.958567:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126968320 00000100:00100000:1.0:1780997225.958586:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126968320 00000100:00100000:1.0:1780997225.958645:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126968576 00000100:00100000:1.0:1780997225.958649:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126968576 00000100:00100000:1.0:1780997225.958665:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1780997225.958673:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:89061:x1867507126968320:12345-0@lo:104: 00010000:00010000:1.0:1780997225.958688:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b14e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.958741:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1780997225.958747:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:89061:x1867507126968320:12345-0@lo:104: Request processed in 75us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.958754:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1780997225.958774:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1780997225.958781:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:89061:x1867507126968576:12345-0@lo:104: 00010000:00010000:1.0:1780997225.958788:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b139 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.958828:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1780997225.958834:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:89061:x1867507126968576:12345-0@lo:104: Request processed in 55us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.958840:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:1.0:1780997225.958858:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997225.958863:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b14e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.958871:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02400 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997225.958876:0:37626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b14e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.958886:0:37626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b14e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997225.958893:0:37626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b14e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997225.958899:0:37626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997225.958930:0:37626:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b14e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.958936:0:37626:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997225.958957:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b14e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.958965:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b147 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b14e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.958990:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997225.958993:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b139 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.958999:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031600 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997225.959002:0:37626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b139 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.959009:0:37626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b139 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997225.959015:0:37626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b139 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997225.959021:0:37626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997225.959036:0:37626:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b139 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.959042:0:37626:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997225.959048:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b139 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.959055:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968980031600/0x30fd811c0305b132 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b139 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.959065:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997225.959066:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997225.959068:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997225.959075:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997225.959102:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126968832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997225.959134:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997225.959162:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997225.959168:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126968960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997225.959189:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997225.959218:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126968832 00000100:00100000:1.0:1780997225.959222:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126968832 00010000:00010000:1.0:1780997225.959242:0:8261:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689ba455200/0x30fd811c0305b14e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b147 expref: 23 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997225.959263:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126968960 00000100:00100000:1.0:1780997225.959266:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126968960 00010000:00010000:1.0:1780997225.959317:0:8261:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b139 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b132 expref: 24 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997225.959338:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1780997225.959344:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+24:3498:x1867507126968832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997225.959354:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997225.959359:0:8261:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689ba455200/0x30fd811c0305b14e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b147 expref: 24 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.959369:0:8261:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689ba455200/0x30fd811c0305b14e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b147 expref: 24 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.959385:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997225.959413:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+24:3498:x1867507126968832:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.959419:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1780997225.959432:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1780997225.959445:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126968960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997225.959453:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997225.959457:0:8261:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b139 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b132 expref: 23 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.959465:0:8261:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b139 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b132 expref: 23 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.959474:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997225.959495:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126968960:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.959501:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1780997225.959557:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126968960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997225.959567:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126968832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997225.959808:0:89061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bff03a00/0x30fd811c0305b11d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d98 expref: 8 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.959820:0:89061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bff03a00/0x30fd811c0305b11d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d98 expref: 8 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.959831:0:89061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969088:192.168.206.51@tcp:104: 00010000:00010000:0.0:1780997225.959890:0:89061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bff02a00/0x30fd811c0305b116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b10f expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.959899:0:89061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bff02a00/0x30fd811c0305b116 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b10f expref: 22 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.959908:0:89061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5688e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969216:0@lo:104: 00000100:00100000:0.0:1780997225.959934:0:89061:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780997225.959955:0:89061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968889ffc200/0x30fd811c0305b108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b101 expref: 22 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.959963:0:89061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968889ffc200/0x30fd811c0305b108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b101 expref: 22 pid: 88344 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.959972:0:89061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888961a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969344:0@lo:104: 00000100:00100000:0.0:1780997225.959994:0:89061:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780997225.960022:0:89061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bff02600/0x30fd811c0305b0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b0f3 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.960031:0:89061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bff02600/0x30fd811c0305b0fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b0f3 expref: 22 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.960039:0:89061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888961b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969472:0@lo:104: 00010000:00010000:0.0:1780997225.960061:0:89061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689ba455a00/0x30fd811c0305b0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b0e5 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.960069:0:89061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689ba455a00/0x30fd811c0305b0ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b0e5 expref: 22 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.960078:0:89061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889618380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969600:0@lo:104: 00010000:00010000:0.0:1780997225.960101:0:89061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bff02c00/0x30fd811c0305b0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b0d7 expref: 22 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.960110:0:89061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bff02c00/0x30fd811c0305b0de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b0d7 expref: 22 pid: 88351 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.960118:0:89061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969728:0@lo:104: 00010000:00010000:0.0:1780997225.960138:0:89061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bff02e00/0x30fd811c0305b0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b0c9 expref: 22 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.960146:0:89061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bff02e00/0x30fd811c0305b0d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b0c9 expref: 22 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.960154:0:89061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969856:0@lo:104: 00000100:00100000:0.0:1780997225.960171:0:89061:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722300 going to sleep for 11 seconds 00010000:00010000:0.0:1780997225.960189:0:89061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455200/0x30fd811c0305b14e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b147 expref: 22 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.960207:0:89061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126968320:0@lo:104: 00010000:00010000:0.0:1780997225.960221:0:89061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b139 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b132 expref: 21 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.960229:0:89061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5688000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126968576:0@lo:104: 00000100:00100000:2.0:1780997225.960411:0:6334:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1780997225.960429:0:6334:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997225.960447:0:6334:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997225.960455:0:6334:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997225.960463:0:6334:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997225.960470:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126968704 00000100:00100000:2.0:1780997225.960475:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126968704 00000100:00100000:2.0:1780997225.960498:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126969216 00000100:00100000:2.0:1780997225.960500:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126969216 00000100:00100000:2.0:1780997225.960510:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126969344 00000100:00100000:2.0:1780997225.960512:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126969344 00000100:00100000:2.0:1780997225.960521:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126969472 00000100:00100000:2.0:1780997225.960523:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126969472 00000100:00100000:2.0:1780997225.960530:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126969600 00000100:00100000:2.0:1780997225.960532:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126969600 00000100:00100000:2.0:1780997225.960540:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126969728 00000100:00100000:2.0:1780997225.960542:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126969728 00000100:00100000:2.0:1780997225.960551:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126969856 00000100:00100000:2.0:1780997225.960553:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126969856 00000100:00100000:2.0:1780997225.960565:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1780997225.960572:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:89061:x1867507126968704:12345-0@lo:104: 00010000:00010000:2.0:1780997225.960597:0:6334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b12b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.960649:0:6334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1780997225.960654:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:89061:x1867507126968704:12345-0@lo:104: Request processed in 84us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997225.960661:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1780997225.960676:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1780997225.960682:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:89061:x1867507126969216:12345-0@lo:104: 00010000:00010000:2.0:1780997225.960690:0:6334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b116 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.960735:0:6334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1780997225.960740:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:89061:x1867507126969216:12345-0@lo:104: Request processed in 59us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997225.960746:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1780997225.960759:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1780997225.960764:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d985850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:89061:x1867507126969344:12345-0@lo:104: 00010000:00010000:2.0:1780997225.960772:0:6334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b108 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.960799:0:6334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1780997225.960803:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d985850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:89061:x1867507126969344:12345-0@lo:104: Request processed in 40us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997225.960809:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1780997225.960840:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1780997225.960846:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:89061:x1867507126969472:12345-0@lo:104: 00010000:00010000:2.0:1780997225.960853:0:6334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b0fa expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.960880:0:6334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1780997225.960884:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:89061:x1867507126969472:12345-0@lo:104: Request processed in 40us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997225.960889:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1780997225.960900:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1780997225.960905:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:89061:x1867507126969600:12345-0@lo:104: 00010000:00010000:2.0:1780997225.960912:0:6334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b0ec expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.960945:0:6334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1780997225.960950:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:89061:x1867507126969600:12345-0@lo:104: Request processed in 45us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997225.960956:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1780997225.960968:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1780997225.960973:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:89061:x1867507126969728:12345-0@lo:104: 00010000:00010000:2.0:1780997225.960980:0:6334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b0de expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961004:0:6334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1780997225.961008:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:89061:x1867507126969728:12345-0@lo:104: Request processed in 36us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997225.961013:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1780997225.961023:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1780997225.961028:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:89061:x1867507126969856:12345-0@lo:104: 00010000:00010000:2.0:1780997225.961034:0:6334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b0d0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961057:0:6334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1780997225.961062:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:89061:x1867507126969856:12345-0@lo:104: Request processed in 34us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997225.961066:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00010000:00010000:2.0:1780997225.961080:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1780997225.961085:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b12b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961099:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455400 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997225.961103:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b12b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961109:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b12b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997225.961115:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b12b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997225.961120:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780997225.961143:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b12b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961148:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997225.961163:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b12b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961168:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b124 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b12b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961179:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1780997225.961181:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b116 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961187:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffde00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997225.961189:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b116 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961204:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b116 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997225.961210:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b116 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997225.961214:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780997225.961225:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b116 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961230:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997225.961236:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b116 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961242:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968889ffde00/0x30fd811c0305b10f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b116 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961249:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1780997225.961252:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b108 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961256:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454800 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997225.961259:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b108 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961264:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b108 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997225.961292:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b108 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997225.961315:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780997225.961330:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b108 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961335:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997225.961345:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b108 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961352:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba454800/0x30fd811c0305b101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b108 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961361:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1780997225.961364:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b0fa expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961368:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980030000 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997225.961371:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b0fa expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961377:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b0fa expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997225.961383:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b0fa expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997225.961388:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780997225.961399:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b0fa expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961404:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997225.961416:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b0fa expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961422:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b0f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b0fa expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961432:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780997225.961434:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b0ec expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961440:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03e00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997225.961442:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b0ec expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961448:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b0ec expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997225.961454:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b0ec expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997225.961459:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780997225.961472:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b0ec expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961477:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997225.961481:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b0ec expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961486:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03e00/0x30fd811c0305b0e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b0ec expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961494:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997225.961503:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b0de expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961508:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454000 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997225.961511:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b0de expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961517:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b0de expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997225.961523:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b0de expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997225.961528:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780997225.961542:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b0de expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961548:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997225.961552:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b0de expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961558:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba454000/0x30fd811c0305b0d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b0de expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961566:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997225.961569:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b0d0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961574:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455c00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997225.961577:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b0d0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961594:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b0d0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997225.961599:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b0d0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997225.961604:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780997225.961617:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b0d0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961622:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997225.961627:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b0d0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961633:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba455c00/0x30fd811c0305b0c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b0d0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997225.961645:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997225.961647:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997225.961648:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997225.961662:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126969984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997225.961693:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997225.961714:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126970496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997225.961735:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997225.961752:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1780997225.961757:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126970112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997225.961776:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997225.961790:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126970624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997225.961818:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997225.961945:0:89061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126968704:0@lo:104: 00000100:00100000:0.0:1780997225.961956:0:89061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5688e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969216:0@lo:104: 00000100:00100000:0.0:1780997225.961963:0:89061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888961a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969344:0@lo:104: 00000100:00100000:0.0:1780997225.961970:0:89061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888961b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969472:0@lo:104: 00000100:00100000:0.0:1780997225.961978:0:89061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889618380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969600:0@lo:104: 00000100:00100000:0.0:1780997225.961984:0:89061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969728:0@lo:104: 00000100:00100000:0.0:1780997225.961991:0:89061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969856:0@lo:104: 00010000:00010000:0.0:1780997225.962824:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997225.963133:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126969984 00000100:00100000:1.0:1780997225.963143:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126969984 00010000:00010000:1.0:1780997225.963181:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bff03400/0x30fd811c0305b12b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b124 expref: 21 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997225.963219:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126970496 00000100:00100000:1.0:1780997225.963222:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126970496 00010000:00010000:1.0:1780997225.963233:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689ba455a00/0x30fd811c0305b0ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b0e5 expref: 22 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997225.963251:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126970112 00000100:00100000:1.0:1780997225.963254:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126970112 00010000:00010000:1.0:1780997225.963264:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bff02a00/0x30fd811c0305b116 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b10f expref: 23 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997225.963305:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126970624 00000100:00100000:1.0:1780997225.963319:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126970624 00010000:00010000:1.0:1780997225.963333:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bff02c00/0x30fd811c0305b0de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b0d7 expref: 24 pid: 88351 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997225.963346:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1780997225.963354:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+24:3496:x1867507126969984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997225.963367:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997225.963371:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bff03400/0x30fd811c0305b12b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b124 expref: 24 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.963380:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bff03400/0x30fd811c0305b12b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b124 expref: 24 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.963395:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03400/0x30fd811c0305b12b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b124 expref: 24 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.963409:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997225.963464:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126969984:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.963472:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1780997225.963488:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:1.0:1780997225.963493:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b620a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3496:x1867507126970496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997225.963501:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997225.963505:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689ba455a00/0x30fd811c0305b0ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b0e5 expref: 22 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.963513:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689ba455a00/0x30fd811c0305b0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b0e5 expref: 22 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.963523:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455a00/0x30fd811c0305b0ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b0e5 expref: 22 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.963539:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997225.963564:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b620a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3496:x1867507126970496:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.963570:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:1.0:1780997225.963610:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:1.0:1780997225.963617:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3496:x1867507126970112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997225.963623:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997225.963627:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bff02a00/0x30fd811c0305b116 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b10f expref: 20 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.963634:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bff02a00/0x30fd811c0305b116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b10f expref: 20 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.963643:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02a00/0x30fd811c0305b116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b10f expref: 20 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.963651:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997225.963672:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3496:x1867507126970112:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.963678:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:1.0:1780997225.963689:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1780997225.963696:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3496:x1867507126970624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997225.963702:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997225.963706:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bff02c00/0x30fd811c0305b0de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b0d7 expref: 18 pid: 88351 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.963713:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bff02c00/0x30fd811c0305b0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b0d7 expref: 18 pid: 88351 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.963730:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02c00/0x30fd811c0305b0de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b0d7 expref: 18 pid: 88351 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.963738:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997225.963760:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:3496:x1867507126970624:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.963767:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1780997225.963795:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126970368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997225.963822:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997225.963850:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1780997225.963856:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126970240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997225.963872:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997225.963883:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126970752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997225.963898:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997225.963912:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126970368 00000100:00100000:1.0:1780997225.963916:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126970368 00010000:00010000:1.0:1780997225.963926:0:6338:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bff02600/0x30fd811c0305b0fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b0f3 expref: 17 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997225.963938:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126970240 00000100:00100000:1.0:1780997225.963940:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126970240 00010000:00010000:1.0:1780997225.963949:0:6338:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968889ffc200/0x30fd811c0305b108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b101 expref: 18 pid: 88344 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997225.963959:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126970752 00000100:00100000:1.0:1780997225.963961:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126970752 00010000:00010000:1.0:1780997225.963969:0:6338:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bff02e00/0x30fd811c0305b0d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b0c9 expref: 19 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997225.963994:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:1.0:1780997225.964000:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3499:x1867507126970368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997225.964008:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997225.964012:0:6338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bff02600/0x30fd811c0305b0fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b0f3 expref: 19 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.964020:0:6338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bff02600/0x30fd811c0305b0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b0f3 expref: 19 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.964029:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02600/0x30fd811c0305b0fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b0f3 expref: 19 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.964037:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997225.964064:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3499:x1867507126970368:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.964070:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:1.0:1780997225.964081:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:1.0:1780997225.964087:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:3499:x1867507126970240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997225.964093:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997225.964096:0:6338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968889ffc200/0x30fd811c0305b108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b101 expref: 17 pid: 88344 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.964103:0:6338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968889ffc200/0x30fd811c0305b108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b101 expref: 17 pid: 88344 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.964111:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffc200/0x30fd811c0305b108 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b101 expref: 17 pid: 88344 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.964128:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997225.964152:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:3499:x1867507126970240:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.964158:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:1.0:1780997225.964170:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:1.0:1780997225.964176:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:3499:x1867507126970752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997225.964183:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997225.964187:0:6338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bff02e00/0x30fd811c0305b0d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b0c9 expref: 15 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.964194:0:6338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bff02e00/0x30fd811c0305b0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b0c9 expref: 15 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.964204:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02e00/0x30fd811c0305b0d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b0c9 expref: 15 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.964212:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997225.964231:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:3499:x1867507126970752:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.964236:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00010000:00010000:1.0:1780997225.964260:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997225.964326:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126970240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997225.964337:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126970752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997225.964344:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126970368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997225.964382:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126970112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997225.964400:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126970624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997225.964407:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126969984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997225.964414:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126970496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997225.964435:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997225.969903:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997225.970009:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997225.970510:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110405504 00000100:00100000:1.0:1780997225.970520:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110405504 00010000:00010000:1.0:1780997225.970560:0:18812:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968980031a00/0x30fd811c0305b140 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d9f expref: 9 pid: 88351 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997225.970605:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110405632 00000100:00100000:1.0:1780997225.970609:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110405632 00010000:00010000:1.0:1780997225.970622:0:18812:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bff03a00/0x30fd811c0305b11d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d98 expref: 10 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997225.970641:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2587 00000100:00100000:1.0:1780997225.970650:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cf5d474c-5b3a-4e23-b534-5ea64925b132+10:2394:x1867507110405504:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780997225.970666:0:18812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997225.970672:0:18812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968980031a00/0x30fd811c0305b140 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d9f expref: 10 pid: 88351 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.970684:0:18812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968980031a00/0x30fd811c0305b140 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d9f expref: 10 pid: 88351 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.970704:0:18812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997225.970757:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cf5d474c-5b3a-4e23-b534-5ea64925b132+10:2394:x1867507110405504:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 109us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.970765:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2587 00000100:00100000:1.0:1780997225.970797:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2588 00000100:00100000:1.0:1780997225.970803:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b620bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110405632:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780997225.970811:0:18812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997225.970815:0:18812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bff03a00/0x30fd811c0305b11d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d98 expref: 9 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.970824:0:18812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bff03a00/0x30fd811c0305b11d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d98 expref: 9 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.970837:0:18812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.970845:0:18812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.970860:0:18812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.970867:0:18812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.970873:0:18812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.970879:0:18812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.971009:0:18812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffcc00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997225.971013:0:18812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.971030:0:18812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.971039:0:18812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997225.971049:0:18812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997225.971069:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b620bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110405632:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 266us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997225.971075:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2588 00010000:00010000:0.0:1780997225.975090:0:89061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968980031a00/0x30fd811c0305b140 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d9f expref: 8 pid: 88351 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.975119:0:89061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126968448:192.168.206.51@tcp:104: 00010000:00010000:0.0:1780997225.975252:0:89061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03a00/0x30fd811c0305b11d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d98 expref: 7 pid: 88346 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997225.975263:0:89061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89061:1867507126969088:192.168.206.51@tcp:104: 00010000:00010000:0.0:1780997225.975779:0:89061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.975815:0:89061:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.975822:0:89061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997225.975828:0:89061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b155 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997226.213628:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997227.237575:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997227.267399:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997227.267784:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110405760 00000100:00100000:0.0:1780997227.267795:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110405760 00000100:00100000:0.0:1780997227.267864:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:0.0:1780997227.267875:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70253:x1867507110405760:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997227.267891:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997227.267910:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b15c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8da6 expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.267937:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b15c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8da6 expref: 8 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.267947:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b15c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8da6 expref: 8 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.267956:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffcc00, rc 0) 00000100:00100000:0.0:1780997227.268035:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110405760:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 162us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.268042:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:1.0:1780997227.269636:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997227.269756:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110405888 00000100:00100000:0.0:1780997227.269764:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110405888 00000100:00100000:0.0:1780997227.269810:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:0.0:1780997227.269820:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110405888:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.269965:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110405888:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 146us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.269974:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:1.0:1780997227.273209:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997227.273361:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110406016 00000100:00100000:0.0:1780997227.273371:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110406016 00000100:00100000:0.0:1780997227.273427:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 132 00000100:00100000:0.0:1780997227.273436:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110406016:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.273733:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110406016:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 296us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.273741:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 132 00000100:00100000:1.0:1780997227.285761:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997227.286077:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110406144 00000100:00100000:0.0:1780997227.286088:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110406144 00000100:00100000:0.0:1780997227.286147:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00100000:0.0:1780997227.286156:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:71241:x1867507110406144:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1780997227.286375:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:71241:x1867507110406144:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 219us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.286383:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00100000:1.0:1780997227.299561:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997227.301630:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110406272 00000100:00100000:2.0:1780997227.301645:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110406272 00000100:00100000:2.0:1780997227.301723:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:2.0:1780997227.301733:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:71241:x1867507110406272:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1780997227.301898:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:71241:x1867507110406272:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 166us (2344us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.301907:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:1.0:1780997227.308027:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997227.308311:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110406400 00000100:00100000:0.0:1780997227.308321:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110406400 00000100:00100000:0.0:1780997227.308375:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:0.0:1780997227.308385:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110406400:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997227.308417:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997227.308433:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968889ffd800/0x30fd811c0305b163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8dad expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.308460:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffd800/0x30fd811c0305b163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dad expref: 9 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.308471:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968889ffd800/0x30fd811c0305b163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dad expref: 9 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.308479:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffd800, rc 0) 00000100:00100000:0.0:1780997227.308536:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110406400:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 153us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.308544:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:1.0:1780997227.314013:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997227.317395:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110406528 00000100:00100000:0.0:1780997227.317409:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110406528 00000100:00100000:0.0:1780997227.317480:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:0.0:1780997227.317490:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110406528:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.317619:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110406528:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 129us (3614us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780997227.317627:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 136 10000000:01000000:1.0:1780997227.813399:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780997227.813409:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689a5870800 from 55 10000000:01000000:1.0:1780997227.813415:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780997227.813469:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.813481:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.813491:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997227.813520:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126970880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.813606:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997227.813662:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.813933:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126970880 00000100:00100000:2.0:1780997227.813942:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126970880 00000100:00100000:2.0:1780997227.814002:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1780997227.814012:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507126970880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997227.814025:0:88345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997227.814039:0:88345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b171 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b16a expref: -99 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.814063:0:88345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b16a expref: 15 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.814073:0:88345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b16a expref: 15 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.814081:0:88345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455c00, rc 0) 00000100:00100000:2.0:1780997227.814129:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126970880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.814143:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1780997227.814317:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126970880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997227.814333:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.814341:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997227.814403:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126971008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.814430:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997227.814457:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780997227.814510:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126971008 00000100:00100000:0.0:1780997227.814515:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126971008 00000100:00100000:0.0:1780997227.814549:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1780997227.814557:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adf26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126971008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.814691:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adf26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126971008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.814704:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1780997227.814884:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126971008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.814909:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126971136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.814943:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997227.814964:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.815011:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126971136 00000100:00100000:2.0:1780997227.815014:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126971136 00000100:00100000:2.0:1780997227.815044:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1780997227.815050:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126971136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997227.815121:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126971136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.815127:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1780997227.815200:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126971136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.815748:0:89063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89063:1867507126971264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997227.815786:0:89063:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.815816:0:89063:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722900 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.816691:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126971264 00000100:00100000:2.0:1780997227.816700:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126971264 00000100:00100000:2.0:1780997227.816751:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1780997227.816759:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:89063:x1867507126971264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997227.816898:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:89063:x1867507126971264:12345-0@lo:502:llog_process_th.0 Request processed in 139us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.816905:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1780997227.817088:0:89063:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89063:1867507126971264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997227.817144:0:89063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89063:1867507126971392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997227.817184:0:89063:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.817219:0:89063:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f480 going to sleep for 11 seconds 00000100:00100000:3.0:1780997227.817305:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126971392 00000100:00100000:3.0:1780997227.817310:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126971392 00000100:00100000:3.0:1780997227.817342:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1780997227.817349:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:89063:x1867507126971392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997227.817430:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:89063:x1867507126971392:12345-0@lo:502:llog_process_th.0 Request processed in 81us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997227.817436:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1780997227.817621:0:89063:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89063:1867507126971392:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1780997227.817641:0:89063:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1780997227.820399:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1780997227.820436:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780997227.820448:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.820461:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997227.820473:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1780997227.822625:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:1.0:1780997227.822631:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1780997227.822676:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.822687:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.822698:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997227.822726:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126971520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.822793:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997227.822841:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.822950:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126971520 00000100:00100000:2.0:1780997227.822959:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126971520 00000100:00100000:2.0:1780997227.823012:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1780997227.823021:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507126971520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997227.823034:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997227.823047:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba454000/0x30fd811c0305b17f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b178 expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.823071:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454000/0x30fd811c0305b17f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b178 expref: 16 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.823092:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba454000/0x30fd811c0305b17f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b178 expref: 16 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.823102:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454000, rc 0) 00000100:00100000:2.0:1780997227.823158:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126971520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.823165:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1780997227.823385:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126971520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997227.823410:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997227.823419:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997227.823491:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126971648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997227.823521:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997227.823551:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc784d80 going to sleep for 11 seconds 00000100:00100000:1.0:1780997227.823614:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126971648 00000100:00100000:1.0:1780997227.823619:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126971648 00000100:00100000:1.0:1780997227.823652:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1780997227.823659:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126971648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.823772:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126971648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997227.823778:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1780997227.823927:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126971648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997227.823955:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126971776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997227.823991:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997227.824012:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc784d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.824051:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126971776 00000100:00100000:2.0:1780997227.824056:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126971776 00000100:00100000:2.0:1780997227.824083:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1780997227.824089:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126971776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997227.824177:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126971776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.824183:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1780997227.824251:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126971776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997227.824741:0:89064:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89064:1867507126971904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997227.824777:0:89064:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997227.824808:0:89064:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc784cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.824852:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126971904 00000100:00100000:2.0:1780997227.824857:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126971904 00000100:00100000:2.0:1780997227.824890:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1780997227.824898:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:89064:x1867507126971904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997227.824980:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:89064:x1867507126971904:12345-0@lo:502:llog_process_th.0 Request processed in 82us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.824986:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1780997227.825114:0:89064:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89064:1867507126971904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780997227.825136:0:89064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997227.825147:0:89064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997227.825149:0:89064:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1780997227.825154:0:89064:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1780997227.825168:0:89064:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1780997227.825962:0:89064:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89064:1867507126972032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997227.826009:0:89064:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997227.826049:0:89064:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc9dd480 going to sleep for 11 seconds 00000020:01000004:3.0:1780997227.826120:0:89065:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689a5870800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1780997227.826124:0:89065:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689a5870800 4 00000100:00100000:1.0:1780997227.826323:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126972032 00000100:00100000:1.0:1780997227.826330:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126972032 00000100:00100000:1.0:1780997227.826359:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1780997227.826366:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:89064:x1867507126972032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997227.826454:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:89064:x1867507126972032:12345-0@lo:502:llog_process_th.0 Request processed in 89us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997227.826461:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1780997227.826746:0:89064:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89064:1867507126972032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780997227.826777:0:89064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997227.826782:0:89064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997227.826784:0:89064:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1780997227.826788:0:89064:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:3.0:1780997227.826945:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:3.0:1780997227.826970:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1780997227.826979:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997227.826989:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997227.826998:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1780997227.827000:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968886f5e000 from 55 10000000:01000000:3.0:1780997227.827003:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780997227.827027:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968980031000/0x30fd811c0305b186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997227.827034:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968980031000/0x30fd811c0305b186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997227.827042:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968980031000/0x30fd811c0305b186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997227.827057:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126972160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997227.827088:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997227.827117:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc784540 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.827159:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126972160 00000100:00100000:2.0:1780997227.827164:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126972160 00000100:00100000:2.0:1780997227.827187:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1780997227.827194:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507126972160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997227.827203:0:88346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997227.827215:0:88346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba454800/0x30fd811c0305b18d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b186 expref: -99 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.827237:0:88346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454800/0x30fd811c0305b18d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b186 expref: 17 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.827247:0:88346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba454800/0x30fd811c0305b18d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b186 expref: 17 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.827255:0:88346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454800, rc 0) 00000100:00100000:2.0:1780997227.827360:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126972160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.827365:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1780997227.827432:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126972160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997227.827444:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968980031000/0x30fd811c0305b186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b18d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.827452:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968980031000/0x30fd811c0305b186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b18d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997227.827510:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126972288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.827536:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.827560:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688887226c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.827839:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126972288 00000100:00100000:2.0:1780997227.827844:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126972288 00000100:00100000:2.0:1780997227.827876:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1780997227.827883:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126972288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997227.827977:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126972288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.827994:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1780997227.828796:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126972288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.828839:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126972416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.828884:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.828912:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688887226c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.829045:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126972416 00000100:00100000:2.0:1780997227.829050:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126972416 00000100:00100000:2.0:1780997227.829085:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1780997227.829092:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126972416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997227.829171:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126972416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.829179:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1780997227.829575:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126972416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.845743:0:89066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89066:1867507126972544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997227.846124:0:89066:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.846335:0:89066:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722900 going to sleep for 11 seconds 00000100:00100000:1.0:1780997227.847122:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126972544 00000100:00100000:1.0:1780997227.847133:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126972544 00000100:00100000:1.0:1780997227.847542:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1780997227.847554:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:89066:x1867507126972544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997227.847732:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:89066:x1867507126972544:12345-0@lo:502:llog_process_th.0 Request processed in 181us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997227.847740:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1780997227.847833:0:89066:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89066:1867507126972544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997227.847904:0:89066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89066:1867507126972672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997227.847959:0:89066:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997227.848724:0:89066:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888722900 going to sleep for 11 seconds 00000100:00100000:0.0:1780997227.848816:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126972672 00000100:00100000:0.0:1780997227.848822:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126972672 00000100:00100000:0.0:1780997227.848864:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1780997227.848880:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:89066:x1867507126972672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997227.849407:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:89066:x1867507126972672:12345-0@lo:502:llog_process_th.0 Request processed in 533us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.849416:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1780997227.849505:0:89066:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89066:1867507126972672:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1780997227.849532:0:89066:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1780997227.849973:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1780997227.849996:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780997227.850006:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968980031000/0x30fd811c0305b186 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b18d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.850017:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968980031000/0x30fd811c0305b186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b18d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997227.850027:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1780997227.850029:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:0.0:1780997227.850032:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1780997227.850409:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffca00/0x30fd811c0305b194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.850419:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968889ffca00/0x30fd811c0305b194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.850428:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968889ffca00/0x30fd811c0305b194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997227.850459:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126972800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.850507:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.850542:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.850649:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126972800 00000100:00100000:2.0:1780997227.850656:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126972800 00000100:00100000:2.0:1780997227.850694:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1780997227.850702:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507126972800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997227.850713:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997227.850726:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455400/0x30fd811c0305b19b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b194 expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.850749:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455400/0x30fd811c0305b19b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b194 expref: 18 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.850772:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455400/0x30fd811c0305b19b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b194 expref: 18 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.850780:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455400, rc 0) 00000100:00100000:2.0:1780997227.850818:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126972800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.850825:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1780997227.851327:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126972800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997227.851343:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968889ffca00/0x30fd811c0305b194 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b19b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.851353:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968889ffca00/0x30fd811c0305b194 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b19b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997227.851411:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126972928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.851441:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.851463:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997227.851478:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126972928 00000100:00100000:0.0:1780997227.851482:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126972928 00000100:00100000:0.0:1780997227.851515:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1780997227.851521:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126972928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.851636:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126972928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.851642:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1780997227.851672:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126972928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.851698:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126973056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.851737:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.851750:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997227.851767:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126973056 00000100:00100000:0.0:1780997227.851771:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126973056 00000100:00100000:0.0:1780997227.851786:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1780997227.851792:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126973056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.851870:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126973056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.851888:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1780997227.851926:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126973056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.853542:0:89067:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89067:1867507126973184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997227.853618:0:89067:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.853658:0:89067:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997227.853774:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126973184 00000100:00100000:1.0:1780997227.853780:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126973184 00000100:00100000:1.0:1780997227.853824:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1780997227.853832:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:89067:x1867507126973184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997227.853973:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:89067:x1867507126973184:12345-0@lo:502:llog_process_th.0 Request processed in 142us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997227.853980:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1780997227.854759:0:89067:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89067:1867507126973184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780997227.854800:0:89067:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780997227.854814:0:89067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997227.854816:0:89067:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1780997227.854823:0:89067:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1780997227.854839:0:89067:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:0.0:1780997227.854864:0:89067:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89067:1867507126973312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997227.855263:0:89067:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.855328:0:89067:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885e41b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997227.855431:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126973312 00000100:00100000:1.0:1780997227.855437:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126973312 00000100:00100000:1.0:1780997227.855481:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1780997227.855489:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:89067:x1867507126973312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997227.855595:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:89067:x1867507126973312:12345-0@lo:502:llog_process_th.0 Request processed in 106us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997227.855602:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1780997227.855734:0:89067:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89067:1867507126973312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780997227.855757:0:89067:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997227.855762:0:89067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997227.855764:0:89067:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1780997227.855768:0:89067:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:1.0:1780997227.861497:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:1.0:1780997227.861541:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1780997227.861553:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffca00/0x30fd811c0305b194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b19b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.861576:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968889ffca00/0x30fd811c0305b194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b19b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997227.861606:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780997227.861609:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689bfa99000 from 55 10000000:01000000:1.0:1780997227.861611:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780997227.861649:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b1a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.861657:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b1a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.861667:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b1a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997227.861695:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126973440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.861760:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997227.861817:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034840 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.861888:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126973440 00000100:00100000:2.0:1780997227.861895:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126973440 00000100:00100000:2.0:1780997227.861957:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1780997227.861967:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507126973440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997227.861981:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997227.861995:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455600/0x30fd811c0305b1a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b1a2 expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.862018:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455600/0x30fd811c0305b1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b1a2 expref: 19 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.862028:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455600/0x30fd811c0305b1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b1a2 expref: 19 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.862036:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455600, rc 0) 00000100:00100000:2.0:1780997227.862097:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126973440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.862103:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1780997227.863360:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126973440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997227.863383:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b1a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1a9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.863393:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b1a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b1a9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997227.863466:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126973568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.863511:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997227.863538:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034840 going to sleep for 11 seconds 00000100:00100000:1.0:1780997227.863559:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126973568 00000100:00100000:1.0:1780997227.865307:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126973568 00000100:00100000:1.0:1780997227.865384:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1780997227.865393:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126973568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.865555:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126973568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (2042us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997227.865575:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1780997227.865632:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126973568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.865677:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126973696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.865723:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997227.865741:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034840 going to sleep for 11 seconds 00000100:00100000:1.0:1780997227.865754:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126973696 00000100:00100000:1.0:1780997227.865759:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126973696 00000100:00100000:1.0:1780997227.865781:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1780997227.865788:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126973696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.865858:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126973696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997227.865864:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1780997227.865910:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126973696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.867055:0:89068:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89068:1867507126973824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997227.867131:0:89068:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.867180:0:89068:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885e41240 going to sleep for 11 seconds 00000100:00100000:1.0:1780997227.867407:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126973824 00000100:00100000:1.0:1780997227.867413:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126973824 00000100:00100000:1.0:1780997227.867453:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1780997227.867460:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688868e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:89068:x1867507126973824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997227.867648:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688868e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:89068:x1867507126973824:12345-0@lo:502:llog_process_th.0 Request processed in 188us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997227.867656:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1780997227.878383:0:89068:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89068:1867507126973824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997227.878557:0:89068:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89068:1867507126973952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997227.880727:0:89068:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997227.880787:0:89068:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986958480 going to sleep for 11 seconds 00000100:00100000:0.0:1780997227.881004:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126973952 00000100:00100000:0.0:1780997227.881013:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126973952 00000100:00100000:0.0:1780997227.881077:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1780997227.881095:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:89068:x1867507126973952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997227.881375:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:89068:x1867507126973952:12345-0@lo:502:llog_process_th.0 Request processed in 281us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.881383:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1780997227.882005:0:89068:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89068:1867507126973952:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1780997227.882662:0:89068:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1780997227.890138:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1780997227.890204:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780997227.890218:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b1a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1a9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.890231:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1a9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997227.890241:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1780997227.890244:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1780997227.890247:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1780997227.890681:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b1b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.890692:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b1b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.890703:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b1b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997227.890730:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126974080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.890801:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997227.891103:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f000 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.895476:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126974080 00000100:00100000:2.0:1780997227.895489:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126974080 00000100:00100000:2.0:1780997227.895551:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1780997227.895562:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507126974080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997227.895577:0:88344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997227.895594:0:88344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455e00/0x30fd811c0305b1b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b1b0 expref: -99 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.895620:0:88344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455e00/0x30fd811c0305b1b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b1b0 expref: 20 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.895630:0:88344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455e00/0x30fd811c0305b1b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b1b0 expref: 20 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.895639:0:88344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455e00, rc 0) 00000100:00100000:2.0:1780997227.895718:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126974080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (4916us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.895725:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1780997227.897800:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126974080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997227.897825:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b1b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1b7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.897837:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b1b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b1b7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997227.897919:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126974208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.897991:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997227.898032:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f000 going to sleep for 11 seconds 00000100:00100000:0.0:1780997227.898155:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126974208 00000100:00100000:0.0:1780997227.898162:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126974208 00000100:00100000:0.0:1780997227.898206:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1780997227.898216:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126974208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.898377:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126974208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.898385:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1780997227.899445:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126974208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997227.899491:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126974336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997227.899551:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997227.899590:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986958900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997227.899709:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126974336 00000100:00100000:3.0:1780997227.899716:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126974336 00000100:00100000:3.0:1780997227.899759:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1780997227.899767:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126974336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997227.899880:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126974336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997227.899887:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1780997227.900682:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126974336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997227.902999:0:89069:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1780997227.914644:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1780997227.914686:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1780997227.914699:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b1b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1b7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.914712:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b1b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1b7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997227.914993:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1780997227.914997:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968990f90000 from 55 10000000:01000000:3.0:1780997227.915001:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780997227.915054:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b1be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997227.915062:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b1be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997227.915073:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b1be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997227.915098:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126974464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997227.915183:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997227.915227:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc784d80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997227.915308:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126974464 00000100:00100000:0.0:1780997227.915316:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126974464 00000100:00100000:0.0:1780997227.915362:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1780997227.915371:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688891c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507126974464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997227.915384:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997227.915397:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968889ffc400/0x30fd811c0305b1c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b1be expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.915421:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffc400/0x30fd811c0305b1c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b1be expref: 21 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.915433:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968889ffc400/0x30fd811c0305b1c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b1be expref: 21 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.915462:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffc400, rc 0) 00000100:00100000:0.0:1780997227.915511:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688891c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126974464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.915518:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1780997227.915718:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126974464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997227.915732:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b1be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1c5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.915740:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b1be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b1c5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997227.915798:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126974592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.915850:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997227.915877:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997227.915986:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126974592 00000100:00100000:0.0:1780997227.915992:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126974592 00000100:00100000:0.0:1780997227.916018:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1780997227.916025:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126974592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.916152:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126974592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.916158:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1780997227.916327:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126974592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.916355:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126974720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.916397:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997227.916419:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997227.916546:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126974720 00000100:00100000:0.0:1780997227.916550:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126974720 00000100:00100000:0.0:1780997227.916571:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1780997227.916577:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126974720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.916647:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126974720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.916653:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1780997227.916731:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126974720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997227.917530:0:89070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89070:1867507126974848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997227.917598:0:89070:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997227.917628:0:89070:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc784d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.917849:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126974848 00000100:00100000:2.0:1780997227.917855:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126974848 00000100:00100000:2.0:1780997227.918394:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1780997227.918405:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:89070:x1867507126974848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997227.918513:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:89070:x1867507126974848:12345-0@lo:502:llog_process_th.0 Request processed in 111us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.918520:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1780997227.918765:0:89070:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89070:1867507126974848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997227.918827:0:89070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89070:1867507126974976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997227.918861:0:89070:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997227.918896:0:89070:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99480 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.919217:0:88346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126974976 00000100:00100000:2.0:1780997227.919223:0:88346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126974976 00000100:00100000:2.0:1780997227.919261:0:88346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1780997227.919407:0:88346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:89070:x1867507126974976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997227.923745:0:88346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:89070:x1867507126974976:12345-0@lo:502:llog_process_th.0 Request processed in 4467us (4873us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.923761:0:88346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1780997227.924460:0:89070:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1123480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:89070:1867507126974976:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780997227.924507:0:89070:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1780997227.925305:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1780997227.925333:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780997227.925344:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b1be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1c5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.925375:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b1be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1c5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997227.925386:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1780997227.925389:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1780997227.925392:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1780997227.925430:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffc200/0x30fd811c0305b1cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.925437:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968889ffc200/0x30fd811c0305b1cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.925448:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968889ffc200/0x30fd811c0305b1cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997227.925472:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126975104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.925552:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.925706:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885e41300 going to sleep for 11 seconds 00000100:00100000:2.0:1780997227.927116:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126975104 00000100:00100000:2.0:1780997227.927127:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126975104 00000100:00100000:3.0:1780997227.934482:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1780997227.934497:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507126975104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997227.934515:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997227.934547:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968980031a00/0x30fd811c0305b1d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b1cc expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997227.934582:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968980031a00/0x30fd811c0305b1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b1cc expref: 22 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997227.934594:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968980031a00/0x30fd811c0305b1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b1cc expref: 22 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997227.934611:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968980031a00, rc 0) 00000100:00100000:3.0:1780997227.934688:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126975104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (9135us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997227.934694:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1780997227.934862:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126975104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997227.934894:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968889ffc200/0x30fd811c0305b1cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1d3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997227.934905:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968889ffc200/0x30fd811c0305b1cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b1d3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997227.934993:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126975232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.935056:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.935101:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885e41300 going to sleep for 11 seconds 00000100:00100000:1.0:1780997227.935317:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126975232 00000100:00100000:1.0:1780997227.935324:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126975232 00000100:00100000:1.0:1780997227.935358:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1780997227.935368:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126975232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.935483:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126975232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997227.935490:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1780997227.935671:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126975232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.935701:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126975360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997227.935741:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.935766:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885e41300 going to sleep for 11 seconds 00000100:00100000:1.0:1780997227.935992:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126975360 00000100:00100000:1.0:1780997227.936004:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126975360 00000100:00100000:1.0:1780997227.936045:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1780997227.936052:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126975360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.936139:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126975360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997227.936146:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1780997227.936401:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126975360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997227.937561:0:89071:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1780997227.937770:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1780997227.937791:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1780997227.937800:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffc200/0x30fd811c0305b1cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1d3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.937812:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968889ffc200/0x30fd811c0305b1cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1d3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997227.937821:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1780997227.937823:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9689b6283380 from 1 10000000:01000000:1.0:1780997227.937826:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1780997227.937857:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b1da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.937864:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b1da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997227.937883:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b1da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997227.937904:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126975488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997227.937954:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997227.938003:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034000 going to sleep for 11 seconds 00000100:00100000:3.0:1780997227.938223:0:88351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126975488 00000100:00100000:3.0:1780997227.938231:0:88351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126975488 00000100:00100000:3.0:1780997227.938302:0:88351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1780997227.938311:0:88351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507126975488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997227.938324:0:88351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997227.938338:0:88351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968980031600/0x30fd811c0305b1e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b1da expref: -99 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997227.938360:0:88351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968980031600/0x30fd811c0305b1e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b1da expref: 23 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997227.938371:0:88351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968980031600/0x30fd811c0305b1e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b1da expref: 23 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997227.938380:0:88351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968980031600, rc 0) 00000100:00100000:3.0:1780997227.938430:0:88351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126975488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997227.938446:0:88351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1780997227.938536:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126975488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997227.938550:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b1da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1e1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.938576:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b1da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b1e1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997227.938634:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126975616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997227.938679:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997227.938712:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986958a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997227.938815:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126975616 00000100:00100000:3.0:1780997227.938820:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126975616 00000100:00100000:3.0:1780997227.938851:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1780997227.938859:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126975616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997227.938937:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507126975616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (257us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780997227.938943:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1780997227.939093:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507126975616:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1780997227.939123:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1780997227.939129:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b1da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1e1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997227.939136:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b1da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b1e1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997227.943135:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997227.943158:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126975872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997227.943232:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997227.943310:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126975872 00000100:00100000:0.0:1780997227.943317:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126975872 00000100:00100000:0.0:1780997227.943370:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1780997227.943381:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126975872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997227.943407:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997227.943451:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126975872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997227.943458:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1780997227.943507:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b78dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126975872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997227.943596:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126975744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997227.943626:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997227.943657:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126975744 00000100:00100000:2.0:1780997227.943661:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126975744 00000100:00100000:2.0:1780997227.943685:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:2.0:1780997227.943691:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126975744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780997227.943708:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997227.943739:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126975744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997227.943744:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:2.0:1780997227.943773:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126975744:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1780997227.943970:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997227.943975:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1780997228.261721:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997229.193704:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997229.193783:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110406656 00000100:00100000:3.0:1780997229.193792:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110406656 00000100:00100000:3.0:1780997229.193867:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1374 00000100:00100000:3.0:1780997229.193877:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:71261:x1867507110406656:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:3.0:1780997229.193898:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997229.193918:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968980030000/0x30fd811c0305b1e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8db4 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.193997:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b1ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.194011:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b1ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.194025:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b1ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997229.194073:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1780997229.194089:0:80049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780997229.194130:0:80049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b1ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.194156:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968980030000/0x30fd811c0305b1e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8db4 expref: 8 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.194175:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b1ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8db4 expref: 7 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.194183:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:3.0:1780997229.194187:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780997229.194191:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689c2055e00, rc 0) 00000100:00100000:3.0:1780997229.194243:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71261:x1867507110406656:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 368us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.194251:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1374 00000100:00080000:0.0:1780997229.194342:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997229.207901:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997229.207971:0:88282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110406784 00000100:00100000:3.0:1780997229.207981:0:88282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110406784 00000100:00100000:3.0:1780997229.208031:0:88282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:3.0:1780997229.208041:0:88282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71261:x1867507110406784:12345-192.168.206.51@tcp:700:mkdir.0 00000100:00100000:3.0:1780997229.208128:0:88282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71261:x1867507110406784:12345-192.168.206.51@tcp:700:mkdir.0 Request processed in 88us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.208136:0:88282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1780997229.215035:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997229.215115:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110407040 00000100:00100000:3.0:1780997229.215125:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110407040 00000100:00100000:3.0:1780997229.215182:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1375 00000100:00100000:3.0:1780997229.215192:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71261:x1867507110407040:12345-192.168.206.51@tcp:36:mkdir.0 00010000:00010000:3.0:1780997229.215246:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997229.215319:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b1ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8db4 expref: 7 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.215340:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:3.0:1780997229.215345:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997229.215411:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b1f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.215425:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b1f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.215434:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b1f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.215448:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054e00/0x30fd811c0305b1fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.215455:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054e00/0x30fd811c0305b1fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.215474:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054e00/0x30fd811c0305b1fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216499:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216514:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216523:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997229.216539:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000895220f7 reply state 00000000fa919f81 transno 115964116996 ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216563:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216569:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689836c9a00) 00010000:00010000:3.0:1780997229.216572:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997229.216575:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1780997229.216581:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1780997229.216589:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b1f6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216596:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b1f6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216602:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b1f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216609:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b1f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216615:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997229.216619:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b1f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216626:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b1f6 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216634:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:3.0:1780997229.216636:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997229.216640:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b1f6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216655:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b1f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997229.216667:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000895220f7 reply state 00000000fa919f81 transno 115964116996 ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054e00/0x30fd811c0305b1fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216676:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054e00/0x30fd811c0305b1fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.216682:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9689836c9f00) 00010000:00010000:3.0:1780997229.216684:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997229.216686:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1780997229.216776:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:71261:x1867507110407040:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 1582us (1748us total) trans 115964116996 rc 0/0 00000100:00100000:3.0:1780997229.216784:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1375 00000100:00100000:0.0:1780997229.218486:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997229.221086:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110407168 00000100:00100000:1.0:1780997229.221101:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110407168 00000100:00100000:0.0:1780997229.221511:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1376 00000100:00100000:0.0:1780997229.221523:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:71261:x1867507110407168:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:0.0:1780997229.221545:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997229.221564:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305b20b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8dbb expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.221642:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b212 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.221656:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b212 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.221667:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b212 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997229.221708:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780997229.221712:0:63419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997229.221731:0:63419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b212 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.221756:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305b20b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dbb expref: 10 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.221771:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b212 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dbb expref: 9 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.221778:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:0.0:1780997229.221781:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780997229.221785:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffc800, rc 0) 00000100:00100000:0.0:1780997229.221841:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71261:x1867507110407168:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 321us (3361us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997229.221848:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1376 00000100:00100000:1.0:1780997229.224292:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997229.224352:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110407424 00000100:00100000:3.0:1780997229.224360:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110407424 00000100:00100000:3.0:1780997229.224406:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1377 00000100:00100000:3.0:1780997229.224416:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71261:x1867507110407424:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:3.0:1780997229.224433:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997229.224451:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8dc2 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224510:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b220 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224520:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b220 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224536:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b220 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224544:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054800/0x30fd811c0305b227 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224548:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054800/0x30fd811c0305b227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224552:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054800/0x30fd811c0305b227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997229.224681:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1780997229.224736:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b220 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224741:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b220 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224745:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b220 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224749:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2055e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997229.224751:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b220 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224756:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b220 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224763:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:3.0:1780997229.224765:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997229.224773:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b220 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224777:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2055e00/0x30fd811c0305b220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224786:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054800/0x30fd811c0305b227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224790:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054800/0x30fd811c0305b227 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224794:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054800/0x30fd811c0305b227 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224796:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997229.224798:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054800/0x30fd811c0305b227 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224801:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054800/0x30fd811c0305b227 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224805:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9689836c9f00) 00010000:00010000:3.0:1780997229.224806:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997229.224808:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054800/0x30fd811c0305b227 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224811:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054800/0x30fd811c0305b227 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224832:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b219 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dc2 expref: 11 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224846:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:3.0:1780997229.224847:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1780997229.224849:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dc2 expref: 11 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.224856:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689c2054400, rc 0) 00000100:00100000:3.0:1780997229.224985:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71261:x1867507110407424:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 571us (723us total) trans 115964116997 rc 301/301 00000100:00100000:3.0:1780997229.224994:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1377 00000100:00100000:0.0:1780997229.226841:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997229.226968:0:63429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110407552 00000100:00100000:3.0:1780997229.226978:0:63429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110407552 00000100:00100000:3.0:1780997229.227081:0:63429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1780997229.227090:0:63429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:71261:x1867507110407552:12345-192.168.206.51@tcp:900:mkdir.0 00000100:00100000:3.0:1780997229.227163:0:63429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:71261:x1867507110407552:12345-192.168.206.51@tcp:900:mkdir.0 Request processed in 74us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.227170:0:63429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00080000:0.0:1780997229.227749:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997229.228840:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997229.228894:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110407808 00000100:00100000:1.0:1780997229.228906:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110407808 00000100:00100000:1.0:1780997229.228960:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 238 00000100:00100000:1.0:1780997229.228969:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71261:x1867507110407808:12345-192.168.206.51@tcp:35:mkdir.0 00000100:00100000:1.0:1780997229.229189:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:71261:x1867507110407808:12345-192.168.206.51@tcp:35:mkdir.0 Request processed in 221us (352us total) trans 115964116998 rc 0/0 00000100:00100000:1.0:1780997229.229196:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 238 00000100:00100000:3.0:1780997229.230928:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997229.230996:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110408064 00000100:00100000:0.0:1780997229.231003:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110408064 00000100:00100000:0.0:1780997229.231124:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1378 00000100:00100000:0.0:1780997229.231133:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:71261:x1867507110408064:12345-192.168.206.51@tcp:36:mkdir.0 00000100:00100000:0.0:1780997229.231251:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888961a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976000:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780997229.231636:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997229.231698:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997229.231730:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126976000 00000100:00100000:1.0:1780997229.231734:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126976000 00000100:00100000:1.0:1780997229.231781:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4051 00000100:00100000:1.0:1780997229.231787:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63418:x1867507126976000:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.231852:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63418:x1867507126976000:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.231857:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4051 00000100:00100000:3.0:1780997229.231927:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888961a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976000:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1780997229.231993:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888961a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976128:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1780997229.232034:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.232294:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc784300 going to sleep for 11 seconds 00000100:00100000:0.0:1780997229.232363:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126976128 00000100:00100000:0.0:1780997229.232368:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126976128 00000100:00100000:0.0:1780997229.232391:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4052 00000100:00100000:0.0:1780997229.232397:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63418:x1867507126976128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780997229.232460:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63418:x1867507126976128:12345-0@lo:1000:mdt00_001.0 Request processed in 63us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997229.232465:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4052 00000100:00100000:0.0:1780997229.232491:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888961a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976128:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780997229.232524:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888961a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976256:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780997229.232543:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997229.232554:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc784d80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997229.232563:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126976256 00000100:00100000:0.0:1780997229.232566:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126976256 00000100:00100000:0.0:1780997229.232584:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4053 00000100:00100000:0.0:1780997229.232589:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63418:x1867507126976256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780997229.232653:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63418:x1867507126976256:12345-0@lo:1000:mdt00_001.0 Request processed in 62us (107us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780997229.232660:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4053 00000100:00100000:0.0:1780997229.232708:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888961a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976256:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1780997229.232758:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.232768:0:63418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.232779:0:63418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997229.232787:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6797480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976384:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1780997229.232804:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997229.232813:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1780997229.232821:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126976384 00000100:00100000:0.0:1780997229.232823:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126976384 00000100:00100000:0.0:1780997229.232840:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4054 00000100:00100000:0.0:1780997229.232846:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63418:x1867507126976384:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1780997229.232852:0:8242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997229.232865:0:8242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b23c lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b235 expref: -99 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.232897:0:8242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 2/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.232907:0:8242:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b23c lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b235 expref: 9 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.232922:0:8242:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1780997229.232962:0:8242:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1780997229.232999:0:8242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b23c lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b235 expref: 9 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.233008:0:8242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689836c9a00) 00010000:00010000:0.0:1780997229.233011:0:8242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997229.233015:0:8242:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b23c lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b235 expref: 9 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.233032:0:8242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffd400, rc 0) 00000100:00100000:0.0:1780997229.233058:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126976384:12345-0@lo:101:mdt00_001.0 Request processed in 212us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997229.233064:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4054 00000100:00100000:0.0:1780997229.233089:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6797480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976384:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1780997229.233100:0:63418:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.233108:0:63418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780997229.234781:0:88340:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116998 is committed 00000001:00080000:1.0:1780997229.234807:0:88340:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116995 is committed 00010000:00010000:3.0:1780997229.234843:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054e00/0x30fd811c0305b1fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.234852:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054e00/0x30fd811c0305b1fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.234864:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054e00/0x30fd811c0305b1fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.234868:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997229.234870:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054e00/0x30fd811c0305b1fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.234875:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054e00/0x30fd811c0305b1fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.234947:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9689836c9f00) 00010000:00010000:3.0:1780997229.234951:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997229.234956:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054e00/0x30fd811c0305b1fd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.234963:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054e00/0x30fd811c0305b1fd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.234981:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.234988:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.234994:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.234999:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997229.235001:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.235019:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.235086:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689836c9a00) 00010000:00010000:3.0:1780997229.235089:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997229.235095:0:3482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b23c lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b235 expref: 7 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.235105:0:3482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b23c lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x30fd811c0305b235 expref: 7 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.235114:0:3482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b23c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x30fd811c0305b235 expref: 7 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.235151:0:3482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b23c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b235 expref: 7 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997229.235163:0:3482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3482:1867507126976512:0@lo:105: 00000100:00100000:3.0:1780997229.235213:0:3482:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.235307:0:3482:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1780997229.235356:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126976512 00000100:00100000:0.0:1780997229.235363:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126976512 00000100:00100000:0.0:1780997229.235432:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1780997229.235440:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3482:x1867507126976512:12345-0@lo:105: 00010000:00010000:0.0:1780997229.235450:0:6334:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.235468:0:6334:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.235477:0:6334:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.235483:0:6334:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.235489:0:6334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.235497:0:6334:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.235543:0:6334:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff968889ffd600) 00000100:00100000:0.0:1780997229.235579:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3482:x1867507126976512:12345-0@lo:105: Request processed in 140us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997229.235585:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00010000:00010000:3.0:1780997229.235640:0:63418:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.235649:0:63418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780997229.235667:0:63418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:3.0:1780997229.235699:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.235710:0:63418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.235720:0:63418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997229.235735:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c46680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976640:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1780997229.235761:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.235773:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1780997229.235813:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126976640 00000100:00100000:1.0:1780997229.235816:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126976640 00000100:00100000:1.0:1780997229.235841:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4055 00000100:00100000:1.0:1780997229.235845:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63418:x1867507126976640:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1780997229.235856:0:8242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997229.235872:0:8242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b24a lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b243 expref: -99 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.235901:0:8242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b24a lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b243 expref: 9 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.235915:0:8242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b24a lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b243 expref: 9 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.235921:0:8242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff968983653800) 00010000:00010000:1.0:1780997229.235924:0:8242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997229.235926:0:8242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03c00, rc 0) 00000100:00100000:1.0:1780997229.235961:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126976640:12345-0@lo:101:mdt00_001.0 Request processed in 115us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.235967:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4055 00000100:00100000:1.0:1780997229.235996:0:63418:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116995 gen 3 00000004:00080000:1.0:1780997229.236001:0:63418:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964116995 committed transno 115964116995 00000100:00100000:1.0:1780997229.236018:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c46680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976640:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1780997229.236030:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b24a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.236039:0:63418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b24a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780997229.236049:0:63418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:1.0:1780997229.236083:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976768:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.236107:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.236130:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885805600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997229.236144:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126976768 00000100:00100000:1.0:1780997229.236147:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126976768 00000100:00100000:1.0:1780997229.236171:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4056 00000100:00100000:1.0:1780997229.236177:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126976768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.236233:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126976768:12345-0@lo:1000:mdt00_001.0 Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.236240:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4056 00000100:00100000:1.0:1780997229.236266:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976768:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.236338:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976896:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.236358:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.236369:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997229.236378:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126976896 00000100:00100000:1.0:1780997229.236381:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126976896 00000100:00100000:1.0:1780997229.236397:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4057 00000100:00100000:1.0:1780997229.236401:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126976896:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.236455:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126976896:12345-0@lo:1000:mdt00_001.0 Request processed in 53us (96us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780997229.236461:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4057 00000100:00100000:1.0:1780997229.236481:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126976896:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.236540:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126977024:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.236559:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.236569:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885805600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997229.236581:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126977024 00000100:00100000:1.0:1780997229.236584:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126977024 00000100:00100000:1.0:1780997229.236605:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4058 00000100:00100000:1.0:1780997229.236610:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126977024:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.236666:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126977024:12345-0@lo:1000:mdt00_001.0 Request processed in 55us (106us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780997229.236672:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4058 00000100:00100000:1.0:1780997229.236694:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126977024:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.236731:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126977152:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.236749:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.236761:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997229.236770:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126977152 00000100:00100000:1.0:1780997229.236772:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126977152 00000100:00100000:1.0:1780997229.236790:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4059 00000100:00100000:1.0:1780997229.236795:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126977152:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.236835:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126977152:12345-0@lo:1000:mdt00_001.0 Request processed in 40us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.236841:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4059 00000100:00100000:1.0:1780997229.236862:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126977152:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.236904:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126977280:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.236927:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.236942:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885805600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997229.236953:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126977280 00000100:00100000:1.0:1780997229.236956:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126977280 00000100:00100000:1.0:1780997229.236978:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4060 00000100:00100000:1.0:1780997229.236984:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126977280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780997229.237002:0:3482:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3482:1867507126976512:0@lo:105: 00010000:00010000:0.0:1780997229.237019:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.237027:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054a00/0x30fd811c0305b204 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997229.237034:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126977280:12345-0@lo:1000:mdt00_001.0 Request processed in 51us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.237041:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4060 00000100:00100000:1.0:1780997229.237072:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126977280:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.237111:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126977408:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780997229.237135:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.237158:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997229.237332:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126977408 00000100:00100000:0.0:1780997229.237341:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126977408 00000100:00100000:0.0:1780997229.237358:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4061 00000100:00100000:0.0:1780997229.237363:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126977408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780997229.237409:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507126977408:12345-0@lo:1000:mdt00_001.0 Request processed in 45us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997229.237415:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4061 00000100:00100000:1.0:1780997229.237520:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5dbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507126977408:0@lo:1000:mdt00_001.0 00000040:00080000:1.0:1780997229.237917:0:63418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].5, 968 off39472 00000040:00080000:1.0:1780997229.237983:0:63418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].4, 1120 off37904 00000004:00080000:1.0:1780997229.237990:0:63418:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff968885805cc0 with version 16 00000004:00080000:3.0:1780997229.238063:0:72369:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff968889e33300 version 16 rpc_version 16 00000020:00100000:3.0:1780997229.238086:0:72369:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1780997229.238093:0:72369:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9689a5c47b80 x1867507126977664/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997229.238108:0:72369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126977664:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1780997229.238137:0:72369:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.238187:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997229.238216:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126977664 00000100:00100000:1.0:1780997229.238221:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126977664 00000100:00100000:1.0:1780997229.238314:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4062 00000100:00100000:1.0:1780997229.238321:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:72369:x1867507126977664:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1780997229.238639:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:72369:x1867507126977664:12345-0@lo:1000:osp_up0-1.0 Request processed in 317us (500us total) trans 115964116999 rc 0/0 00000100:00100000:1.0:1780997229.238648:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4062 00000100:00100000:3.0:1780997229.238716:0:72369:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126977664:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1780997229.238802:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305b251 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.238814:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305b251 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.238823:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305b251 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997229.238834:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4b322a8 reply state 00000000b2e0f165 transno 81604378753 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305b251 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.238841:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305b251 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.238851:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff968983653400) 00010000:00010000:1.0:1780997229.238853:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997229.238855:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1780997229.238860:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00080000:1.0:1780997229.238865:0:63418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:1.0:1780997229.238871:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.238877:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.238882:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.238932:0:63418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1780997229.238937:0:63418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:1.0:1780997229.238943:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b24a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.238950:0:63418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b24a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997229.239028:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71261:x1867507110408064:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 7895us (8104us total) trans 81604378753 rc 0/0 00000100:00100000:1.0:1780997229.239035:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1378 00010000:00010000:0.0:1780997229.239537:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997229.239547:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.239555:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffd600 already unused, calling callback (ffffffffc1b42ee0) 00010000:00010000:0.0:1780997229.239561:0:37626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997229.239569:0:37626:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.239605:0:37626:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.239612:0:37626:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780997229.239645:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.239653:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff968889ffd600/0x30fd811c0305b235 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b23c expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997229.239666:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126977792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997229.239674:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997229.239676:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997229.239684:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997229.239704:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997229.239849:0:6337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126977792 00000100:00100000:0.0:1780997229.239855:0:6337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126977792 00000100:00100000:0.0:1780997229.239913:0:6337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1780997229.239923:0:6337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3497:x1867507126977792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997229.239934:0:6337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997229.239953:0:6337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b23c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305b235 expref: 10 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.239967:0:6337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689836c9a00) 00010000:00010000:0.0:1780997229.239975:0:6337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997229.240020:0:6337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3497:x1867507126977792:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997229.240027:0:6337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1780997229.240196:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126977792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997229.241723:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997229.241786:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110408320 00000100:00100000:3.0:1780997229.241792:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110408320 00000100:00100000:3.0:1780997229.241839:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1379 00000100:00100000:3.0:1780997229.241849:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71261:x1867507110408320:12345-192.168.206.51@tcp:36:mkdir.0 00010000:00010000:3.0:1780997229.241913:0:65272:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997229.241936:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b212 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dbb expref: 7 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.241949:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:3.0:1780997229.241960:0:65272:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997229.242071:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:71261:x1867507110408320:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 224us (353us total) trans 0 rc -17/-17 00000100:00100000:3.0:1780997229.242078:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1379 00000100:00100000:0.0:1780997229.244780:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997229.244946:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110408448 00000100:00100000:1.0:1780997229.244956:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110408448 00000100:00100000:1.0:1780997229.245007:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1380 00000100:00100000:1.0:1780997229.245016:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:71261:x1867507110408448:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:1.0:1780997229.245036:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997229.245056:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305b258 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8dc9 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.245121:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305b25f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.245137:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305b25f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.245148:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305b25f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997229.245200:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780997229.245204:0:63584:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780997229.245223:0:63584:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305b25f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.245248:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305b258 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dc9 expref: 8 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.245264:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305b25f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dc9 expref: 7 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.248802:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:1.0:1780997229.248813:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780997229.248818:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03600, rc 0) 00000100:00100000:1.0:1780997229.248914:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71261:x1867507110408448:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 3893us (4137us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.248925:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1380 00000100:00100000:1.0:1780997229.254911:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997229.254945:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110408576 00000100:00100000:1.0:1780997229.254953:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110408576 00000100:00100000:1.0:1780997229.255004:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1381 00000100:00100000:1.0:1780997229.255013:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71261:x1867507110408576:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:1.0:1780997229.255034:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997229.255055:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02e00/0x30fd811c0305b266 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8dd0 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255122:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b26d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255139:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b26d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255151:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b26d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255166:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b274 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255173:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b274 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255180:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b274 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255352:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b27b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255360:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b27b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255367:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b27b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997229.255402:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780997229.255405:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780997229.255420:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b27b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255584:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b26d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255590:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b26d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255596:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b26d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255602:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b26d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255606:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997229.255610:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b26d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255616:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b26d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255633:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:1.0:1780997229.255635:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997229.255639:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b26d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255645:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b26d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255656:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b274 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255662:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b274 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255667:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b274 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255672:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997229.255674:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b274 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255680:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b274 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255685:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff968983653e00) 00010000:00010000:1.0:1780997229.255687:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997229.255689:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b274 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255693:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b274 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255728:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02e00/0x30fd811c0305b266 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dd0 expref: 9 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255740:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b27b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dd0 expref: 8 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.255748:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff968983653c00) 00010000:00010000:1.0:1780997229.255750:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780997229.255753:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02a00, rc 0) 00000100:00100000:1.0:1780997229.255817:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:71261:x1867507110408576:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 805us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.255825:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1381 00000100:00100000:2.0:1780997229.260745:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997229.262124:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110408832 00000100:00100000:3.0:1780997229.262137:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110408832 00000100:00100000:3.0:1780997229.262209:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1382 00000100:00100000:3.0:1780997229.262221:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71261:x1867507110408832:12345-192.168.206.51@tcp:36:mkdir.0 00000100:00100000:3.0:1780997229.262361:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126977920:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.262417:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.262442:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997229.262459:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126977920 00000100:00100000:3.0:1780997229.262462:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126977920 00000100:00100000:3.0:1780997229.262487:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4063 00000100:00100000:3.0:1780997229.262493:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63419:x1867507126977920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.262556:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63419:x1867507126977920:12345-0@lo:1000:mdt00_002.0 Request processed in 64us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.262564:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4063 00000100:00100000:3.0:1780997229.262800:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126977920:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.262847:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126978048:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.262873:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.262929:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689898b5840 going to sleep for 11 seconds 00000100:00100000:1.0:1780997229.263358:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126978048 00000100:00100000:1.0:1780997229.263365:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126978048 00000100:00100000:1.0:1780997229.263396:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4064 00000100:00100000:1.0:1780997229.263404:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63419:x1867507126978048:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1780997229.263496:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63419:x1867507126978048:12345-0@lo:1000:mdt00_002.0 Request processed in 93us (622us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780997229.263503:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4064 00000100:00100000:1.0:1780997229.263534:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126978048:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1780997229.263599:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.263610:0:63419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.263620:0:63419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997229.263638:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126978176:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1780997229.263662:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.263676:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997229.263687:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126978176 00000100:00100000:1.0:1780997229.263690:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126978176 00000100:00100000:1.0:1780997229.263709:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4065 00000100:00100000:1.0:1780997229.263715:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63419:x1867507126978176:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1780997229.263724:0:8241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997229.263738:0:8241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b289 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b282 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.263762:0:8241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b27b lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dd0 expref: 7 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.263773:0:8241:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b289 lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b282 expref: 10 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.263795:0:8241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b27b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dd0 expref: 7 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.263808:0:8241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b27b lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dd0 expref: 7 pid: 63417 timeout: 3856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997229.263820:0:8241:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5688e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8241:1867507126978304:192.168.206.51@tcp:104: 00000100:00100000:1.0:1780997229.263876:0:8241:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18ba840 going to sleep for 11 seconds 00000100:00100000:3.0:1780997229.271748:0:8241:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5688e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8241:1867507126978304:192.168.206.51@tcp:104: 00010000:00010000:3.0:1780997229.271786:0:8241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b289 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b282 expref: 10 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.271816:0:8241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff968983653c00) 00010000:00010000:3.0:1780997229.271819:0:8241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997229.271823:0:8241:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b289 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b282 expref: 10 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.271832:0:8241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03400, rc 0) 00000100:00100000:3.0:1780997229.271885:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63419:x1867507126978176:12345-0@lo:101:mdt00_002.0 Request processed in 8168us (8221us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.271895:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4065 00000100:00100000:3.0:1780997229.271945:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126978176:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1780997229.271964:0:63419:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.271974:0:63419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997229.281871:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997229.281920:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110408960 00000100:00100000:3.0:1780997229.281930:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110408960 00010000:00010000:3.0:1780997229.281970:0:18812:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b27b lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dd0 expref: 8 pid: 63417 timeout: 3856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997229.282008:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2589 00000100:00100000:3.0:1780997229.282018:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2395:x1867507110408960:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780997229.282033:0:18812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997229.282052:0:18812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b27b lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dd0 expref: 8 pid: 63417 timeout: 3856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282066:0:18812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b27b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dd0 expref: 8 pid: 63417 timeout: 3856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282090:0:18812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b27b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dd0 expref: 8 pid: 63417 timeout: 3856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282104:0:18812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff968983653c00) 00010000:00010000:3.0:1780997229.282111:0:18812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b289 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b282 expref: 9 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282123:0:18812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b289 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x30fd811c0305b282 expref: 9 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282133:0:18812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b289 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x30fd811c0305b282 expref: 9 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282170:0:18812:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b289 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b282 expref: 9 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997229.282185:0:18812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6797480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:18812:1867507126978432:0@lo:105: 00000100:00100000:3.0:1780997229.282236:0:18812:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.282312:0:18812:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689898b5900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997229.282332:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126978432 00000100:00100000:3.0:1780997229.282336:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126978432 00000100:00100000:3.0:1780997229.282363:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1780997229.282370:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:18812:x1867507126978432:12345-0@lo:105: 00010000:00010000:3.0:1780997229.282386:0:9303:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282396:0:9303:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282405:0:9303:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282413:0:9303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282421:0:9303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282431:0:9303:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282448:0:9303:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9689bff03a00) 00000100:00100000:3.0:1780997229.282483:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:18812:x1867507126978432:12345-0@lo:105: Request processed in 114us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.282491:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00010000:00010000:3.0:1780997229.282516:0:63419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282525:0:63419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780997229.282560:0:63419:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:3.0:1780997229.282596:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282602:0:63419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282610:0:63419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997229.282624:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126978560:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1780997229.282650:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.282667:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689898b50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997229.282691:0:18812:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6797480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:18812:1867507126978432:0@lo:105: 00010000:00010000:3.0:1780997229.282701:0:18812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997229.282736:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110408960:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 719us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.282744:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2589 00000100:00100000:3.0:1780997229.282763:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126978560 00000100:00100000:3.0:1780997229.282767:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126978560 00000100:00100000:3.0:1780997229.282787:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4066 00000100:00100000:3.0:1780997229.282793:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63419:x1867507126978560:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1780997229.282810:0:23042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997229.282823:0:23042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b297 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b290 expref: -99 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282840:0:23042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b297 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b290 expref: 11 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282858:0:23042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b297 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b290 expref: 11 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.282866:0:23042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9689836c9800) 00010000:00010000:3.0:1780997229.282869:0:23042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997229.282871:0:23042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689c2054400, rc 0) 00000100:00100000:3.0:1780997229.282901:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126978560:12345-0@lo:101:mdt00_002.0 Request processed in 108us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.282907:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4066 00000100:00100000:3.0:1780997229.282990:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126978560:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1780997229.283002:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b297 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.283011:0:63419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b297 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780997229.283023:0:63419:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:3.0:1780997229.283051:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126978688:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.283075:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.283090:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689898b5900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997229.283103:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126978688 00000100:00100000:3.0:1780997229.283107:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126978688 00000100:00100000:3.0:1780997229.283129:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4067 00000100:00100000:3.0:1780997229.283135:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126978688:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.283190:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126978688:12345-0@lo:1000:mdt00_002.0 Request processed in 55us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.283202:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4067 00000100:00100000:3.0:1780997229.283229:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126978688:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.283263:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126978816:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.283325:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.283338:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689898b5900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997229.283348:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126978816 00000100:00100000:3.0:1780997229.283351:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126978816 00000100:00100000:3.0:1780997229.283368:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4068 00000100:00100000:3.0:1780997229.283374:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126978816:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.283432:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126978816:12345-0@lo:1000:mdt00_002.0 Request processed in 58us (106us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780997229.283439:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4068 00000100:00100000:3.0:1780997229.283461:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126978816:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.283538:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126978944:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.283560:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.283572:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689898b5900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997229.283584:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126978944 00000100:00100000:3.0:1780997229.283587:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126978944 00000100:00100000:3.0:1780997229.283606:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4069 00000100:00100000:3.0:1780997229.283612:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126978944:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.283660:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126978944:12345-0@lo:1000:mdt00_002.0 Request processed in 47us (99us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780997229.283667:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4069 00000100:00100000:3.0:1780997229.283690:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126978944:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.283737:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126979072:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.283759:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.283771:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689898b5900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997229.283782:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126979072 00000100:00100000:3.0:1780997229.283784:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126979072 00000100:00100000:3.0:1780997229.283802:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4070 00000100:00100000:3.0:1780997229.283808:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126979072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.283851:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126979072:12345-0@lo:1000:mdt00_002.0 Request processed in 43us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.283858:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4070 00000100:00100000:3.0:1780997229.283881:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126979072:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.283916:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126979200:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.283938:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.283950:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689898b5900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997229.283961:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126979200 00000100:00100000:3.0:1780997229.283963:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126979200 00000100:00100000:3.0:1780997229.283984:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4071 00000100:00100000:3.0:1780997229.283989:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126979200:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.284042:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126979200:12345-0@lo:1000:mdt00_002.0 Request processed in 52us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.284048:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4071 00000100:00100000:3.0:1780997229.284072:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126979200:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.284105:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126979328:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.284126:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.284139:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689898b5900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997229.284154:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126979328 00000100:00100000:3.0:1780997229.284158:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126979328 00000100:00100000:3.0:1780997229.284177:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4072 00000100:00100000:3.0:1780997229.284182:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126979328:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997229.284220:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63419:x1867507126979328:12345-0@lo:1000:mdt00_002.0 Request processed in 37us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.284226:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4072 00000100:00100000:3.0:1780997229.284249:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507126979328:0@lo:1000:mdt00_002.0 00000040:00080000:3.0:1780997229.284700:0:63419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].6, 968 off40440 00000040:00080000:3.0:1780997229.284750:0:63419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].5, 1120 off39024 00000004:00080000:3.0:1780997229.284756:0:63419:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9689898b50c0 with version 17 00000004:00080000:3.0:1780997229.284771:0:72369:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff968889e33300 version 17 rpc_version 17 00000020:00100000:3.0:1780997229.284790:0:72369:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1780997229.284797:0:72369:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9689854b5180 x1867507126979584/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997229.284812:0:72369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126979584:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1780997229.284840:0:72369:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.284853:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991db7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997229.284866:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126979584 00000100:00100000:3.0:1780997229.284869:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126979584 00000100:00100000:3.0:1780997229.284889:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4073 00000100:00100000:3.0:1780997229.284896:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:72369:x1867507126979584:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1780997229.285154:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:72369:x1867507126979584:12345-0@lo:1000:osp_up0-1.0 Request processed in 258us (312us total) trans 115964117000 rc 0/0 00000100:00100000:3.0:1780997229.285161:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4073 00000100:00100000:3.0:1780997229.285200:0:72369:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126979584:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1780997229.285258:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b29e lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.289117:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b29e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.289141:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b29e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997229.289174:0:63419:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001dbb8bfb reply state 00000000108ffeb1 transno 81604378754 ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b29e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.289185:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b29e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.289193:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689836c9e00) 00010000:00010000:3.0:1780997229.289196:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997229.289457:0:63419:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1780997229.289465:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00080000:3.0:1780997229.289475:0:63419:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:3.0:1780997229.289485:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.289495:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.289503:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.289527:0:63419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1780997229.289531:0:63419:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:3.0:1780997229.289543:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b297 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.289551:0:63419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b297 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997229.289709:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71261:x1867507110408832:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 27487us (28974us total) trans 81604378754 rc 0/0 00000100:00100000:3.0:1780997229.289719:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1382 00010000:00010000:0.0:1780997229.293506:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997229.293520:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.293532:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03a00 already unused, calling callback (ffffffffc1b42ee0) 00010000:00010000:0.0:1780997229.293539:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997229.293548:0:6340:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.293940:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.293966:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780997229.294004:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.294012:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bff03a00/0x30fd811c0305b282 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b289 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.294036:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997229.294038:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997229.294039:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997229.294048:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780997229.294067:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126979712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997229.294123:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997229.294166:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126979712 00000100:00100000:0.0:1780997229.294173:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126979712 00000100:00100000:0.0:1780997229.295106:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1780997229.295118:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+12:3499:x1867507126979712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997229.295131:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997229.295149:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b289 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305b282 expref: 12 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.295163:0:25183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff968983653c00) 00010000:00010000:0.0:1780997229.295172:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997229.295229:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3499:x1867507126979712:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997229.295237:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00010000:00010000:3.0:1780997229.295456:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997229.295610:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126979712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997229.309998:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997229.310103:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110409088 00000100:00100000:2.0:1780997229.310115:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110409088 00000100:00100000:2.0:1780997229.310173:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1383 00000100:00100000:2.0:1780997229.310183:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71262:x1867507110409088:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780997229.310215:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997229.310239:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454a00/0x30fd811c0305b2a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8dd7 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310354:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305b2ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310368:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305b2ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310379:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305b2ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310393:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b2b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310400:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310406:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310492:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b2ba lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310500:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b2ba lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310520:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b2ba lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997229.310557:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780997229.310561:0:80049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780997229.310760:0:80049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b2ba lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310773:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305b2ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310780:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305b2ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310786:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305b2ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310792:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997229.310796:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305b2ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310803:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305b2ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310815:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:2.0:1780997229.310818:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997229.310822:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305b2ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310829:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455800/0x30fd811c0305b2ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310850:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310856:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b2b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310862:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b2b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310867:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997229.310869:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b2b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310875:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b2b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310883:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9689964dce00) 00010000:00010000:2.0:1780997229.310886:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997229.310888:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b2b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310894:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b2b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310925:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454a00/0x30fd811c0305b2a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dd7 expref: 9 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310937:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b2ba lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dd7 expref: 8 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.310956:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689964dc000) 00010000:00010000:2.0:1780997229.310958:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1780997229.310961:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454200, rc 0) 00000100:00100000:2.0:1780997229.311064:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:71262:x1867507110409088:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 881us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997229.311072:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1383 00000100:00100000:3.0:1780997229.313844:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997229.313962:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110409216 00000100:00100000:1.0:1780997229.313971:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110409216 00000100:00100000:1.0:1780997229.314025:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1384 00000100:00100000:1.0:1780997229.314035:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:71262:x1867507110409216:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780997229.314054:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997229.314078:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02e00/0x30fd811c0305b2c1 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8dde expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.314145:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b2c8 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.314158:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b2c8 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.314169:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b2c8 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.314180:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.314190:0:63417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b24a lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b243 expref: 10 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.314199:0:63417:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 4/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.314245:0:63417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b24a lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b243 expref: 10 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997229.314261:0:63417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:63417:1867507126979840:0@lo:104: 00000100:00100000:0.0:1780997229.315725:0:63417:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997229.315785:0:63417:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18ba180 going to sleep for 11 seconds 00000100:00100000:2.0:1780997229.315857:0:6334:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1780997229.315871:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126979840 00000100:00100000:2.0:1780997229.315877:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126979840 00000100:00100000:2.0:1780997229.315924:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1780997229.315933:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:63417:x1867507126979840:12345-0@lo:104: 00010000:00010000:2.0:1780997229.315949:0:6334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b24a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.316018:0:6334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1780997229.316024:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:63417:x1867507126979840:12345-0@lo:104: Request processed in 93us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997229.316031:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00010000:1.0:1780997229.316099:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997229.316106:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b24a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.316115:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980030000 already unused, calling callback (ffffffffc1b42ee0) 00010000:00010000:1.0:1780997229.316120:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b24a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997229.316129:0:14480:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b24a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.316160:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b24a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.316166:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997229.316196:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b24a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.316212:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff968980030000/0x30fd811c0305b243 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b24a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.316235:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997229.316237:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997229.316238:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997229.316513:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126979968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997229.316547:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997229.316726:0:63417:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:63417:1867507126979840:0@lo:104: 00010000:00010000:0.0:1780997229.316758:0:63417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997229.316834:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126979968 00000100:00100000:3.0:1780997229.316839:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126979968 00010000:00010000:3.0:1780997229.316860:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b24a lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x30fd811c0305b243 expref: 11 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997229.316997:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:3.0:1780997229.317006:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3499:x1867507126979968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997229.317017:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1780997229.321191:0:88340:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117000 is committed 00010000:00010000:3.0:1780997229.321371:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b24a lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b243 expref: 9 pid: 8242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.321389:0:6336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff968983653800) 00010000:00010000:3.0:1780997229.321395:0:6336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.321405:0:6336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.321427:0:6336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 4/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.321462:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997229.321539:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3499:x1867507126979968:12345-0@lo:103:ldlm_bl.0 Request processed in 4533us (4990us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.321549:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:2.0:1780997229.321652:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126979968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997229.321890:0:63417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.321899:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997229.322021:0:63417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5688700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:63417:1867507126980096:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1780997229.322074:0:63417:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.322095:0:63417:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bae40 going to sleep for 11 seconds 00000100:00100000:2.0:1780997229.322471:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126980096 00000100:00100000:2.0:1780997229.322478:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126980096 00000100:00100000:2.0:1780997229.322523:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4074 00000100:00100000:2.0:1780997229.322531:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63417:x1867507126980096:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1780997229.322619:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63417:x1867507126980096:12345-0@lo:1000:mdt00_000.0 Request processed in 89us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997229.322626:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4074 00000100:00100000:2.0:1780997229.322664:0:63417:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5688700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:63417:1867507126980096:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1780997229.322705:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454a00/0x30fd811c0305b2d6 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322716:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454a00/0x30fd811c0305b2d6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322726:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454a00/0x30fd811c0305b2d6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997229.322744:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454a00/0x30fd811c0305b2d6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322756:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b2c8 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322762:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b2c8 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322768:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b2c8 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322775:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b2c8 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322780:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997229.322784:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b2c8 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322800:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b2c8 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322810:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689964dc000) 00010000:00010000:2.0:1780997229.322812:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997229.322817:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b2c8 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322822:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b2c8 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322833:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322838:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322844:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322848:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997229.322851:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322856:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322861:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff968983653800) 00010000:00010000:2.0:1780997229.322863:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997229.322865:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322879:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b2cf lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322916:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02e00/0x30fd811c0305b2c1 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dde expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322929:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454a00/0x30fd811c0305b2d6 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dde expref: 9 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.322936:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9689964dce00) 00010000:00010000:2.0:1780997229.322938:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780997229.322941:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454a00, rc 0) 00000100:00100000:2.0:1780997229.322984:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71262:x1867507110409216:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 8951us (9149us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997229.322991:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1384 00000100:00100000:2.0:1780997229.331916:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997229.331992:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110409344 00000100:00100000:1.0:1780997229.332003:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110409344 00000100:00100000:1.0:1780997229.332060:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1385 00000100:00100000:1.0:1780997229.332069:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71262:x1867507110409344:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780997229.332094:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997229.332117:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b2dd lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8de5 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.332185:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b2e4 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.332211:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b2e4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.332223:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b2e4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997229.332571:0:65272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1780997229.332576:0:65272:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1780997229.332621:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b2dd lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8de5 expref: 11 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.332643:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b2e4 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8de5 expref: 10 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.332673:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff968983653400) 00010000:00010000:1.0:1780997229.332676:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1780997229.332680:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03a00, rc 0) 00000100:00100000:1.0:1780997229.332744:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71262:x1867507110409344:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 676us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.332751:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1385 00000100:00100000:2.0:1780997229.337823:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997229.337897:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110409600 00000100:00100000:1.0:1780997229.337907:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110409600 00000100:00100000:1.0:1780997229.337965:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1386 00000100:00100000:1.0:1780997229.337976:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71262:x1867507110409600:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780997229.337999:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997229.338025:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b2eb lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8dec expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997229.338127:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1780997229.338239:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b2eb lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dec expref: 12 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.338253:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689882bd700) 00010000:00010000:1.0:1780997229.338255:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780997229.338260:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305b2eb lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dec expref: 12 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.338411:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02a00, rc 0) 00000100:00100000:1.0:1780997229.338478:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:71262:x1867507110409600:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 504us (664us total) trans 81604378755 rc 301/301 00000100:00100000:1.0:1780997229.338502:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1386 00000100:00100000:0.0:1780997229.341364:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997229.341697:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110409856 00000100:00100000:2.0:1780997229.341708:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110409856 00000100:00100000:2.0:1780997229.341763:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1387 00000100:00100000:2.0:1780997229.341772:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:71262:x1867507110409856:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:2.0:1780997229.341834:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997229.341862:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b2e4 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8de5 expref: 11 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.341882:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff968983653400) 00010000:00010000:2.0:1780997229.341902:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997229.341926:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455800/0x30fd811c0305b2f9 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.341939:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455800/0x30fd811c0305b2f9 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.341949:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455800/0x30fd811c0305b2f9 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997229.342119:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000022e84253 reply state 000000005921032e transno 81604378756 ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455800/0x30fd811c0305b2f9 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.342133:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455800/0x30fd811c0305b2f9 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.342139:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff968983653400) 00010000:00010000:2.0:1780997229.342142:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1780997229.342144:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1780997229.342152:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000100:00100000:2.0:1780997229.342233:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:71262:x1867507110409856:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 461us (878us total) trans 81604378756 rc 0/0 00000100:00100000:2.0:1780997229.342240:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1387 00000100:00100000:3.0:1780997229.344504:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997229.345444:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110410112 00000100:00100000:1.0:1780997229.345458:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110410112 00000100:00100000:1.0:1780997229.345522:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 239 00000100:00100000:1.0:1780997229.345532:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889fe4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:71262:x1867507110410112:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1780997229.345782:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889fe4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:71262:x1867507110410112:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 251us (1286us total) trans 81604378757 rc 0/0 00000100:00100000:1.0:1780997229.345790:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 239 00000100:00100000:2.0:1780997229.363058:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997229.363159:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110410240 00000100:00100000:1.0:1780997229.363171:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110410240 00000100:00100000:1.0:1780997229.363633:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1388 00000100:00100000:1.0:1780997229.363646:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71263:x1867507110410240:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780997229.363667:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997229.363687:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b300 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8df3 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.363755:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b307 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.363770:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b307 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.363782:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b307 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.363792:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.363820:0:65272:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b297 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b290 expref: 7 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.363829:0:65272:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 4/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.363862:0:65272:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b297 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b290 expref: 7 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997229.363878:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:65272:1867507126980224:0@lo:104: 00000100:00100000:1.0:1780997229.363937:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.363976:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18ba600 going to sleep for 11 seconds 00000100:00100000:0.0:1780997229.364053:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126980224 00000100:00100000:0.0:1780997229.364058:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126980224 00000100:00100000:0.0:1780997229.364095:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1780997229.364102:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:65272:x1867507126980224:12345-0@lo:104: 00010000:00010000:0.0:1780997229.364114:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b297 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.364172:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1780997229.364177:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:65272:x1867507126980224:12345-0@lo:104: Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997229.364184:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00010000:0.0:1780997229.364203:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997229.364209:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b297 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.364216:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054e00 already unused, calling callback (ffffffffc1b42ee0) 00010000:00010000:0.0:1780997229.364221:0:37626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b297 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997229.364229:0:37626:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b297 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.364254:0:37626:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b297 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.364428:0:37626:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780997229.364453:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b297 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.364462:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689c2054e00/0x30fd811c0305b290 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b297 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997229.364485:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997229.364487:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997229.364489:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997229.364501:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126980352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997229.364530:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997229.364595:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126980352 00000100:00100000:3.0:1780997229.364601:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126980352 00010000:00010000:3.0:1780997229.364622:0:6338:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b297 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x30fd811c0305b290 expref: 8 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997229.364657:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:3.0:1780997229.364665:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba657b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3496:x1867507126980352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997229.364676:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1780997229.364735:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:65272:1867507126980224:0@lo:104: 00010000:00010000:1.0:1780997229.364769:0:65272:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.365123:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689c2054400/0x30fd811c0305b297 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b290 expref: 8 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.365137:0:6338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9689836c9800) 00010000:00010000:3.0:1780997229.365142:0:6338:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.365149:0:6338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.365155:0:6338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 4/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.365191:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997229.365669:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba657b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507126980352:12345-0@lo:103:ldlm_bl.0 Request processed in 1003us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997229.365678:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:3.0:1780997229.365736:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126980352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997229.370920:0:65272:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.370939:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997229.371079:0:65272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:65272:1867507126980480:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780997229.371143:0:65272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.371179:0:65272:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18ba9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997229.372016:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126980480 00000100:00100000:3.0:1780997229.372024:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126980480 00000100:00100000:3.0:1780997229.372078:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4075 00000100:00100000:3.0:1780997229.372087:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65272:x1867507126980480:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1780997229.372198:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65272:x1867507126980480:12345-0@lo:1000:mdt00_004.0 Request processed in 111us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.372205:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4075 00000100:00100000:2.0:1780997229.373007:0:65272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:65272:1867507126980480:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1780997229.373078:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454e00/0x30fd811c0305b315 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373094:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454e00/0x30fd811c0305b315 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373104:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454e00/0x30fd811c0305b315 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997229.373142:0:65272:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454e00/0x30fd811c0305b315 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373157:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b307 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373163:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b307 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373169:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b307 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373175:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b307 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373181:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997229.373184:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b307 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373191:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b307 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373203:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689964dc000) 00010000:00010000:2.0:1780997229.373205:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997229.373211:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b307 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373216:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03400/0x30fd811c0305b307 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373228:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373240:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373246:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373251:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997229.373254:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373260:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373308:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9689836c9800) 00010000:00010000:2.0:1780997229.373319:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997229.373324:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373330:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03e00/0x30fd811c0305b30e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373372:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02a00/0x30fd811c0305b300 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8df3 expref: 11 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373385:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454e00/0x30fd811c0305b315 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8df3 expref: 10 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.373392:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689964dc600) 00010000:00010000:2.0:1780997229.373394:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780997229.373403:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454e00, rc 0) 00000100:00100000:2.0:1780997229.373455:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71263:x1867507110410240:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 9814us (10408us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997229.373462:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1388 00000100:00100000:0.0:1780997229.377792:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997229.377896:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110410368 00000100:00100000:1.0:1780997229.377907:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110410368 00000100:00100000:1.0:1780997229.377967:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1389 00000100:00100000:1.0:1780997229.377995:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:71263:x1867507110410368:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780997229.378019:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997229.378043:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b31c lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8dfa expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.378105:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b323 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.378119:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b323 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.378130:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b323 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997229.378177:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1780997229.378181:0:63584:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1780997229.378227:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03a00/0x30fd811c0305b31c lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dfa expref: 15 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.378246:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b323 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dfa expref: 14 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997229.378255:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689836c9e00) 00010000:00010000:1.0:1780997229.378258:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1780997229.378261:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02e00, rc 0) 00000100:00100000:0.0:1780997229.381051:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:71263:x1867507110410368:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 3048us (3257us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997229.381064:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1389 00000100:00100000:3.0:1780997229.394649:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997229.394767:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110410624 00000100:00100000:2.0:1780997229.394777:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110410624 00000100:00100000:2.0:1780997229.394888:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1390 00000100:00100000:2.0:1780997229.394899:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:71263:x1867507110410624:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780997229.394919:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997229.394944:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454600/0x30fd811c0305b32a lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e01 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997229.395046:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1780997229.395136:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454600/0x30fd811c0305b32a lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e01 expref: 16 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.395152:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689964dcf00) 00010000:00010000:2.0:1780997229.395156:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780997229.395161:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454600/0x30fd811c0305b32a lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e01 expref: 16 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997229.395180:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454600, rc 0) 00000100:00100000:2.0:1780997229.395242:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+15:71263:x1867507110410624:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 344us (601us total) trans 81604378758 rc 301/301 00000100:00100000:2.0:1780997229.395250:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1390 00000100:00100000:2.0:1780997229.398482:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997229.398603:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110410880 00000100:00100000:3.0:1780997229.398616:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110410880 00000100:00100000:3.0:1780997229.398678:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1391 00000100:00100000:3.0:1780997229.398689:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+15:71263:x1867507110410880:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:3.0:1780997229.398762:0:63419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997229.398790:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b323 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dfa expref: 15 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.398812:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689836c9e00) 00010000:00010000:3.0:1780997229.398818:0:63419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997229.398846:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b338 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.398862:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b338 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.398874:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b338 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997229.399149:0:63419:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004151e046 reply state 000000009471587a transno 81604378759 ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b338 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.399163:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b338 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997229.399169:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689836c9e00) 00010000:00010000:3.0:1780997229.399171:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1780997229.399174:0:63419:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1780997229.399181:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000100:00100000:3.0:1780997229.399321:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+16:71263:x1867507110410880:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 633us (848us total) trans 81604378759 rc 0/0 00000100:00100000:3.0:1780997229.399329:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1391 00000100:00100000:0.0:1780997229.403169:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997229.403830:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110411136 00000100:00100000:3.0:1780997229.403840:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110411136 00000100:00100000:2.0:1780997229.404456:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 240 00000100:00100000:2.0:1780997229.404468:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+16:71263:x1867507110411136:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1780997229.404714:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+17:71263:x1867507110411136:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 249us (1556us total) trans 81604378760 rc 0/0 00000100:00100000:2.0:1780997229.404723:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 240 00000100:00100000:3.0:1780997229.990067:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126980608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997229.990157:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997229.990261:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126980608 00000100:00100000:0.0:1780997229.990311:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126980608 00000100:00100000:0.0:1780997229.990366:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4076 00000100:00100000:2.0:1780997229.990542:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780997229.990554:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126980736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997229.990588:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997229.992647:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126980608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780997229.992690:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:0.0:1780997229.992766:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126980608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (2609us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997229.992880:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126980608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780997229.993206:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126981120:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.993242:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.993266:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888961b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126981632:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.993331:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.993350:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507126982144:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.993381:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.993402:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1780997229.993408:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126980992:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.993430:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.993458:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b10c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126981504:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.993481:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.993510:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126982016:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.993531:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.993559:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126981120 00000100:00100000:1.0:1780997229.993565:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126981120 00000100:00100000:1.0:1780997229.993612:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126982144 00000100:00100000:1.0:1780997229.993615:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126982144 00000100:00100000:1.0:1780997229.993630:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126980992 00000100:00100000:1.0:1780997229.993633:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126980992 00000100:00100000:1.0:1780997229.993652:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1780997229.993660:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126981120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.993697:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126981120:12345-0@lo:400:kworker.0 Request processed in 38us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.993704:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1780997229.993721:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:1.0:1780997229.993727:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507126982144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.993752:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507126982144:12345-0@lo:400:kworker.0 Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.993758:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:1.0:1780997229.993778:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:1.0:1780997229.993783:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126980992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.993808:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3497:x1867507126980992:12345-0@lo:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.993814:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:1.0:1780997229.993832:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126981632 00000100:00100000:1.0:1780997229.993836:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126981632 00000100:00100000:1.0:1780997229.993858:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126981504 00000100:00100000:1.0:1780997229.993861:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126981504 00000100:00100000:1.0:1780997229.993876:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126982016 00000100:00100000:1.0:1780997229.993879:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126982016 00000100:00100000:1.0:1780997229.993895:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1780997229.993900:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126981632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.993929:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126981632:12345-0@lo:400:kworker.0 Request processed in 29us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.993935:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1780997229.993946:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640 00000100:00100000:1.0:1780997229.993951:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126981504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.993975:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126981504:12345-0@lo:400:kworker.0 Request processed in 24us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.993981:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640 00000100:00100000:1.0:1780997229.993990:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641 00000100:00100000:1.0:1780997229.993996:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126982016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.994020:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126982016:12345-0@lo:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.994026:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641 00000100:00080000:1.0:1780997229.994056:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997229.994067:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997229.994069:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780997229.994071:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997229.994110:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3497:1867507126980992:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.994120:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b10c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126981504:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.994129:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126982016:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.994139:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126981120:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.994146:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888961b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126981632:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.994154:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507126982144:0@lo:400:kworker.0 00000100:00100000:2.0:1780997229.995998:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126980864:0@lo:400:kworker.0 00000100:00100000:2.0:1780997229.996080:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997229.996133:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126981376:0@lo:400:kworker.0 00000100:00100000:2.0:1780997229.996160:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997229.996179:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126981888:0@lo:400:kworker.0 00000100:00100000:2.0:1780997229.996202:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997229.996225:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1780997229.996232:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126981248:0@lo:400:kworker.0 00000100:00100000:2.0:1780997229.996254:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997229.996294:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126981760:0@lo:400:kworker.0 00000100:00100000:2.0:1780997229.996328:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997229.997827:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126980864 00000100:00100000:1.0:1780997229.997840:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126980864 00000100:00100000:1.0:1780997229.997901:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1780997229.997911:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126980864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.997994:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126980864:12345-0@lo:400:kworker.0 Request processed in 84us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.998001:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1780997229.998040:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126981888 00000100:00100000:1.0:1780997229.998044:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126981888 00000100:00100000:1.0:1780997229.998086:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00100000:1.0:1780997229.998093:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126981888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.998127:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507126981888:12345-0@lo:400:kworker.0 Request processed in 34us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.998133:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00000100:00100000:1.0:1780997229.998156:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126981376 00000100:00100000:1.0:1780997229.998159:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126981376 00000100:00100000:1.0:1780997229.998200:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126981248 00000100:00100000:1.0:1780997229.998204:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126981248 00000100:00100000:1.0:1780997229.998220:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126981760 00000100:00100000:1.0:1780997229.998222:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126981760 00000100:00100000:1.0:1780997229.998238:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1780997229.998243:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126981376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.998700:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126981376:12345-0@lo:400:kworker.0 Request processed in 455us (2537us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.998707:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1780997229.998722:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1780997229.998729:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126981248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.998760:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126981248:12345-0@lo:400:kworker.0 Request processed in 32us (2506us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.998766:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1780997229.998777:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1780997229.998783:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126981760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.998811:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126981760:12345-0@lo:400:kworker.0 Request processed in 28us (2482us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997229.998817:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00080000:1.0:1780997229.998845:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780997229.998849:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997229.998851:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997229.998884:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126981248:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.998895:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126981760:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.998903:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126980864:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.998912:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126981376:0@lo:400:kworker.0 00000100:00100000:1.0:1780997229.998938:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507126981888:0@lo:400:kworker.0 00000100:00100000:3.0:1780997229.999114:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126980736 00000100:00100000:3.0:1780997229.999120:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126980736 00000100:00100000:3.0:1780997229.999151:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4077 00000100:00100000:3.0:1780997229.999158:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3499:x1867507126980736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780997229.999197:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445183488 avail 1298944000 00000100:00100000:3.0:1780997229.999344:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3499:x1867507126980736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 186us (8754us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997229.999351:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4077 00000100:00100000:0.0:1780997229.999858:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4076 00000100:00100000:2.0:1780997230.003979:0:3499:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117000 gen 3 00000004:00080000:2.0:1780997230.003992:0:3499:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964116999 committed transno 115964117000 00000004:00080000:2.0:1780997230.004022:0:3499:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964117000 committed transno 115964117000 00000100:00100000:2.0:1780997230.004051:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126980736:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1780997230.288555:0:72364:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378760 is committed 00000020:00080000:0.0:1780997230.288587:0:72364:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9689898b5900 refcount 2 committed 0 result 0 batchid 77309411390 00000020:00080000:0.0:1780997230.288593:0:72364:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff968885f19700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9689898b50c0 00000020:00080000:0.0:1780997230.288597:0:72364:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].5 00000020:00080000:0.0:1780997230.288600:0:72364:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff968885f19e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9689a6762600 00000020:00080000:0.0:1780997230.288603:0:72364:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].6 00000020:00080000:0.0:1780997230.288623:0:72364:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff968885805600 refcount 2 committed 0 result 0 batchid 77309411389 00000020:00080000:0.0:1780997230.288626:0:72364:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9689ba02cf00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff968885805cc0 00000020:00080000:0.0:1780997230.288629:0:72364:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].4 00000020:00080000:0.0:1780997230.288631:0:72364:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9689ba02ce00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9689ad8e5200 00000020:00080000:0.0:1780997230.288633:0:72364:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].5 00000020:00080000:3.0:1780997230.288680:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411390 committed batchid 77309411388 00000020:00080000:3.0:1780997230.288748:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411388 00010000:00010000:1.0:1780997230.289536:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305b251 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289551:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305b251 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289559:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305b251 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289565:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997230.289571:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305b251 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289579:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305b251 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289598:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff968983653400) 00010000:00010000:1.0:1780997230.289601:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997230.289606:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305b251 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289612:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305b251 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289630:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b29e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289635:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b29e lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289641:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b29e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289653:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2055e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997230.289656:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b29e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289661:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b29e lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289669:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689836c9e00) 00010000:00010000:1.0:1780997230.289671:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997230.289674:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b29e lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289679:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b29e lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289692:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455800/0x30fd811c0305b2f9 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289698:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455800/0x30fd811c0305b2f9 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289703:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455800/0x30fd811c0305b2f9 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289708:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997230.289710:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455800/0x30fd811c0305b2f9 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289716:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455800/0x30fd811c0305b2f9 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289731:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff968983653400) 00010000:00010000:1.0:1780997230.289733:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780997230.289736:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455800/0x30fd811c0305b2f9 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289742:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455800/0x30fd811c0305b2f9 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289758:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b338 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289764:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b338 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289769:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b338 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289774:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997230.289776:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b338 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289782:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b338 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289788:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689836c9e00) 00010000:00010000:1.0:1780997230.289790:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780997230.289792:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b338 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.289798:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b338 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1780997230.290444:0:72364:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411390 batchid updated 00000020:00080000:3.0:1780997230.290491:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411390 00000004:00080000:3.0:1780997230.290551:0:72384:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9689bccb5a80 with version 18 00000020:00080000:3.0:1780997230.290569:0:72384:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411389 cancel update log [0x2000088d1:0x2:0x0].4: rc = 0 00000020:00080000:3.0:1780997230.290642:0:72384:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411389 cancel update log [0x2400090a0:0x2:0x0].5: rc = 0 00000004:00080000:3.0:1780997230.290663:0:72384:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9689bccb5300 with version 19 00000020:00080000:3.0:1780997230.290667:0:72384:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411390 cancel update log [0x2000088d1:0x2:0x0].5: rc = 0 00000020:00080000:3.0:1780997230.290689:0:72384:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411390 cancel update log [0x2400090a0:0x2:0x0].6: rc = 0 00000020:00080000:3.0:1780997230.290695:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411390 00000004:00080000:1.0:1780997230.290742:0:72369:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff968889e33300 version 18 rpc_version 18 00000020:00100000:1.0:1780997230.290776:0:72369:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1780997230.290786:0:72369:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9688895f6a00 x1867507126982400/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997230.290809:0:72369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f6a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126982400:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1780997230.290872:0:72369:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997230.290947:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997230.293063:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126982400 00000100:00100000:3.0:1780997230.293079:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126982400 00000100:00100000:3.0:1780997230.293146:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4078 00000100:00100000:3.0:1780997230.293156:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:72369:x1867507126982400:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1780997230.293374:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:72369:x1867507126982400:12345-0@lo:1000:osp_up0-1.0 Request processed in 219us (2500us total) trans 115964117001 rc 0/0 00000100:00100000:3.0:1780997230.293382:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4078 00000100:00100000:2.0:1780997230.293666:0:72369:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f6a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126982400:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1780997230.293699:0:72369:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff968889e33300 version 19 rpc_version 19 00000020:00100000:2.0:1780997230.293724:0:72369:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1780997230.293732:0:72369:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9689bb5ba680 x1867507126982656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997230.293753:0:72369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5ba680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126982656:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1780997230.293791:0:72369:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997230.293812:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e33a80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997230.293862:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126982656 00000100:00100000:0.0:1780997230.293867:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126982656 00000100:00100000:0.0:1780997230.293904:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4079 00000100:00100000:0.0:1780997230.293911:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:72369:x1867507126982656:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1780997230.294014:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:72369:x1867507126982656:12345-0@lo:1000:osp_up0-1.0 Request processed in 103us (222us total) trans 115964117002 rc 0/0 00000100:00100000:0.0:1780997230.294021:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4079 00000100:00100000:2.0:1780997230.294690:0:72369:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5ba680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507126982656:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1780997230.309521:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1780997230.313488:0:88340:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117002 is committed 00000100:00100000:0.0:1780997230.349931:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997230.349979:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997230.350008:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997230.350032:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997230.350079:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997230.350118:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110411392 00000100:00100000:0.0:1780997230.350128:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110411392 00000100:00100000:0.0:1780997230.350180:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110411520 00000100:00100000:0.0:1780997230.350184:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110411520 00000100:00100000:0.0:1780997230.350217:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110411776 00000100:00100000:0.0:1780997230.350221:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110411776 00000100:00100000:0.0:1780997230.350246:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1349 00000100:00100000:0.0:1780997230.350258:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2395:x1867507110411392:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997230.350374:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2395:x1867507110411392:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 119us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997230.350382:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1349 00000100:00100000:0.0:1780997230.350401:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1350 00000100:00100000:0.0:1780997230.350408:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110411520:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997230.350443:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110411520:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997230.350449:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1350 00000100:00100000:0.0:1780997230.350462:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1392 00000100:00100000:0.0:1780997230.350469:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71272:x1867507110411776:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:0.0:1780997230.350487:0:63417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445183488 avail 1298944000 00000100:00100000:0.0:1780997230.350521:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71272:x1867507110411776:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 52us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997230.350528:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1392 00000100:00100000:3.0:1780997230.351174:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110411264 00000100:00100000:3.0:1780997230.351182:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110411264 00000100:00100000:3.0:1780997230.351238:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:3.0:1780997230.351247:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110411264:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997230.351313:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110411264:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 68us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997230.351320:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:0.0:1780997230.352374:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110411648 00000100:00100000:0.0:1780997230.352386:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110411648 00000100:00100000:0.0:1780997230.352487:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2643 00000100:00100000:0.0:1780997230.352498:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110411648:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997230.352580:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110411648:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 71us (2533us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997230.352587:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2643 00000100:00080000:3.0:1780997230.356798:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997230.378998:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997230.379080:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110411904 00000100:00100000:1.0:1780997230.379091:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110411904 00000100:00100000:1.0:1780997230.379156:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1393 00000100:00100000:1.0:1780997230.379167:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:71272:x1867507110411904:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:1.0:1780997230.379211:0:63417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:1.0:1780997230.379265:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:71272:x1867507110411904:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 101us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997230.379299:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1393 00000100:00100000:3.0:1780997230.388952:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997230.393464:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110412032 00000100:00100000:1.0:1780997230.393481:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110412032 00000100:00100000:1.0:1780997230.393535:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5965 00000100:00100000:1.0:1780997230.393545:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2393:x1867507110412032:12345-192.168.206.51@tcp:8:lfs.0 00010000:00080000:1.0:1780997230.393590:0:25175:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp t0 exp 0000000000000000 cur 3757 last 0 00000020:00000080:1.0:1780997230.393621:0:25175:0:(genops.c:1406:class_connect()) connect: client e4805cfa-ac6d-4d67-bb97-a6c06740fcd0, cookie 0x30fd811c0305b33f 00002000:00100000:1.0:1780997230.393633:0:25175:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e4805cfa-ac6d-4d67-bb97-a6c06740fcd0/ffff96888a817800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1780997230.393651:0:25175:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1780997230.393742:0:25175:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1780997230.393780:0:25175:0:(import.c:65:import_set_state_nolock()) ffff96888a814800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997230.393865:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110412032:12345-192.168.206.51@tcp:8:lfs.0 Request processed in 319us (4920us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997230.393874:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5965 00000100:00100000:3.0:1780997230.397713:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997230.398065:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110412160 00000100:00100000:1.0:1780997230.398077:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110412160 00000100:00100000:1.0:1780997230.398161:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2122 00000100:00100000:1.0:1780997230.398173:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:71272:x1867507110412160:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:1.0:1780997230.398220:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780997230.398323:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:71272:x1867507110412160:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 152us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997230.398332:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2122 00000100:00080000:3.0:1780997230.399069:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997230.402525:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997230.403112:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110412288 00000100:00100000:3.0:1780997230.403123:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110412288 00000100:00100000:3.0:1780997230.403181:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2123 00000100:00100000:3.0:1780997230.403192:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:71272:x1867507110412288:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:3.0:1780997230.403225:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997230.403341:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:71272:x1867507110412288:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 150us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997230.403349:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2123 00000100:00100000:1.0:1780997230.501529:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126982784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997230.501597:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997230.501704:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126982784 00000100:00100000:0.0:1780997230.501712:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126982784 00000100:00100000:0.0:1780997230.501762:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:0.0:1780997230.501770:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126982784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780997230.501790:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997230.501831:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126982784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997230.501838:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00100000:0.0:1780997230.501879:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126982784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780997230.507251:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997230.507391:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110412544 00000100:00100000:1.0:1780997230.507403:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110412544 00000100:00100000:1.0:1780997230.507467:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1394 00000100:00100000:1.0:1780997230.507477:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71279:x1867507110412544:12345-192.168.206.51@tcp:36:mcreate.0 00010000:00010000:1.0:1780997230.507534:0:63419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997230.507560:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03600/0x30fd811c0305b25f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dc9 expref: 10 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.507578:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:1.0:1780997230.507583:0:63419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780997230.507657:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b346 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.507670:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b346 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.507680:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b346 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.507693:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b34d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.507700:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b34d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.507706:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b34d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.508141:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b346 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.508150:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b346 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.508156:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b346 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.508162:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b346 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.508167:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997230.508171:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b346 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.508189:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b346 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.508200:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:1.0:1780997230.508203:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997230.508207:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b346 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.508213:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02c00/0x30fd811c0305b346 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997230.508224:0:63419:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006b4bc819 reply state 000000003adc84d4 transno 115964117003 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b34d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.508234:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b34d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997230.508240:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689882bda00) 00010000:00010000:1.0:1780997230.508242:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997230.508244:0:63419:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780997230.508548:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:71279:x1867507110412544:12345-192.168.206.51@tcp:36:mcreate.0 Request processed in 1071us (1306us total) trans 115964117003 rc 0/0 00000100:00100000:1.0:1780997230.508556:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1394 00000100:00100000:1.0:1780997230.510108:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997230.510127:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126982912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997230.510182:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997230.510267:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126982912 00000100:00100000:0.0:1780997230.510308:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126982912 00000100:00100000:0.0:1780997230.510353:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:0.0:1780997230.510362:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126982912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780997230.510381:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997230.510426:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126982912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997230.510433:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:0.0:1780997230.510474:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126982912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780997230.549747:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997230.549854:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110412672 00000100:00100000:0.0:1780997230.549866:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110412672 00000100:00100000:0.0:1780997230.549920:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1395 00000100:00100000:0.0:1780997230.549931:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:71282:x1867507110412672:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1780997230.549970:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997230.549993:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffce00/0x30fd811c0305b354 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e08 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.550062:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305b35b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.550077:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305b35b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.550088:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305b35b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997230.550131:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780997230.550135:0:63584:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997230.550157:0:63584:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305b35b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.550182:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffce00/0x30fd811c0305b354 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e08 expref: 13 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.550199:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305b35b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e08 expref: 12 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.550208:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:0.0:1780997230.550211:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780997230.550215:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffdc00, rc 0) 00000100:00100000:0.0:1780997230.550506:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:71282:x1867507110412672:12345-192.168.206.51@tcp:101:rm.0 Request processed in 576us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997230.550516:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1395 00000100:00100000:2.0:1780997230.561133:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997230.561223:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110412800 00000100:00100000:0.0:1780997230.561233:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110412800 00000100:00100000:0.0:1780997230.561334:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1396 00000100:00100000:0.0:1780997230.561345:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:71282:x1867507110412800:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1780997230.561367:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997230.561388:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc600/0x30fd811c0305b362 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e0f expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561454:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305b369 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561468:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305b369 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561479:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305b369 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561490:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b370 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561498:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561504:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561586:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b377 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561594:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b377 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561617:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b377 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997230.561660:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x3:0x0]: returning size 0 00000004:00200000:0.0:1780997230.561664:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997230.561682:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b377 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561693:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b377 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561701:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305b369 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561707:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305b369 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561730:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305b369 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561737:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305b369 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561743:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffda00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997230.561747:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305b369 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561755:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305b369 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561766:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:0.0:1780997230.561769:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997230.561780:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305b369 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561788:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305b369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561801:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561808:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b370 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561814:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b370 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561819:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffd600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997230.561822:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b370 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561828:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b370 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561835:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689882bda00) 00010000:00010000:0.0:1780997230.561838:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997230.561841:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b370 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561846:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b370 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561871:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc600/0x30fd811c0305b362 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e0f expref: 14 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561896:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b377 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e0f expref: 13 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.561902:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff96898a563b00) 00010000:00010000:0.0:1780997230.561904:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780997230.561906:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffd400, rc 0) 00000100:00100000:0.0:1780997230.561959:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:71282:x1867507110412800:12345-192.168.206.51@tcp:101:rm.0 Request processed in 615us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997230.561966:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1396 00000100:00100000:3.0:1780997230.570407:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997230.570506:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110413056 00000100:00100000:0.0:1780997230.570517:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110413056 00000100:00100000:0.0:1780997230.570577:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1397 00000100:00100000:0.0:1780997230.570587:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:71282:x1867507110413056:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:0.0:1780997230.570637:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1780997230.570660:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b377 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e0f expref: 13 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.570678:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff96898a563b00) 00010000:00010000:0.0:1780997230.570691:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305b35b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e08 expref: 12 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.570699:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:0.0:1780997230.570702:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997230.570719:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffce00/0x30fd811c0305b37e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.570746:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffce00/0x30fd811c0305b37e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.570755:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffce00/0x30fd811c0305b37e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.570765:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b385 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.570771:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b385 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.570777:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b385 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.570856:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd000/0x30fd811c0305b38c lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.570863:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd000/0x30fd811c0305b38c lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.570869:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd000/0x30fd811c0305b38c lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571033:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd200/0x30fd811c0305b393 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571041:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd200/0x30fd811c0305b393 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571049:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd200/0x30fd811c0305b393 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571064:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd200/0x30fd811c0305b393 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571070:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd200/0x30fd811c0305b393 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571076:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd200/0x30fd811c0305b393 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571098:0:63418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997230.571114:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd000/0x30fd811c0305b38c lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571120:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd000/0x30fd811c0305b38c lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571126:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd000/0x30fd811c0305b38c lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571132:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffd000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997230.571136:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd000/0x30fd811c0305b38c lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571144:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd000/0x30fd811c0305b38c lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571151:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff96898a563f00) 00010000:00010000:0.0:1780997230.571154:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1780997230.571157:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd000/0x30fd811c0305b38c lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571172:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd000/0x30fd811c0305b38c lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571187:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffce00/0x30fd811c0305b37e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571192:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffce00/0x30fd811c0305b37e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571198:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffce00/0x30fd811c0305b37e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571204:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffce00/0x30fd811c0305b37e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571208:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffce00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997230.571211:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffce00/0x30fd811c0305b37e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571217:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffce00/0x30fd811c0305b37e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571223:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:0.0:1780997230.571225:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997230.571227:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffce00/0x30fd811c0305b37e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571233:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffce00/0x30fd811c0305b37e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997230.571240:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008605ad2f reply state 000000007f00abf5 transno 115964117004 ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b385 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571256:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b385 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997230.571262:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689882bda00) 00010000:00010000:0.0:1780997230.571264:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997230.571266:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997230.571373:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:71282:x1867507110413056:12345-192.168.206.51@tcp:36:rm.0 Request processed in 787us (974us total) trans 115964117004 rc 0/0 00000100:00100000:0.0:1780997230.571380:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1397 00010000:00010000:3.0:1780997230.571691:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997230.571698:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd200/0x30fd811c0305b393 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997230.571705:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffd200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997230.571707:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd200/0x30fd811c0305b393 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997230.571714:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd200/0x30fd811c0305b393 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997230.571722:0:6339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff96898a563f00) 00010000:00010000:3.0:1780997230.571724:0:6339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1780997230.571727:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd200/0x30fd811c0305b393 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997230.571732:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd200/0x30fd811c0305b393 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997230.571753:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997230.571755:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997230.571757:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997231.336934:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997232.359327:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997233.061650:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997233.061678:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126983040:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997233.061763:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997233.062401:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997233.062413:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126983168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997233.062449:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997233.062894:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126983040 00000100:00100000:2.0:1780997233.063265:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126983040 00000100:00100000:2.0:1780997233.063336:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126983168 00000100:00100000:2.0:1780997233.063339:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126983168 00000100:00100000:2.0:1780997233.063362:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00100000:2.0:1780997233.063371:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126983040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997233.063401:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997233.063453:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126983040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997233.063460:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00100000:2.0:1780997233.063476:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:2.0:1780997233.063482:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126983168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780997233.063510:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997233.063546:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126983168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (1096us total) trans 0 rc 0/0 00000100:00080000:0.0:1780997233.063746:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997233.063750:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997233.065029:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00100000:2.0:1780997233.066106:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126983168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997233.066189:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126983040:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1780997233.382037:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997234.405537:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997235.110217:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126983296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780997235.110322:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.110458:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126983296 00000100:00100000:1.0:1780997235.110465:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126983296 00000100:00100000:1.0:1780997235.110510:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4080 00000100:00100000:1.0:1780997235.110520:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126983296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780997235.110556:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:1.0:1780997235.110597:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507126983296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.110604:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4080 00000100:00100000:1.0:1780997235.110625:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507126983552:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.110649:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.110665:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126984064:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.110682:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.110695:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126984576:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.110714:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.110729:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1780997235.110734:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126983680:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.110751:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.110763:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126984192:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.110778:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.110790:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126984704:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.110807:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.110830:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126984064 00000100:00100000:1.0:1780997235.110833:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126984064 00000100:00100000:1.0:1780997235.110854:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4081 00000100:00100000:1.0:1780997235.110859:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507126984064:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780997235.110876:0:8241:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b7f13480 x1867507126984064/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:566/0 lens 224/224 e 0 to 0 dl 1780997246 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997235.110910:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507126984064:12345-0@lo:400:kworker.0 Request processed in 51us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.110916:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4081 00000100:00100000:1.0:1780997235.110932:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126983552 00000100:00100000:1.0:1780997235.110934:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126983552 00000100:00100000:1.0:1780997235.110960:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126983680 00000100:00100000:1.0:1780997235.110962:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126983680 00000100:00100000:1.0:1780997235.110977:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:1.0:1780997235.110982:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507126983552:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780997235.110993:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b7f10e00 x1867507126983552/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:566/0 lens 224/224 e 0 to 0 dl 1780997246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997235.111016:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507126983552:12345-0@lo:400:kworker.0 Request processed in 35us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.111022:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:1.0:1780997235.111030:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1780997235.111035:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126983680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.111053:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126983680:12345-0@lo:400:kworker.0 Request processed in 19us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.111059:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1780997235.111079:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126984576 00000100:00100000:1.0:1780997235.111081:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126984576 00000100:00100000:1.0:1780997235.111105:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126984192 00000100:00100000:1.0:1780997235.111108:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126984192 00000100:00100000:1.0:1780997235.111124:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126984704 00000100:00100000:1.0:1780997235.111127:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126984704 00000100:00100000:1.0:1780997235.111145:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644 00000100:00100000:1.0:1780997235.111151:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126984576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.111187:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126984576:12345-0@lo:400:kworker.0 Request processed in 37us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.111193:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644 00000100:00100000:1.0:1780997235.111205:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645 00000100:00100000:1.0:1780997235.111211:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126984192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.111233:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126984192:12345-0@lo:400:kworker.0 Request processed in 23us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.111238:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645 00000100:00100000:1.0:1780997235.111263:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646 00000100:00100000:1.0:1780997235.111286:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126984704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.111314:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126984704:12345-0@lo:400:kworker.0 Request processed in 45us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.111319:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646 00000100:00080000:1.0:1780997235.111340:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997235.111344:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997235.111346:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997235.111347:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997235.111370:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126983424:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.111398:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.111423:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126983936:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.111443:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.111460:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126984448:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.111479:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.111497:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1780997235.111503:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126983808:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.111534:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.111550:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126984320:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.111568:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.111582:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126984832:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.111601:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.111623:0:88345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126983424 00000100:00100000:1.0:1780997235.111626:0:88345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126983424 00000100:00100000:1.0:1780997235.111652:0:88345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1780997235.111659:0:88345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bae33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126983424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.111691:0:88345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bae33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507126983424:12345-0@lo:400:kworker.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.111697:0:88345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1780997235.111720:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126983936 00000100:00100000:1.0:1780997235.111723:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126983936 00000100:00100000:1.0:1780997235.111743:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126984448 00000100:00100000:1.0:1780997235.111745:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126984448 00000100:00100000:1.0:1780997235.111757:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126983808 00000100:00100000:1.0:1780997235.111759:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126983808 00000100:00100000:1.0:1780997235.111769:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126984832 00000100:00100000:1.0:1780997235.111771:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126984832 00000100:00100000:1.0:1780997235.111781:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1780997235.111786:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126983936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.111813:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126983936:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.111819:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1780997235.111829:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1780997235.111835:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126984448:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780997235.111853:0:63419:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc63a300 x1867507126984448/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:566/0 lens 224/224 e 0 to 0 dl 1780997246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997235.111879:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507126984448:12345-0@lo:400:kworker.0 Request processed in 45us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.111886:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1780997235.111898:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1780997235.111904:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126983808:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780997235.111914:0:63419:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc638380 x1867507126983808/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:566/0 lens 224/224 e 0 to 0 dl 1780997246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997235.111937:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507126983808:12345-0@lo:400:kworker.0 Request processed in 34us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.111943:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1780997235.111953:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1780997235.111958:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126984832:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780997235.111968:0:63419:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc639180 x1867507126984832/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:566/0 lens 224/224 e 0 to 0 dl 1780997246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997235.111991:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507126984832:12345-0@lo:400:kworker.0 Request processed in 34us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.111997:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1780997235.112013:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126984320 00000100:00100000:1.0:1780997235.112016:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126984320 00000100:00100000:1.0:1780997235.112037:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647 00000100:00100000:1.0:1780997235.112043:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126984320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.112071:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126984320:12345-0@lo:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.112086:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647 00000100:00080000:1.0:1780997235.112108:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997235.112111:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780997235.112112:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997235.112148:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126983296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780997235.112179:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126983680:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.112189:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126984192:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.112198:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126984704:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.112207:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507126983552:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.112216:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126984064:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.112226:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126984576:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.112291:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507126983808:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.112303:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126984320:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.112312:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507126984832:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.112320:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126983424:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.112328:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126983936:0@lo:400:kworker.0 00000100:00100000:1.0:1780997235.112336:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507126984448:0@lo:400:kworker.0 00000100:00100000:2.0:1780997235.113007:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997235.113019:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126984960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997235.113060:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997235.113122:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126984960 00000100:00100000:0.0:1780997235.113128:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126984960 00000100:00100000:0.0:1780997235.113227:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4082 00000100:00100000:0.0:1780997235.113238:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507126984960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780997235.113295:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445183488 avail 1298944000 00010000:00000080:0.0:1780997235.113311:0:8242:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968888cd5c00 x1867507126984960/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:566/0 lens 224/368 e 0 to 0 dl 1780997246 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997235.113347:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507126984960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997235.113353:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4082 00000100:00100000:2.0:1780997235.113430:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126984960:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1780997235.429470:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997235.459646:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997235.459688:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997235.459728:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997235.459771:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997235.459797:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997235.459824:0:88344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110413184 00000100:00100000:1.0:1780997235.459835:0:88344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110413184 00000100:00100000:1.0:1780997235.459895:0:88344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 178 00000100:00100000:1.0:1780997235.459907:0:88344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b175c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110413184:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997235.459992:0:88344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b175c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110413184:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.460000:0:88344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 178 00000100:00100000:1.0:1780997235.460033:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110413312 00000100:00100000:1.0:1780997235.460037:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110413312 00000100:00100000:1.0:1780997235.460070:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110413440 00000100:00100000:1.0:1780997235.460073:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110413440 00000100:00100000:1.0:1780997235.460092:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1357 00000100:00100000:1.0:1780997235.460099:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:2395:x1867507110413312:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000080:1.0:1780997235.460132:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc638000 x1867507110413312/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:566/0 lens 224/224 e 0 to 0 dl 1780997246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997235.460156:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:2395:x1867507110413312:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 58us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.460163:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1357 00000100:00100000:1.0:1780997235.460188:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1358 00000100:00100000:1.0:1780997235.460194:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110413440:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997235.460216:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110413440:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 22us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.460222:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1358 00000100:00100000:1.0:1780997235.460258:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110413568 00000100:00100000:1.0:1780997235.460261:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110413568 00000100:00100000:1.0:1780997235.460320:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110413696 00000100:00100000:1.0:1780997235.460323:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110413696 00000100:00100000:1.0:1780997235.460348:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2648 00000100:00100000:1.0:1780997235.460353:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2395:x1867507110413568:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997235.460379:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2395:x1867507110413568:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.460385:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2648 00000100:00100000:1.0:1780997235.460396:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2649 00000100:00100000:1.0:1780997235.460402:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110413696:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997235.460425:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110413696:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 23us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.460431:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2649 00000100:00080000:1.0:1780997235.460555:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997235.460560:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997235.460563:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997235.460565:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997235.622732:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126985088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997235.622807:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997235.622863:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126985088 00000100:00100000:1.0:1780997235.622871:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126985088 00000100:00100000:1.0:1780997235.622921:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:1.0:1780997235.622929:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126985088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780997235.622956:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780997235.623007:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507126985088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997235.623024:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:1.0:1780997235.623070:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507126985088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997235.625572:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126985216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997235.625649:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997235.632910:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126985216 00000100:00100000:0.0:1780997235.632924:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126985216 00000100:00100000:0.0:1780997235.632976:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:0.0:1780997235.632999:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126985216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780997235.633033:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997235.633122:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507126985216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (7472us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997235.633129:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:0.0:1780997235.639972:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126985216:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1780997236.454180:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1780997236.645703:0:88340:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117004 is committed 00010000:00010000:2.0:1780997236.645986:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b34d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.646002:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b34d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.646009:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b34d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.646016:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997236.646022:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b34d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.646030:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b34d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.646052:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689882bda00) 00010000:00010000:2.0:1780997236.646061:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997236.646066:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b34d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.646073:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03c00/0x30fd811c0305b34d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.646093:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b385 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.646100:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b385 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.646105:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b385 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.646110:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffc800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997236.646112:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b385 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.646117:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b385 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.646123:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689882bda00) 00010000:00010000:2.0:1780997236.646125:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997236.646128:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b385 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.646133:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc800/0x30fd811c0305b385 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1780997236.647690:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000001:02000400:0.0:1780997236.654011:0:89518:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1780997236.752415:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997236.752530:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110413824 00000100:00100000:1.0:1780997236.752542:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110413824 00000100:00100000:1.0:1780997236.752615:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1398 00000100:00100000:1.0:1780997236.752629:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71349:x1867507110413824:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997236.752656:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997236.752680:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b39a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e16 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.752758:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305b3a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.752774:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305b3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.752787:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305b3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997236.752838:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780997236.752842:0:63584:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780997236.752882:0:63584:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305b3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.752908:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff02600/0x30fd811c0305b39a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e16 expref: 11 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.752946:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305b3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e16 expref: 10 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.752957:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96898d864700) 00010000:00010000:1.0:1780997236.752960:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780997236.752963:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03a00, rc 0) 00010000:00000080:1.0:1780997236.752971:0:63584:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968888cd4000 x1867507110413824/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:567/0 lens 576/688 e 0 to 0 dl 1780997247 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997236.753038:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71349:x1867507110413824:12345-192.168.206.51@tcp:101:touch.0 Request processed in 413us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997236.753044:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1398 00000100:00100000:1.0:1780997236.760388:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997236.760542:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110413952 00000100:00100000:2.0:1780997236.760554:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110413952 00000100:00100000:2.0:1780997236.760626:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1399 00000100:00100000:2.0:1780997236.760638:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71349:x1867507110413952:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:2.0:1780997236.760665:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997236.760691:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305b3a8 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e1d expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760766:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305b3af lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760783:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305b3af lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760796:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305b3af lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760811:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b3b6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760818:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b3b6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760825:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b3b6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760877:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454400/0x30fd811c0305b3bd lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760886:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454400/0x30fd811c0305b3bd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760905:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454400/0x30fd811c0305b3bd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997236.760942:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454400/0x30fd811c0305b3bd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760957:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305b3af lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760963:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305b3af lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760970:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305b3af lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760976:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305b3af lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760983:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997236.760987:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305b3af lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.760995:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305b3af lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.761007:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689964dc000) 00010000:00010000:2.0:1780997236.761010:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997236.761015:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305b3af lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.761020:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455a00/0x30fd811c0305b3af lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.761042:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b3b6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.761047:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b3b6 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.761054:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b3b6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.761060:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997236.761064:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b3b6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.761070:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b3b6 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.761077:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9689964dc700) 00010000:00010000:2.0:1780997236.761079:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997236.761082:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b3b6 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.761087:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455000/0x30fd811c0305b3b6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.761121:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba455200/0x30fd811c0305b3a8 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e1d expref: 12 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.761134:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454400/0x30fd811c0305b3bd lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e1d expref: 11 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.761152:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9689964dce00) 00010000:00010000:2.0:1780997236.761154:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780997236.761156:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454400, rc 0) 00010000:00000080:2.0:1780997236.761165:0:63417:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc63b480 x1867507110413952/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:567/0 lens 576/584 e 0 to 0 dl 1780997247 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997236.761261:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:71349:x1867507110413952:12345-192.168.206.51@tcp:101:touch.0 Request processed in 626us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997236.761289:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1399 00000100:00100000:3.0:1780997236.765337:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997236.767709:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110414080 00000100:00100000:1.0:1780997236.767726:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110414080 00000100:00100000:1.0:1780997236.767813:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1400 00000100:00100000:1.0:1780997236.767826:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:71349:x1867507110414080:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997236.767849:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997236.767875:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02600/0x30fd811c0305b3c4 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e24 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.767949:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b3cb lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.767966:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b3cb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.767995:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b3cb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997236.768047:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1780997236.768051:0:80049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1780997236.768108:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02600/0x30fd811c0305b3c4 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e24 expref: 7 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.768126:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02e00/0x30fd811c0305b3cb lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e24 expref: 6 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.768135:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9689882bd900) 00010000:00010000:1.0:1780997236.768138:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1780997236.768142:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02e00, rc 0) 00000100:00100000:1.0:1780997236.768243:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:71349:x1867507110414080:12345-192.168.206.51@tcp:101:touch.0 Request processed in 410us (2909us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997236.768252:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1400 00000100:00100000:2.0:1780997236.772802:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997236.772854:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997236.772944:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110414464 00000100:00100000:3.0:1780997236.772957:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110414464 00000100:00100000:3.0:1780997236.773036:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 695 00000100:00100000:3.0:1780997236.773046:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2394:x1867507110414464:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780997236.773065:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997236.773095:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454400/0x30fd811c0305b3bd lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e1d expref: 11 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.773115:0:8261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9689964dce00) 00010000:00010000:3.0:1780997236.773120:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997236.773176:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2394:x1867507110414464:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 132us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997236.773183:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 695 00000100:00100000:1.0:1780997236.774587:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110414336 00000100:00100000:1.0:1780997236.774600:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110414336 00000100:00100000:1.0:1780997236.774656:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1401 00000100:00100000:1.0:1780997236.774666:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:71349:x1867507110414336:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997236.774688:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997236.774711:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02600/0x30fd811c0305b3d2 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e2b expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.774872:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b3d9 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.774909:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b3d9 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.774923:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b3d9 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.774940:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b3e0 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.774948:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b3e0 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.774955:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b3e0 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997236.775129:0:63584:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc639500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:63584:1867507126985344:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780997236.775226:0:63584:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997236.775322:0:63584:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5540 going to sleep for 11 seconds 00000100:00100000:3.0:1780997236.775472:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126985344 00000100:00100000:3.0:1780997236.775479:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126985344 00000100:00100000:3.0:1780997236.775513:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4083 00000100:00100000:3.0:1780997236.775521:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63584:x1867507126985344:12345-0@lo:1000:mdt00_003.0 00010000:00000080:3.0:1780997236.775567:0:80061:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc63aa00 x1867507126985344/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:567/0 lens 328/4320 e 0 to 0 dl 1780997247 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997236.775631:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63584:x1867507126985344:12345-0@lo:1000:mdt00_003.0 Request processed in 111us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997236.775639:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4083 00000100:00100000:2.0:1780997236.775730:0:63584:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc639500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:63584:1867507126985344:0@lo:1000:mdt00_003.0 00000004:00080000:2.0:1780997236.776054:0:63584:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x623:0x0], index 1: 0 00010000:00010000:2.0:1780997236.776227:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455200/0x30fd811c0305b3e7 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776253:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455200/0x30fd811c0305b3e7 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776263:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455200/0x30fd811c0305b3e7 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776333:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b3d9 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776342:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b3d9 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776349:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b3d9 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776365:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b3d9 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776371:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997236.776377:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b3d9 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776386:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b3d9 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776400:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9689882bd900) 00010000:00010000:2.0:1780997236.776403:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997236.776407:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b3d9 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776413:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b3d9 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997236.776428:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009136e05c reply state 00000000bf3f5a6f transno 81604378761 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b3e0 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776439:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b3e0 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776446:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff9689882bd700) 00010000:00010000:2.0:1780997236.776448:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997236.776451:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780997236.776487:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02600/0x30fd811c0305b3d2 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e2b expref: 9 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776502:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455200/0x30fd811c0305b3e7 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e2b expref: 8 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.776516:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9689964dc700) 00010000:00010000:2.0:1780997236.776519:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997236.776521:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455200, rc 0) 00000100:00100000:2.0:1780997236.776589:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71349:x1867507110414336:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1925us (3803us total) trans 81604378761 rc 0/0 00000100:00100000:2.0:1780997236.776597:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1401 00000100:00100000:2.0:1780997236.784109:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997236.784641:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110414720 00000100:00100000:3.0:1780997236.784651:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110414720 00000100:00100000:3.0:1780997236.784713:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1402 00000100:00100000:3.0:1780997236.784725:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71349:x1867507110414720:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:3.0:1780997236.784785:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997236.784812:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455200/0x30fd811c0305b3e7 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e2b expref: 9 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.784830:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9689964dc700) 00010000:00010000:3.0:1780997236.784842:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997236.784911:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b3f5 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.784927:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b3f5 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.784938:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b3f5 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997236.785068:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000028f82136 reply state 00000000d3211425 transno 81604378762 ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b3f5 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.785081:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b3f5 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.785087:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9689836c9c00) 00010000:00010000:3.0:1780997236.785102:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997236.785105:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780997236.785225:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71349:x1867507110414720:12345-192.168.206.51@tcp:36:touch.0 Request processed in 502us (1124us total) trans 81604378762 rc 0/0 00000100:00100000:3.0:1780997236.785255:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1402 00000100:00100000:3.0:1780997236.787987:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997236.788071:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110414848 00000100:00100000:0.0:1780997236.788081:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110414848 00000100:00100000:0.0:1780997236.788132:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1403 00000100:00100000:0.0:1780997236.788140:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71349:x1867507110414848:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997236.788164:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997236.788181:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b3fc lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e32 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.788256:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b3fc lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e32 expref: 11 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.788298:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffce00/0x30fd811c0305b3fc lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e32 expref: 11 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.788321:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9689836c9c00) 00010000:00010000:0.0:1780997236.788324:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780997236.788328:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffce00, rc 0) 00000100:00100000:0.0:1780997236.788393:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:71349:x1867507110414848:12345-192.168.206.51@tcp:101:touch.0 Request processed in 250us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997236.788413:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1403 00000100:00100000:3.0:1780997236.793602:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997236.793696:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110414976 00000100:00100000:0.0:1780997236.793712:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110414976 00000100:00100000:0.0:1780997236.793787:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5966 00000100:00100000:0.0:1780997236.793800:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110414976:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:0.0:1780997236.794100:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2394:x1867507110414976:12345-192.168.206.51@tcp:2:touch.0 Request processed in 303us (514us total) trans 4294969456 rc 0/0 00000100:00100000:0.0:1780997236.794109:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5966 00000100:00100000:3.0:1780997236.796913:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997236.797461:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110415232 00000100:00100000:0.0:1780997236.797473:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110415232 00000100:00100000:0.0:1780997236.797536:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 241 00000100:00100000:0.0:1780997236.797547:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:71349:x1867507110415232:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:0.0:1780997236.797899:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:71349:x1867507110415232:12345-192.168.206.51@tcp:35:touch.0 Request processed in 353us (998us total) trans 81604378763 rc 0/0 00000100:00100000:0.0:1780997236.797907:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 241 00000100:00100000:1.0:1780997236.819579:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997236.819656:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110415360 00000100:00100000:0.0:1780997236.819667:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110415360 00000100:00100000:0.0:1780997236.819750:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1404 00000100:00100000:0.0:1780997236.819764:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71350:x1867507110415360:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997236.819789:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997236.819815:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305b403 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e39 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.819888:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b40a lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.819929:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b40a lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.819943:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b40a lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.819964:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc600/0x30fd811c0305b411 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.819972:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc600/0x30fd811c0305b411 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.819978:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc600/0x30fd811c0305b411 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820046:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b418 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820054:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b418 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820061:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b418 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997236.820087:0:63418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b418 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820102:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b40a lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820108:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b40a lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820124:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b40a lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820130:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b40a lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820136:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffd400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997236.820140:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b40a lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820147:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b40a lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820160:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689964dc000) 00010000:00010000:0.0:1780997236.820163:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997236.820184:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b40a lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820191:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305b40a lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820365:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc600/0x30fd811c0305b411 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820372:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc600/0x30fd811c0305b411 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820378:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc600/0x30fd811c0305b411 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820383:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffc600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997236.820394:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc600/0x30fd811c0305b411 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820400:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc600/0x30fd811c0305b411 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820409:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff96898a563d00) 00010000:00010000:0.0:1780997236.820412:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997236.820415:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc600/0x30fd811c0305b411 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820421:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc600/0x30fd811c0305b411 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820463:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305b403 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e39 expref: 12 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820477:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b418 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e39 expref: 11 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.820485:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689964dc600) 00010000:00010000:0.0:1780997236.820487:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780997236.820490:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffd600, rc 0) 00010000:00000080:0.0:1780997236.820501:0:63418:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc63ad80 x1867507110415360/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:567/0 lens 576/584 e 0 to 0 dl 1780997247 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997236.820585:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:71350:x1867507110415360:12345-192.168.206.51@tcp:101:touch.0 Request processed in 825us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997236.820594:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1404 00000100:00100000:1.0:1780997236.836836:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997236.836894:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997236.838537:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110415488 00000100:00100000:1.0:1780997236.838557:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110415488 00000100:00100000:1.0:1780997236.838646:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1405 00000100:00100000:1.0:1780997236.838840:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:71350:x1867507110415488:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997236.838873:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997236.838907:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02600/0x30fd811c0305b41f lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e40 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.838996:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b426 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.839011:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b426 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.839480:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b426 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997236.839533:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1780997236.839536:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1780997236.839580:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02600/0x30fd811c0305b41f lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e40 expref: 14 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.839601:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03e00/0x30fd811c0305b426 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e40 expref: 13 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997236.839611:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689882bd300) 00010000:00010000:1.0:1780997236.839614:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1780997236.839618:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03e00, rc 0) 00000100:00100000:1.0:1780997236.839691:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:71350:x1867507110415488:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1035us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997236.841355:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1405 00000100:00100000:3.0:1780997236.851125:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110415616 00000100:00100000:3.0:1780997236.851146:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110415616 00000100:00100000:3.0:1780997236.851478:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 696 00000100:00100000:3.0:1780997236.851491:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b6209850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2396:x1867507110415616:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780997236.851508:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997236.851604:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd600/0x30fd811c0305b418 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e39 expref: 11 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.851625:0:6336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689964dc600) 00010000:00010000:3.0:1780997236.851632:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997236.851709:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b6209850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2396:x1867507110415616:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 219us (14813us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997236.851718:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 696 00000100:00100000:3.0:1780997236.857155:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997236.862381:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110415872 00000100:00100000:3.0:1780997236.862399:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110415872 00000100:00100000:3.0:1780997236.862472:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1406 00000100:00100000:3.0:1780997236.862482:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:71350:x1867507110415872:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:3.0:1780997236.862503:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997236.862550:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b42d lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e47 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.862662:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b434 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.862680:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b434 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.862694:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b434 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.862709:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b43b lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.862716:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b43b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.862723:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b43b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780997236.863078:0:80049:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x624:0x0], index 1: 0 00010000:00010000:3.0:1780997236.863257:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305b442 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.863267:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305b442 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.863315:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305b442 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.863357:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b434 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.863379:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b434 lrc: 2/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.863385:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b434 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.863392:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2055e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997236.863398:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b434 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.863405:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b434 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.863420:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689882bd300) 00010000:00010000:3.0:1780997236.863423:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997236.863429:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b434 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.863435:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b434 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997236.863453:0:80049:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a6d8bca reply state 0000000019b9257d transno 81604378764 ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b43b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.863464:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b43b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.863470:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff9689836c9900) 00010000:00010000:3.0:1780997236.863472:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997236.863475:0:80049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1780997236.863508:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b42d lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e47 expref: 16 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.863528:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305b442 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e47 expref: 15 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997236.863535:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9689836c9b00) 00010000:00010000:3.0:1780997236.863537:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780997236.863540:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3200, rc 0) 00000100:00100000:3.0:1780997236.863631:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+16:71350:x1867507110415872:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1150us (6486us total) trans 81604378764 rc 0/0 00000100:00100000:3.0:1780997236.863639:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1406 00000100:00100000:3.0:1780997236.877066:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997236.877229:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110416128 00000100:00100000:0.0:1780997236.877265:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110416128 00000100:00100000:0.0:1780997236.877356:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1407 00000100:00100000:0.0:1780997236.877370:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+16:71350:x1867507110416128:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:0.0:1780997236.877460:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997236.877491:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305b442 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e47 expref: 16 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.877509:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9689836c9b00) 00010000:00010000:0.0:1780997236.877524:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997236.877601:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b450 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.877618:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b450 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.877629:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b450 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997236.879915:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004879e4a8 reply state 00000000722a676a transno 81604378765 ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b450 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.879947:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b450 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997236.879957:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff96898a563d00) 00010000:00010000:0.0:1780997236.879960:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997236.879963:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997236.880711:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+17:71350:x1867507110416128:12345-192.168.206.51@tcp:36:touch.0 Request processed in 3338us (3649us total) trans 81604378765 rc 0/0 00000100:00100000:0.0:1780997236.880723:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1407 00000100:00100000:1.0:1780997236.886437:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997236.891208:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110416256 00000100:00100000:3.0:1780997236.891228:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110416256 00000100:00100000:2.0:1780997236.892230:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1408 00000100:00100000:2.0:1780997236.892252:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+17:71350:x1867507110416256:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:2.0:1780997236.892314:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997236.892341:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455a00/0x30fd811c0305b457 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e4e expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.892411:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455a00/0x30fd811c0305b457 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e4e expref: 18 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.892427:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba455a00/0x30fd811c0305b457 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e4e expref: 18 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997236.892449:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff96898a563d00) 00010000:00010000:2.0:1780997236.892746:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1780997236.892752:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455a00, rc 0) 00000100:00100000:2.0:1780997236.892830:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+18:71350:x1867507110416256:12345-192.168.206.51@tcp:101:touch.0 Request processed in 581us (6402us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997236.892838:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1408 00000100:00100000:3.0:1780997236.896801:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997236.897742:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110416384 00000100:00100000:1.0:1780997236.897756:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110416384 00000100:00100000:1.0:1780997236.897830:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5967 00000100:00100000:1.0:1780997236.897842:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2395:x1867507110416384:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:1.0:1780997236.898107:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110416384:12345-192.168.206.51@tcp:2:touch.0 Request processed in 268us (1581us total) trans 4294969457 rc 0/0 00000100:00100000:1.0:1780997236.898116:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5967 00000100:00100000:3.0:1780997236.916722:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997236.916861:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110416640 00000100:00100000:1.0:1780997236.916877:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110416640 00000100:00100000:1.0:1780997236.916955:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 242 00000100:00100000:1.0:1780997236.916966:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+18:71350:x1867507110416640:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:1.0:1780997236.917427:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+19:71350:x1867507110416640:12345-192.168.206.51@tcp:35:touch.0 Request processed in 462us (725us total) trans 81604378766 rc 0/0 00000100:00100000:1.0:1780997236.917437:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 242 00010000:00010000:3.0:1780997237.477759:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997238.181500:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126985472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997238.181574:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997238.181637:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126985472 00000100:00100000:2.0:1780997238.181646:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126985472 00000100:00100000:2.0:1780997238.181710:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00100000:2.0:1780997238.181720:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126985472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997238.181748:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997238.181794:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126985472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997238.181801:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00080000:2.0:1780997238.181824:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997238.181882:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126985472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997238.183375:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126985600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997238.183429:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997238.183511:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126985600 00000100:00100000:1.0:1780997238.183518:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126985600 00000100:00100000:1.0:1780997238.183563:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:1.0:1780997238.183571:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126985600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997238.183592:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997238.183631:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126985600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997238.183639:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:1.0:1780997238.183680:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126985600:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1780997238.183863:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1780997238.512427:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1780997238.798217:0:89615:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1780997238.798933:0:89615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.798952:0:89615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.798961:0:89615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.798969:0:89615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.799015:0:89615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1780997238.799022:0:89615:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1780997238.799053:0:89615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1780997238.799058:0:89615:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1780997238.799064:0:89615:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1780997238.799093:0:89615:0:(import.c:65:import_set_state_nolock()) ffff9689bc969000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1780997238.799143:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997238.799150:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997238.799157:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03000 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997238.799161:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997238.799170:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997238.799177:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997238.799183:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1780997238.799192:0:14480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1780997238.799195:0:14480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1780997238.799238:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997238.799245:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997238.799291:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997238.799299:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03000/0x30fd811c0305b16a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b171 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997238.799311:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997238.799313:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997238.799314:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997238.799323:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126985856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997238.799372:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126985728:0@lo:39:umount.0 00000100:00100000:3.0:1780997238.799393:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997238.799403:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997238.799447:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126985856 00000100:00100000:2.0:1780997238.799454:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126985856 00000100:00100000:2.0:1780997238.799504:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1780997238.799512:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507126985856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997238.799524:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997238.799538:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b171 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305b16a expref: 23 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997238.799551:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997238.799806:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126985728 00000100:00100000:1.0:1780997238.799817:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126985728 00000100:00100000:1.0:1780997238.799861:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1780997238.799869:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1867507126985728:12345-0@lo:39:umount.0 00000020:00000080:1.0:1780997238.799895:0:80049:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305adc7 00000100:00080000:1.0:1780997238.799910:0:80049:0:(import.c:65:import_set_state_nolock()) ffff9689bd36c000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1780997238.799944:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:1.0:1780997238.799945:0:80049:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b7a4ed80 x1867507126985728/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:569/0 lens 224/224 e 0 to 0 dl 1780997249 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997238.800004:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3495:x1867507126985728:12345-0@lo:39:umount.0 Request processed in 136us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997238.800011:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00080000:3.0:1780997238.800066:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bc969000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1780997238.800083:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507126985728:0@lo:39:umount.0 00000100:00100000:2.0:1780997238.800104:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3496:x1867507126985856:12345-0@lo:103:ldlm_bl.0 Request processed in 592us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997238.800111:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00080000:0.0:1780997238.800136:0:89615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1780997238.800140:0:89615:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1780997238.800142:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126985856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997238.800203:0:89615:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1780997238.800405:0:80049:0:(genops.c:906:class_export_put()) final put ffff9689bc96b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1780997238.800519:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1780997238.800575:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bd36c000 for lustre-MDT0000 00010000:00010000:0.0:1780997238.802143:0:89615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997238.802219:0:89615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997238.802234:0:89615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997238.802241:0:89615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997238.802442:0:89615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997238.802459:0:89615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997238.802465:0:89615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997238.802473:0:89615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997238.802479:0:89615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.802687:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997238.802695:0:89615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997238.802704:0:89615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997238.802711:0:89615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997238.802718:0:89615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997238.802724:0:89615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.802736:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.802744:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03800 already unused, calling callback (ffffffffc14fac20) 00010000:00010000:2.0:1780997238.802745:0:89615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:00010000:3.0:1780997238.802748:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997238.802751:0:89615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997238.802758:0:89615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.802759:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997238.802765:0:89615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997238.802767:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997238.802773:0:89615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997238.802774:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1780997238.802776:0:6340:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1780997238.802784:0:89615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1780997238.802787:0:89615:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1780997238.802791:0:89615:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1780997238.802810:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1780997238.802819:0:89615:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00010000:00010000:3.0:1780997238.802823:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000020:01000000:2.0:1780997238.802823:0:89615:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1780997238.802832:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1780997238.802837:0:89615:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1780997238.802857:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.802864:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03800/0x30fd811c0305b178 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b17f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.802877:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780997238.802880:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.802886:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3e00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997238.802889:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.802895:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997238.802902:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997238.802907:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1780997238.802909:0:6340:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1780997238.802911:0:6340:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1780997238.802925:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.802930:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997238.802944:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.802959:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968983ce3e00/0x30fd811c0305ace7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305acee expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.802968:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997238.802970:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.802975:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955400 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997238.802978:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.802984:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997238.802991:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997238.802996:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1780997238.802998:0:6340:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1780997238.803000:0:6340:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1780997238.803015:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.803021:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997238.803027:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.803033:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968888955400/0x30fd811c0305acb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305acbd expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.803053:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997238.803057:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.803062:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954200 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997238.803066:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.803072:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997238.803079:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997238.803084:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1780997238.803086:0:6340:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1780997238.803087:0:6340:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1780997238.803101:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.803107:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997238.803113:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.803120:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968888954200/0x30fd811c0305abdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305abe4 expref: -99 pid: 88339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.803130:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997238.803131:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997238.803138:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997238.803186:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126986112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997238.803338:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997238.804435:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997238.804827:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997238.804891:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780997238.804901:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126986240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997238.804946:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997238.804990:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126986112 00000100:00100000:3.0:1780997238.804996:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126986112 00000100:00100000:3.0:1780997238.805041:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126986240 00000100:00100000:3.0:1780997238.805044:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126986240 00000100:00100000:3.0:1780997238.805064:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:3.0:1780997238.805072:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507126986112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997238.805101:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997238.805121:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888954e00/0x30fd811c0305acee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305ace7 expref: 23 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.805138:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997238.805172:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3498:x1867507126986112:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997238.805180:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:3.0:1780997238.805196:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:3.0:1780997238.805203:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba657b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3498:x1867507126986240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997238.805210:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997238.805218:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc843800/0x30fd811c0305acbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305acb6 expref: 21 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.805238:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997238.805260:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba657b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3498:x1867507126986240:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (314us total) trans 0 rc 0/0 00000004:00000080:2.0:1780997238.805637:0:89615:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:3.0:1780997238.805767:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:3.0:1780997238.805796:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126985984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997238.805828:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1780997238.805852:0:89615:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000100:00100000:3.0:1780997238.805855:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00080000:2.0:1780997238.805858:0:89615:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689bc96a000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:3.0:1780997238.805860:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126986368:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1780997238.805864:0:89615:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689bc968800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780997238.805869:0:89615:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689bc96a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780997238.805876:0:89615:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689ba676000 e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 192.168.206.51@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 115964117004 stale:0 00000100:00100000:3.0:1780997238.805877:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1780997238.805880:0:89615:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9689ba672800 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 115964117002 stale:0 00000020:00080000:2.0:1780997238.805885:0:89615:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff96888ac54d40) has exports, disconnecting them 00000020:00080000:2.0:1780997238.805890:0:89615:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689bc96a000), last request at 1780997209 00000020:00000080:2.0:1780997238.805896:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305adc0 00000100:00100000:3.0:1780997238.805897:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126985984 00000100:00100000:3.0:1780997238.805901:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126985984 00000100:00080000:2.0:1780997238.805904:0:89615:0:(import.c:65:import_set_state_nolock()) ffff9689bc96f000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1780997238.805922:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126986368 00000020:00080000:2.0:1780997238.805922:0:89615:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bc96a000): rc 0 00000100:00100000:3.0:1780997238.805924:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126986368 00000020:00000080:2.0:1780997238.805925:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689bc96a000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1780997238.805934:0:89615:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689bc968800), last request at 1780997235 00000020:00000080:2.0:1780997238.805937:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305adb9 00000100:00100000:3.0:1780997238.805939:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00080000:2.0:1780997238.805941:0:89615:0:(import.c:65:import_set_state_nolock()) ffff9689bc96b800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1780997238.805944:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3497:x1867507126985984:12345-0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1780997238.805947:0:89615:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bc968800): rc 0 00000020:00000080:2.0:1780997238.805949:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689bc968800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1780997238.805952:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:2.0:1780997238.805953:0:89615:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689bc96a800), last request at 1780997235 00000020:00000080:2.0:1780997238.805955:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305adb2 00000100:00080000:2.0:1780997238.805958:0:89615:0:(import.c:65:import_set_state_nolock()) ffff9689bc96c800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1780997238.805962:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba454000/0x30fd811c0305b17f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305b178 expref: 21 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1780997238.805964:0:89615:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bc96a800): rc 0 00000020:00000080:2.0:1780997238.805966:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689bc96a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1780997238.805970:0:89615:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.206.51@tcp (ffff9689ba676000), last request at 1780997236 00010000:00010000:3.0:1780997238.805972:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:2.0:1780997238.805985:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac38 00000020:00010000:2.0:1780997238.805994:0:89615:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689ba676000: total 3 00000100:00100000:3.0:1780997238.805997:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3497:x1867507126985984:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (168us total) trans 0 rc 0/0 00000100:00080000:2.0:1780997238.805997:0:89615:0:(import.c:65:import_set_state_nolock()) ffff9688888d3000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1780997238.806002:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:3.0:1780997238.806015:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1780997238.806021:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3497:x1867507126986368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997238.806028:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:2.0:1780997238.806031:0:89615:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.206.51@tcp (ffff9689ba676000): rc 0 00000020:00080000:2.0:1780997238.806034:0:89615:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9689ba672800), last request at 1780997204 00010000:00010000:3.0:1780997238.806035:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce2400/0x30fd811c0305abe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305abdd expref: 19 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1780997238.806037:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac31 00000020:00010000:2.0:1780997238.806041:0:89615:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689ba672800: total 3 00010000:00010000:3.0:1780997238.806044:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1780997238.806044:0:89615:0:(import.c:65:import_set_state_nolock()) ffff96888969f000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780997238.806049:0:89615:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689ba672800): rc 0 00000004:00000080:2.0:1780997238.806055:0:89615:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa8c8c2c03ae0 00000100:00100000:3.0:1780997238.806070:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3497:x1867507126986368:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (192us total) trans 0 rc 0/0 00000100:00080000:2.0:1780997238.806071:0:89615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780997238.806075:0:89615:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1780997238.806077:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1780997238.806111:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126986368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997238.806119:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126985984:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1780997238.806891:0:89615:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1780997238.806914:0:89615:0:(import.c:65:import_set_state_nolock()) ffff9689869cb800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1780997238.807054:0:89615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780997238.807057:0:89615:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 3 00000004:00080000:2.0:1780997238.807066:0:89615:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780997238.807069:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126986240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997238.807078:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126986112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997238.807101:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126986496:0@lo:39:umount.0 00000100:00080000:2.0:1780997238.807123:0:89615:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1780997238.807132:0:89615:0:(import.c:65:import_set_state_nolock()) ffff9689bcb9d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1780997238.807138:0:89615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1780997238.807140:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997238.807140:0:89615:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 3 00000004:00080000:2.0:1780997238.807146:0:89615:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780997238.807178:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126986624:0@lo:9:umount.0 00000100:00100000:3.0:1780997238.807202:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997238.807246:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126986496 00000100:00100000:3.0:1780997238.807251:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126986496 00000020:00010000:1.0:1780997238.807286:0:37626:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689ba676000: total 3 00010000:00010000:1.0:1780997238.807339:0:37626:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689ba676000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1780997238.807370:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454a00/0x30fd811c0305b2d6 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dde expref: 5 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.807401:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b2ba lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dd7 expref: 4 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.807420:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03a00/0x30fd811c0305b3a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e16 expref: 3 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997238.807424:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4084 00000100:00100000:3.0:1780997238.807433:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126986496:12345-0@lo:39:umount.0 00010000:00010000:1.0:1780997238.807434:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454e00/0x30fd811c0305b315 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8df3 expref: 2 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.807445:0:37626:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689ba676000, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1780997238.807470:0:8242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac77 00000100:00080000:3.0:1780997238.807476:0:8242:0:(import.c:65:import_set_state_nolock()) ffff9689bcd7d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780997238.807488:0:8242:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378766 00000100:00100000:3.0:1780997238.807622:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3495:x1867507126986496:12345-0@lo:39:umount.0 Request processed in 191us (481us total) trans 81604378767 rc 0/0 00000100:00100000:3.0:1780997238.807629:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4084 00000100:00100000:3.0:1780997238.807650:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126986624 00000100:00100000:3.0:1780997238.807654:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126986624 00000100:00100000:3.0:1780997238.807688:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5968 00000100:00100000:3.0:1780997238.807693:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126986624:12345-0@lo:9:umount.0 00000020:00000080:3.0:1780997238.807714:0:8230:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac93 00000100:00080000:3.0:1780997238.807719:0:8230:0:(import.c:65:import_set_state_nolock()) ffff9689aebbb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780997238.807742:0:8230:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969455 00000100:00100000:3.0:1780997238.807821:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3495:x1867507126986624:12345-0@lo:9:umount.0 Request processed in 127us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997238.807827:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5968 00000100:00080000:3.0:1780997238.808040:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780997238.808065:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcb9d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1780997238.808070:0:3495:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:3.0:1780997238.808072:0:3495:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780997238.808075:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126986624:0@lo:9:umount.0 00000100:00080000:3.0:1780997238.808086:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689869cb800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1780997238.808089:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126986496:0@lo:39:umount.0 00000020:00010000:3.0:1780997238.808107:0:6340:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689ba672800: total 3 00010000:00010000:3.0:1780997238.808110:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997238.808132:0:6340:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689ba672800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1780997238.808660:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780997238.810706:0:89615:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1780997238.810750:0:89615:0:(import.c:65:import_set_state_nolock()) ffff9689aebbd800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1780997238.810824:0:89615:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff96888ac54d40) has no exports 00010000:00010000:3.0:1780997238.813154:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bff03200/0x30fd811c0305ade3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305addc expref: 2 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997238.813195:0:6340:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689ba672800, canceled 1 locks, left on hash table 0. 00000100:00100000:2.0:1780997238.813395:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126986752:0@lo:9:umount.0 00000100:00100000:2.0:1780997238.813462:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997238.813520:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126986752 00000100:00100000:2.0:1780997238.813541:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126986752 00000100:00100000:2.0:1780997238.813590:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5969 00000100:00100000:2.0:1780997238.813597:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507126986752:12345-0@lo:9:umount.0 00000020:00000080:2.0:1780997238.813623:0:25173:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305acaf 00000100:00080000:2.0:1780997238.813631:0:25173:0:(import.c:65:import_set_state_nolock()) ffff9689bcd7f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1780997238.813668:0:25173:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969457 00000100:00100000:2.0:1780997238.813796:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3495:x1867507126986752:12345-0@lo:9:umount.0 Request processed in 198us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997238.813803:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5969 00000100:00080000:2.0:1780997238.813843:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689aebbd800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1780997238.813849:0:3495:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:2.0:1780997238.813851:0:3495:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780997238.813855:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126986752:0@lo:9:umount.0 00010000:00010000:0.0:1780997238.817338:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780997238.819819:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96a000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1780997238.819883:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc968800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1780997238.819903:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc96a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1780997238.819920:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bc96f000 for lustre-MDT0000 00000020:00000080:0.0:1780997238.819924:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bc96b800 for lustre-MDT0000 00000020:00000080:0.0:1780997238.819926:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bc96c800 for lustre-MDT0000 00010000:00010000:0.0:1780997238.819938:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780997238.824566:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1780997238.827862:0:89615:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff96888ac54d40) has no exports 00000020:00000080:1.0:1780997238.843420:0:37626:0:(genops.c:906:class_export_put()) final put ffff9689ba676000/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00010000:00010000:1.0:1780997238.843456:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997238.843459:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997238.843462:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1780997238.843684:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba676000/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 for lustre-MDT0000 00000020:00000080:2.0:1780997238.843752:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9688888d3000 for lustre-MDT0000 00000020:00000080:3.0:1780997238.880883:0:6340:0:(genops.c:906:class_export_put()) final put ffff9689ba672800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1780997238.881244:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba672800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1780997238.881335:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888969f000 for lustre-MDT0000 00010000:00010000:2.0:1780997238.881349:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997238.881352:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997238.881354:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780997238.910689:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac4d 00000020:00000080:0.0:1780997238.910707:0:89615:0:(genops.c:906:class_export_put()) final put ffff96898616d800/lustre-QMT0000_UUID 00000020:01000000:0.0:1780997238.910733:0:89615:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1780997238.910958:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96898616d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1780997238.912234:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997238.912254:0:89615:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1780997238.912259:0:89615:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff968990fe0000) has no exports 00000020:00000080:2.0:1780997238.912891:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac46 00000020:00000080:2.0:1780997238.912900:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689bcd7b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1780997238.912951:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780997238.912960:0:89615:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1780997238.912963:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689bcd7c000/lustre-QMT0000_UUID 00000020:00000080:2.0:1780997238.912965:0:89615:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcd7c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1780997238.912981:0:89615:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1780997238.913010:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcd7b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1780997238.913182:0:89615:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968885f66840 - data ffff9689ae2d2798/ffff968886e55c00 00000020:01000000:2.0:1780997238.913438:0:89615:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968888e7f540 - data ffff9689ae3726c0/ffff9688858cec00 00000100:00080000:0.0:1780997238.958623:0:89615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1780997238.958633:0:89615:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1780997238.958648:0:89615:0:(client.c:3169:ptlrpc_free_committed()) @@@ free request with old gen req@ffff968988611f80 x1867507126986496/t81604378767(81604378767) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997248 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997238.958678:0:89615:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1780997238.964180:0:89615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1780997238.964189:0:89615:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 4 00000004:00080000:0.0:1780997238.964257:0:89615:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780997238.964260:0:89615:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1780997238.965184:0:88358:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1780997238.965189:0:88358:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:3.0:1780997238.965201:0:88358:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:0.0:1780997238.965952:0:89615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1780997238.965958:0:89615:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 4 00000004:00080000:0.0:1780997238.965968:0:89615:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780997238.965971:0:89615:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1780997238.966262:0:88360:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1780997238.966267:0:88360:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:1.0:1780997238.966298:0:88360:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:0.0:1780997238.968485:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac07 00000020:00000080:0.0:1780997238.968498:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689b79cd000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780997238.970112:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac1c 00000020:00000080:0.0:1780997238.970123:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689b11b8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1780997238.970129:0:89615:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1780997238.970147:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780997238.970156:0:89615:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1780997238.970159:0:89615:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff96888ac519c0) has no exports 00000004:01000000:0.0:1780997238.970402:0:89615:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1780997238.970411:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac9a 00000020:00000080:0.0:1780997238.970415:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689bc85a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1780997238.970419:0:89615:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1780997238.970423:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780997238.970429:0:89615:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1780997238.970431:0:89615:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff968886ec4d40) has no exports 00000020:00000080:0.0:1780997238.970438:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac8c 00000020:00000080:0.0:1780997238.970442:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689aebba000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780997238.970775:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b79cd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780997238.970785:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b11b8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1780997238.970789:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc85a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1780997238.970794:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689aebba000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1780997238.971661:0:89615:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1780997238.971667:0:89615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1780997238.971744:0:89615:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 5 00000004:00080000:0.0:1780997238.971752:0:89615:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780997238.971754:0:89615:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780997238.971856:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997238.971866:0:89615:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780997238.971873:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac7e 00000020:00000080:0.0:1780997238.971879:0:89615:0:(genops.c:906:class_export_put()) final put ffff968984dad800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1780997238.979514:0:89615:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1780997238.979558:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780997238.979574:0:89615:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1780997238.979580:0:89615:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff968886ec3380) has no exports 00000020:00000080:0.0:1780997238.979589:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac70 00000020:00000080:0.0:1780997238.979597:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689bc85f800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1780997238.979975:0:89615:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1780997238.979980:0:89615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1780997238.979985:0:89615:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 5 00000004:00080000:0.0:1780997238.979990:0:89615:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780997238.979993:0:89615:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780997238.980038:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780997238.980045:0:89615:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1780997238.980065:0:89615:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1780997238.980071:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac62 00000020:00000080:0.0:1780997238.980075:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689b79cb800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1780997238.980079:0:89615:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1780997238.980082:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780997238.980085:0:89615:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1780997238.980088:0:89615:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff968990fe19c0) has no exports 00000020:00000080:0.0:1780997238.980091:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac5b 00000020:00000080:0.0:1780997238.980094:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689869c9000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780997238.981854:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689aebbd800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1780997238.981868:0:36:0:(genops.c:906:class_export_put()) final put ffff9689891ad800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780997238.981872:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689891ad800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1780997238.981879:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997238.981966:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff968984dad800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1780997238.981973:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc85f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780997238.981978:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bcb9d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1780997238.981983:0:36:0:(genops.c:906:class_export_put()) final put ffff9689b79cb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780997238.981984:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b79cb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1780997238.981987:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997238.982009:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b79cb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1780997238.982013:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689869c9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1780997238.982552:0:89615:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1780997238.982557:0:89615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1780997238.982570:0:89615:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1780997238.982576:0:89615:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1780997238.982623:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997238.982634:0:89615:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997238.982656:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997238.982659:0:89615:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997238.982662:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689891ad000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780997238.982665:0:89615:0:(genops.c:865:class_export_destroy()) destroying export ffff9689891ad000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1780997238.982852:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689869cb800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1780997238.982859:0:36:0:(genops.c:906:class_export_put()) final put ffff9689b79c9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1780997238.982861:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b79c9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1780997238.982866:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1780997238.983006:0:89615:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997238.983068:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac23 00000020:00000080:1.0:1780997238.983075:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689b11bf800/lustre-MDD0000_UUID 00000020:01000000:1.0:1780997238.983089:0:89615:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1780997238.983093:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780997238.983098:0:89615:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1780997238.983101:0:89615:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9688858c19c0) has no exports 00000020:00000080:1.0:1780997238.983122:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997238.983126:0:89615:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1780997238.983129:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ac2a 00000020:00000080:1.0:1780997238.983133:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689b11b9800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1780997238.983139:0:89615:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689a5870800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1780997238.983142:0:89615:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689a5870800 3 00000020:01000004:1.0:1780997238.983145:0:89615:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9689a5870800 from lustre-MDT0000 00000020:00000080:1.0:1780997238.983160:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997238.983162:0:89615:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1780997238.983165:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689b79cd800/lustre-MDT0000_UUID 00000020:00000080:1.0:1780997238.983167:0:89615:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b79cd800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1780997238.983175:0:89615:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1780997238.983201:0:89615:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1780997238.983204:0:89615:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1780997238.983206:0:89615:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1780997238.983209:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780997238.983211:0:89615:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1780997238.983245:0:89615:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9689bcdf8800 bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780997238.983254:0:89615:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9689ba677000 cf5d474c-5b3a-4e23-b534-5ea64925b132 192.168.206.51@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780997238.983259:0:89615:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff96888ac50000) has exports, disconnecting them 00000020:00080000:1.0:1780997238.983263:0:89615:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9689bcdf8800), last request at 1780997203 00000020:00000080:1.0:1780997238.983301:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305abcf 00000020:00010000:1.0:1780997238.983306:0:89615:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689bcdf8800: total 2 00000100:00080000:1.0:1780997238.983311:0:89615:0:(import.c:65:import_set_state_nolock()) ffff9689bfab0800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780997238.983325:0:89615:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689bcdf8800): rc 0 00000020:00080000:1.0:1780997238.983329:0:89615:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.206.51@tcp (ffff9689ba677000), last request at 1780997196 00000020:00000080:1.0:1780997238.983365:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305abac 00000020:00010000:1.0:1780997238.983368:0:89615:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689ba677000: total 2 00000100:00080000:1.0:1780997238.983371:0:89615:0:(import.c:65:import_set_state_nolock()) ffff9689ba675000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780997238.983379:0:89615:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.206.51@tcp (ffff9689ba677000): rc 0 00000020:00080000:1.0:1780997238.983383:0:89615:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff96888ac50000) has no exports 00000100:00100000:1.0:1780997238.983435:0:88345:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff968886bd1a00:88345] 1 exiting: rc = 0 00000100:00100000:1.0:1780997238.983610:0:88344:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9689b7a4a600:88344] 0 exiting: rc = 1 00000100:00100000:1.0:1780997238.983663:0:88346:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff968886bd0400:88346] 2 exiting: rc = 0 00000020:00000080:3.0:1780997238.983827:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b11bf800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1780997238.983841:0:36:0:(genops.c:906:class_export_put()) final put ffff968990cc2000/lustre-MDD0000_UUID 00000020:00000080:3.0:1780997238.983843:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff968990cc2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1780997238.983847:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1780997238.983886:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b11b9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1780997238.984471:0:88351:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff968888e6f000:88351] 3 exiting: rc = 0 00000100:00100000:1.0:1780997238.984655:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984662:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984678:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984693:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984698:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984703:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984708:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984722:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984728:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984737:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984743:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984749:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984753:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984770:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984775:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984780:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984785:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984791:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984796:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984801:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984806:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984812:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984817:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.984822:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985112:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985125:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985131:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985137:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985154:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985159:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985164:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985169:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985175:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985180:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985185:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985191:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985197:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985202:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985207:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985212:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985218:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985236:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985242:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985247:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985253:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985258:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985264:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985299:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985315:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985321:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985329:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985335:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985340:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985348:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985354:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985360:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985365:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985371:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985377:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985382:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985387:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985393:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985401:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780997238.985407:0:89615:0:(events.c:346:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1780997238.986965:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff968888955200/0x30fd811c0305ad96 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x30fd811c0305ad8f expref: 14 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.986989:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888955200/0x30fd811c0305ad96 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x30fd811c0305ad8f expref: 14 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987007:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b15c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40106400000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8da6 expref: 5 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987017:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b15c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44907400000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8da6 expref: 5 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987026:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff968889ffd800/0x30fd811c0305b163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40106400000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dad expref: 4 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987035:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffd800/0x30fd811c0305b163 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44907400000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8dad expref: 4 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987058:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9689ba454800/0x30fd811c0305b18d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x30fd811c0305b186 expref: 13 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987068:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba454800/0x30fd811c0305b18d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x30fd811c0305b186 expref: 13 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987076:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9689ba455400/0x30fd811c0305b19b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x30fd811c0305b194 expref: 12 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987084:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455400/0x30fd811c0305b19b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x30fd811c0305b194 expref: 12 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987091:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9689ba455600/0x30fd811c0305b1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x30fd811c0305b1a2 expref: 11 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987098:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455600/0x30fd811c0305b1a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x30fd811c0305b1a2 expref: 11 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987105:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9689ba455e00/0x30fd811c0305b1b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x30fd811c0305b1b0 expref: 10 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987114:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455e00/0x30fd811c0305b1b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x30fd811c0305b1b0 expref: 10 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987122:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff968889ffc400/0x30fd811c0305b1c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x30fd811c0305b1be expref: 9 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987131:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffc400/0x30fd811c0305b1c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x30fd811c0305b1be expref: 9 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987149:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff968980031a00/0x30fd811c0305b1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x30fd811c0305b1cc expref: 8 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987158:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968980031a00/0x30fd811c0305b1d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x30fd811c0305b1cc expref: 8 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987167:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff968980031600/0x30fd811c0305b1e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x30fd811c0305b1da expref: 7 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987175:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968980031600/0x30fd811c0305b1e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x30fd811c0305b1da expref: 7 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987184:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff968888954800/0x30fd811c0305ad0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x30fd811c0305ad03 expref: 6 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987191:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888954800/0x30fd811c0305ad0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x30fd811c0305ad03 expref: 6 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987200:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff968983ce2c00/0x30fd811c0305adab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d4b expref: 3 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987208:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968983ce2c00/0x30fd811c0305adab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d4b expref: 3 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987219:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff968888955800/0x30fd811c0305ad26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x30fd811c0305ad1f expref: 5 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987239:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888955800/0x30fd811c0305ad26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x30fd811c0305ad1f expref: 5 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987264:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9689bc843200/0x30fd811c0305abc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d3d expref: 2 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987302:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc843200/0x30fd811c0305abc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8d3d expref: 2 pid: 88344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987311:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff968888955c00/0x30fd811c0305ad34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x30fd811c0305ad2d expref: 4 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987318:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968888955c00/0x30fd811c0305ad34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x30fd811c0305ad2d expref: 4 pid: 88346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987325:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9689bc842200/0x30fd811c0305ad5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x30fd811c0305ad57 expref: 3 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987331:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc842200/0x30fd811c0305ad5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x30fd811c0305ad57 expref: 3 pid: 88351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987339:0:89615:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9689bc843c00/0x30fd811c0305ad88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x30fd811c0305ad81 expref: 2 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997238.987346:0:89615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bc843c00/0x30fd811c0305ad88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x30fd811c0305ad81 expref: 2 pid: 88345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1780997238.987535:0:6339:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689bcdf8800: total 0 00010000:00010000:3.0:1780997238.987590:0:6339:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689bcdf8800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1780997238.987603:0:6339:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689bcdf8800, canceled 0 locks, left on hash table 0. 00000020:00000080:3.0:1780997238.987610:0:6339:0:(genops.c:906:class_export_put()) final put ffff9689bcdf8800/bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 00000020:00010000:3.0:1780997238.987629:0:6339:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689ba677000: total 1 00010000:00010000:3.0:1780997238.987646:0:6339:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689ba677000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1780997238.987657:0:6339:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689ba677000, canceled 0 locks, left on hash table 0. 00000020:00000080:3.0:1780997238.987664:0:6339:0:(genops.c:906:class_export_put()) final put ffff9689ba677000/cf5d474c-5b3a-4e23-b534-5ea64925b132 00010000:00010000:3.0:1780997238.987811:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997238.987814:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997238.987816:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1780997238.988322:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcdf8800/bdcd4e03-8d56-43b8-bfda-3b2f97e67d18 for MGS 00000020:00000080:1.0:1780997238.988360:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ba677000/cf5d474c-5b3a-4e23-b534-5ea64925b132 for MGS 00000020:00000080:1.0:1780997238.988378:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bfab0800 for MGS 00000020:00000080:1.0:1780997238.988382:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689ba675000 for MGS 00010000:00010000:1.0:1780997238.989342:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997239.525505:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997240.230665:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997240.230691:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126986880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997240.230764:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997240.233867:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126986880 00000100:00100000:1.0:1780997240.233881:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126986880 00000100:00100000:1.0:1780997240.233951:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4085 00000100:00100000:1.0:1780997240.233960:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3496:x1867507126986880:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1780997240.233968:0:80061:0:(tgt_handler.c:804:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780997240.234061:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3496:x1867507126986880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (3296us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780997240.234069:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4085 00000100:00100000:3.0:1780997240.234299:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126987008:0@lo:400:kworker.0 00000400:00000100:3.0:1780997240.234332:0:3498:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126987008 offset 0 length 224: 4 00000100:00100000:3.0:1780997240.234361:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126987520:0@lo:400:kworker.0 00000100:00100000:3.0:1780997240.234387:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997240.234408:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1780997240.234413:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126987136:0@lo:400:kworker.0 00000100:00100000:3.0:1780997240.234432:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997240.234445:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126987648:0@lo:400:kworker.0 00000100:00100000:3.0:1780997240.234465:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997240.234490:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126987520 00000100:00100000:3.0:1780997240.234507:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126987520 00000100:00100000:3.0:1780997240.234543:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126987136 00000100:00100000:3.0:1780997240.234546:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126987136 00000100:00100000:3.0:1780997240.234560:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1780997240.234568:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126987520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997240.234615:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126987520:12345-0@lo:400:kworker.0 Request processed in 49us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997240.234621:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1780997240.234635:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1780997240.234639:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3498:x1867507126987136:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1780997240.234648:0:63584:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1780997240.234670:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3498:x1867507126987136:12345-0@lo:400:kworker.0 Request processed in 31us (238us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780997240.234676:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1780997240.234692:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126987392:0@lo:400:kworker.0 00000100:00100000:3.0:1780997240.234717:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997240.234735:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507126987904:0@lo:400:kworker.0 00000100:00100000:3.0:1780997240.234753:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997240.234769:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1780997240.234774:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126987264:0@lo:400:kworker.0 00000100:00100000:3.0:1780997240.234794:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997240.234808:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126987776:0@lo:400:kworker.0 00000100:00100000:3.0:1780997240.234827:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997240.234849:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126987392 00000100:00100000:3.0:1780997240.234852:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126987392 00000100:00100000:3.0:1780997240.234866:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126987904 00000100:00100000:3.0:1780997240.234868:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126987904 00000100:00100000:3.0:1780997240.234883:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126987264 00000100:00100000:3.0:1780997240.234886:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126987264 00000100:00100000:3.0:1780997240.234901:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1780997240.234907:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126987264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997240.234940:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126987264:12345-0@lo:400:kworker.0 Request processed in 34us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997240.234945:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1780997240.234956:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1780997240.234960:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3497:x1867507126987392:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1780997240.234964:0:63419:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1780997240.234982:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3497:x1867507126987392:12345-0@lo:400:kworker.0 Request processed in 21us (264us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780997240.234988:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1780997240.234999:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1780997240.235002:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3497:x1867507126987904:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1780997240.235006:0:63419:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1780997240.235023:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3497:x1867507126987904:12345-0@lo:400:kworker.0 Request processed in 20us (269us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780997240.235028:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1780997240.235066:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126987264:0@lo:400:kworker.0 00000100:00080000:3.0:1780997240.235078:0:3497:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780997240.235083:0:3497:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1780997240.235087:0:3497:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1780997240.235093:0:3497:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997240.235097:0:3497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3737 00000100:00080000:3.0:1780997240.235103:0:3497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997240.235139:0:3497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968888606680 x1867507126988032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997240.235156:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507126987392:0@lo:400:kworker.0 00000100:00080000:3.0:1780997240.235169:0:3497:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780997240.235172:0:3497:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1780997240.235175:0:3497:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1780997240.235177:0:3497:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997240.235180:0:3497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3737 00000100:00080000:3.0:1780997240.235184:0:3497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997240.235195:0:3497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968888605880 x1867507126988160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997240.235206:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507126987904:0@lo:400:kworker.0 00000100:00080000:3.0:1780997240.235253:0:3498:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780997240.235256:0:3498:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1780997240.235259:0:3498:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1780997240.235261:0:3498:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780997240.235264:0:3498:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3737 00000100:00080000:3.0:1780997240.235267:0:3498:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1780997240.235303:0:3498:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968888605180 x1867507126988288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780997240.235313:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507126987136:0@lo:400:kworker.0 00000100:00100000:3.0:1780997240.235326:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126987520:0@lo:400:kworker.0 00000100:00080000:2.0:1780997240.235432:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997240.235448:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126988032:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1780997240.235476:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997240.235500:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126988160:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1780997240.235517:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997240.235531:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126988288:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1780997240.235548:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997240.235571:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126988032 00000100:00100000:2.0:1780997240.235574:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126988032 00000100:00100000:2.0:1780997240.235588:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126988160 00000100:00100000:2.0:1780997240.235590:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126988160 00000100:00100000:2.0:1780997240.235596:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126988288 00000100:00100000:2.0:1780997240.235598:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126988288 00000100:00100000:2.0:1780997240.235606:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:2.0:1780997240.235610:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126988032:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1780997240.235627:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997240.235661:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126988032:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 49us (183us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997240.235667:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:2.0:1780997240.235679:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:2.0:1780997240.235683:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126988160:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1780997240.235699:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997240.235725:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126988160:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 40us (206us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997240.235730:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:2.0:1780997240.235741:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1780997240.235745:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126988288:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1780997240.235753:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997240.235773:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126988288:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 26us (224us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997240.235778:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00080000:2.0:1780997240.235802:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997240.235807:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997240.235810:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126988032:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1780997240.235818:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997240.235821:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997240.235824:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126988160:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1780997240.235830:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997240.235833:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997240.235835:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126988288:0@lo:38:ptlrpcd_00_02.0 00000100:02020000:0.0:1780997240.235936:0:3496:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1780997240.235941:0:3496:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780997240.235944:0:3496:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780997240.235948:0:3496:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780997240.235952:0:3496:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997240.235955:0:3496:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3737 00000100:00080000:0.0:1780997240.235959:0:3496:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997240.235976:0:3496:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689a5d83100 x1867507126988416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997240.236290:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126988416:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1780997240.236321:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997240.236410:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126987648 00000100:00100000:1.0:1780997240.236417:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126987648 00000100:00100000:1.0:1780997240.236464:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126987776 00000100:00100000:1.0:1780997240.236467:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126987776 00000100:00100000:1.0:1780997240.236488:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:1.0:1780997240.236495:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126987648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997240.236543:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126987648:12345-0@lo:400:kworker.0 Request processed in 49us (2077us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997240.236549:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00000100:00100000:1.0:1780997240.236562:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:1.0:1780997240.236567:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126987776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997240.236594:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126987776:12345-0@lo:400:kworker.0 Request processed in 27us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997240.236599:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00080000:2.0:1780997240.236803:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997240.236806:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997240.237325:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126988416 00000100:00100000:3.0:1780997240.237331:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126988416 00000100:00100000:3.0:1780997240.237369:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4086 00000100:00100000:3.0:1780997240.237374:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126988416:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1780997240.237389:0:8242:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997240.237439:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126988416:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 63us (1117us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997240.237446:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4086 00000100:00100000:3.0:1780997240.237480:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126987648:0@lo:400:kworker.0 00000100:00080000:0.0:1780997240.237590:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997240.237595:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997240.237599:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126988416:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1780997240.237694:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126987776:0@lo:400:kworker.0 00010000:00010000:2.0:1780997240.550968:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997240.579865:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:0.0:1780997240.579906:0:3490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110416768 offset 0 length 224: 4 00000100:00100000:0.0:1780997240.579924:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997240.579956:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997240.580004:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997240.580110:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110416896 00000100:00100000:2.0:1780997240.580121:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110416896 00000100:00100000:2.0:1780997240.580382:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110417024 00000100:00100000:2.0:1780997240.580386:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110417024 00000100:00100000:2.0:1780997240.580426:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1361 00000100:00100000:2.0:1780997240.580435:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+19:2394:x1867507110417024:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997240.580523:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+19:2394:x1867507110417024:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 88us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997240.580532:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1361 00000100:00100000:2.0:1780997240.580552:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1416 00000100:00100000:2.0:1780997240.580556:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1867507110416896:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:0.0:1780997240.580731:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00080000:2.0:1780997240.580759:0:63417:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.206.51@tcp 00000100:00100000:2.0:1780997240.580789:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1867507110416896:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 231us (933us total) trans 0 rc -107/-107 00000100:00100000:2.0:1780997240.580796:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1416 00000100:00100000:1.0:1780997240.581019:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110417280 00000100:00100000:1.0:1780997240.581025:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110417280 00000100:00080000:0.0:1780997240.581263:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997240.581321:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110417152 00000100:00100000:0.0:1780997240.581325:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110417152 00000100:00100000:0.0:1780997240.581367:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2652 00000100:00100000:0.0:1780997240.581374:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110417152:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997240.581408:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110417152:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997240.581415:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2652 00000100:00080000:2.0:1780997240.581480:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997240.581699:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2653 00000100:00100000:1.0:1780997240.581709:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110417280:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997240.581737:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110417280:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997240.581757:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2653 00000100:00100000:2.0:1780997240.584471:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997240.584797:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110417408 00000100:00100000:1.0:1780997240.584807:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110417408 00000100:00100000:1.0:1780997240.584863:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1417 00000100:00100000:1.0:1780997240.584872:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110417408:12345-192.168.206.51@tcp:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1780997240.584896:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997240.584960:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110417408:12345-192.168.206.51@tcp:38:ptlrpcd_00_01.0 Request processed in 88us (498us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997240.584967:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1417 00000020:01000000:1.0:1780997240.998162:0:89615:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968888e7f360 - data ffff9689ae30fca8/ffff968885e2d400 00000020:01000000:1.0:1780997240.998353:0:89615:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9689bc709780 - data ffff9689aef9b948/ffff9689ba5fb800 00000020:00000080:1.0:1780997240.998781:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305aba5 00000020:00000080:1.0:1780997240.998789:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689891a9800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1780997240.999224:0:89615:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689a5870800 from MGS, refs=2 00000020:01000004:1.0:1780997240.999229:0:89615:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689a5870800 2 00000020:01000004:1.0:1780997240.999232:0:89615:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9689a5870800 from MGS 00000020:00000080:1.0:1780997240.999260:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997240.999304:0:89615:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1780997240.999307:0:89615:0:(genops.c:906:class_export_put()) final put ffff968886bcb000/MGS 00000020:00000080:1.0:1780997240.999310:0:89615:0:(genops.c:865:class_export_destroy()) destroying export ffff968886bcb000/MGS for MGS 00000020:01000000:1.0:1780997240.999317:0:89615:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1780997240.999399:0:89615:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1780997240.999403:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780997240.999408:0:89615:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1780997240.999414:0:89615:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff968886f5c800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780997240.999420:0:89615:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff968990fe4d40) has exports, disconnecting them 00000020:00080000:1.0:1780997240.999425:0:89615:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff968886f5c800), last request at 1780997204 00000020:00000080:1.0:1780997240.999441:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305acd9 00000020:00080000:1.0:1780997240.999448:0:89615:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff968886f5c800): rc 0 00000020:00000080:1.0:1780997240.999452:0:89615:0:(genops.c:906:class_export_put()) final put ffff968886f5c800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1780997241.002757:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689891a9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1780997241.007654:0:89615:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1780997241.007664:0:89615:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1780997241.007667:0:89615:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1780997241.007674:0:89615:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1780997241.007771:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997241.007779:0:89615:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1780997241.007787:0:89615:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689a5870800 1 00000020:00000080:1.0:1780997241.007793:0:89615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ab97 00000020:00000080:1.0:1780997241.007802:0:89615:0:(genops.c:906:class_export_put()) final put ffff968886bce800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1780997241.007807:0:89615:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1780997241.007815:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780997241.007819:0:89615:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1780997241.007823:0:89615:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff96888ac53380) has no exports 00000020:00000080:3.0:1780997241.010474:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff968886f5c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1780997241.010494:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bc969000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1780997241.010505:0:36:0:(genops.c:906:class_export_put()) final put ffff9689bc968000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1780997241.010508:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc968000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1780997241.010513:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1780997241.010604:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff968886bce800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1780997241.077698:0:89615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780997241.077711:0:89615:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1780997241.077716:0:89615:0:(genops.c:906:class_export_put()) final put ffff9689ae563800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1780997241.077721:0:89615:0:(genops.c:865:class_export_destroy()) destroying export ffff9689ae563800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1780997241.077736:0:89615:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1780997241.077859:0:89615:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9689bcb6c800 00000020:02000400:2.0:1780997241.079403:0:89615:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1780997241.574689:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1780997242.288688:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780997242.288698:0:9294:0:(genops.c:906:class_export_put()) final put ffff9689bcd7b000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1780997242.288724:0:9294:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969457 is committed 00000020:00000080:2.0:1780997242.288740:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcd7b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1780997242.288789:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bcd7f000 for lustre-OST0001 00000001:00100000:1.0:1780997242.290262:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1780997242.290301:0:72364:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378767 is committed 00000020:00000080:1.0:1780997242.290305:0:72364:0:(genops.c:906:class_export_put()) final put ffff96898616e000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1780997242.290336:0:72364:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378766 is committed 00000020:00000080:2.0:1780997242.290467:0:13646:0:(genops.c:865:class_export_destroy()) destroying export ffff96898616e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1780997242.290527:0:13646:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bcd7d800 for lustre-MDT0001 00010000:00010000:0.0:1780997242.290754:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b3e0 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290767:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b3e0 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290775:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b3e0 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290781:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997242.290785:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b3e0 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290793:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b3e0 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290808:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff9689882bd700) 00010000:00010000:0.0:1780997242.290811:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997242.290815:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b3e0 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290834:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305b3e0 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290858:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b3f5 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290864:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b3f5 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290870:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b3f5 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290875:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997242.290878:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b3f5 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290884:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b3f5 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290891:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9689836c9c00) 00010000:00010000:0.0:1780997242.290893:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997242.290896:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b3f5 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290902:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b3f5 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290911:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b43b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290917:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b43b lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290926:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b43b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290931:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997242.290934:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b43b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290940:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b43b lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290947:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff9689836c9900) 00010000:00010000:0.0:1780997242.290949:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997242.290952:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b43b lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290957:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b43b lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290972:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b450 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290978:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b450 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290984:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b450 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.290988:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffdc00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997242.290991:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b450 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.291005:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b450 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.291014:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff96898a563d00) 00010000:00010000:0.0:1780997242.291016:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997242.291018:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b450 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997242.291024:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305b450 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997242.597475:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997243.306706:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780997243.306728:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126988544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780997243.306803:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997243.306947:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997243.306956:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126988672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997243.306985:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997243.307013:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126988544 00000100:00100000:2.0:1780997243.307019:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126988544 00000100:00100000:2.0:1780997243.307071:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126988672 00000100:00100000:2.0:1780997243.307075:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126988672 00000100:00100000:3.0:1780997243.307089:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:3.0:1780997243.307099:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126988544:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997243.307107:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:2.0:1780997243.307113:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126988672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997243.307133:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1780997243.307133:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997243.307179:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126988672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997243.307182:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126988544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997243.307187:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00100000:3.0:1780997243.307293:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00100000:3.0:1780997243.307415:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126988544:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1780997243.307422:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997243.307426:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997243.307459:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126988672:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1780997243.621443:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1780997244.327410:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1780997244.327419:0:8226:0:(genops.c:906:class_export_put()) final put ffff9689aebbf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1780997244.327451:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689aebbf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1780997244.327491:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689aebbb000 for lustre-OST0000 00010000:00010000:2.0:1780997244.645803:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780997245.353619:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997245.353628:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997245.353634:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997245.353646:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3767 00000100:00080000:2.0:1780997245.353654:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780997245.353662:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997245.353694:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988613800 x1867507126988928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997245.353767:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997245.353771:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997245.353773:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997245.353777:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3767 00000100:00080000:2.0:1780997245.353780:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780997245.353784:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997245.353801:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b100b800 x1867507126989184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997245.353826:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997245.353829:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997245.353831:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997245.353836:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3767 00000100:00080000:2.0:1780997245.353838:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780997245.353842:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997245.353855:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc961c00 x1867507126989440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997245.353877:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997245.353881:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997245.353883:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997245.353887:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3767 00000100:00080000:2.0:1780997245.353890:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780997245.353894:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997245.353905:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc960000 x1867507126989824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997245.354120:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126988928:0@lo:38:kworker.0 00000100:00100000:0.0:1780997245.354176:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126988800:0@lo:400:kworker.0 00000400:00000100:0.0:1780997245.354223:0:3496:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126988800 offset 0 length 224: 4 00000100:00100000:1.0:1780997245.354225:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997245.354583:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126989696:0@lo:400:kworker.0 00000100:00100000:0.0:1780997245.354615:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997245.354642:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997245.354649:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126989056:0@lo:400:kworker.0 00000100:00100000:0.0:1780997245.354671:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997245.354750:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126989696 00000100:00100000:1.0:1780997245.354758:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126989696 00000100:00100000:3.0:1780997245.354768:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126989568:0@lo:400:kworker.0 00000100:00100000:3.0:1780997245.354804:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997245.354839:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780997245.354847:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126989312:0@lo:400:kworker.0 00000100:00100000:3.0:1780997245.354868:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997245.354895:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126988928 00000100:00100000:3.0:1780997245.354898:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126988928 00000100:00100000:3.0:1780997245.354919:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126989056 00000100:00100000:3.0:1780997245.354922:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126989056 00000100:00100000:3.0:1780997245.354944:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126989312 00000100:00100000:3.0:1780997245.354946:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126989312 00000100:00100000:3.0:1780997245.354968:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:3.0:1780997245.354977:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126989056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997245.355031:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126989056:12345-0@lo:400:kworker.0 Request processed in 55us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997245.355039:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:3.0:1780997245.355056:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:3.0:1780997245.355062:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126989312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997245.355094:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507126989312:12345-0@lo:400:kworker.0 Request processed in 32us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997245.355110:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:3.0:1780997245.355123:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:3.0:1780997245.355127:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126988928:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997245.355144:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997245.355173:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126988928:12345-0@lo:38:kworker.0 Request processed in 44us (953us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997245.355179:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00080000:0.0:1780997245.355511:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780997245.355517:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997245.358966:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126989056:0@lo:400:kworker.0 00000100:00100000:2.0:1780997245.359022:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507126989312:0@lo:400:kworker.0 00000100:00080000:2.0:1780997245.359065:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997245.359071:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997245.359075:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126988928:0@lo:38:kworker.0 00000100:00100000:2.0:1780997245.359084:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126989184:0@lo:38:kworker.0 00000100:00100000:2.0:1780997245.359158:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997245.359199:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126989440:0@lo:38:kworker.0 00000100:00100000:3.0:1780997245.359590:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126989184 00000100:00100000:3.0:1780997245.359597:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126989184 00000100:00100000:3.0:1780997245.359637:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1780997245.359644:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126989184:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997245.359666:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997245.359708:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3495:x1867507126989184:12345-0@lo:38:kworker.0 Request processed in 63us (549us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997245.359715:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:2.0:1780997245.360976:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997245.361012:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126989824:0@lo:38:kworker.0 00000100:00100000:2.0:1780997245.361042:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780997245.361097:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997245.361113:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997245.361117:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126989184:0@lo:38:kworker.0 00000100:00100000:2.0:1780997245.361164:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126989824 00000100:00100000:2.0:1780997245.361169:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126989824 00000100:00100000:2.0:1780997245.361549:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:2.0:1780997245.361557:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126989824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997245.361576:0:63417:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997245.361622:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507126989824:12345-0@lo:38:kworker.0 Request processed in 63us (577us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997245.361629:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00080000:2.0:1780997245.361684:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997245.361690:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997245.361693:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126989824:0@lo:38:kworker.0 00000100:00100000:3.0:1780997245.362486:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126989440 00000100:00100000:3.0:1780997245.362494:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126989440 00000100:00100000:3.0:1780997245.362563:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4087 00000100:00100000:3.0:1780997245.362570:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bf8c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126989440:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1780997245.362573:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126989568 00000100:00100000:1.0:1780997245.362580:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126989568 00010000:00020000:3.0:1780997245.362587:0:80061:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997245.362633:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:3.0:1780997245.362641:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bf8c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126989440:12345-0@lo:38:kworker.0 Request processed in 70us (1668us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997245.362646:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126989696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997245.362652:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4087 00000100:00100000:1.0:1780997245.362720:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126989696:12345-0@lo:400:kworker.0 Request processed in 78us (8103us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997245.362727:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:1.0:1780997245.362747:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:1.0:1780997245.362755:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126989568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997245.362801:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126989568:12345-0@lo:400:kworker.0 Request processed in 47us (7996us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997245.362807:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00080000:1.0:1780997245.362835:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997245.362871:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126989568:0@lo:400:kworker.0 00000100:00100000:1.0:1780997245.362913:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126989696:0@lo:400:kworker.0 00000100:00080000:2.0:1780997245.364146:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997245.364154:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997245.364159:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126989440:0@lo:38:kworker.0 00010000:00010000:3.0:1780997245.669530:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1780997245.699554:0:3489:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110417536 offset 0 length 224: 4 00000100:00100000:2.0:1780997245.716072:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997245.716133:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997245.716167:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997245.716229:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997245.716250:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110418048 00000100:00100000:0.0:1780997245.716262:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110418048 00000100:00100000:3.0:1780997245.716364:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110417792 00000100:00100000:3.0:1780997245.716370:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110417792 00000100:00100000:0.0:1780997245.716372:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110417920 00000100:00100000:0.0:1780997245.716387:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110417920 00000100:00100000:3.0:1780997245.716421:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110417664 00000100:00100000:3.0:1780997245.716426:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110417664 00000100:00100000:0.0:1780997245.716432:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2656 00000100:00100000:0.0:1780997245.716444:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110418048:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997245.716452:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1364 00000100:00100000:3.0:1780997245.716463:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2397:x1867507110417792:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997245.716518:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110418048:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 76us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997245.716541:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2656 00000100:00080000:2.0:1780997245.716578:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997245.716584:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997245.716586:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997245.716616:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1421 00000100:00100000:2.0:1780997245.716622:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110417664:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:2.0:1780997245.716644:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997245.724198:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2657 00000100:00100000:1.0:1780997245.724233:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110417920:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997245.724473:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2397:x1867507110417792:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 8010us (8409us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997245.724484:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1364 00000100:00100000:2.0:1780997245.736784:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110417664:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 20145us (20539us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997245.736813:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1421 00000100:00100000:1.0:1780997245.742761:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110417920:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 18535us (26580us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997245.742778:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2657 00010000:00010000:1.0:1780997246.694432:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997247.717430:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997248.421963:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126989952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997248.422061:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997248.422126:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126989952 00000100:00100000:2.0:1780997248.422135:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126989952 00000100:00080000:1.0:1780997248.422207:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997248.422224:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134 00000100:00100000:2.0:1780997248.422374:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126989952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997248.422412:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997248.422830:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126989952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 459us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997248.422853:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134 00000100:00100000:0.0:1780997248.423459:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780997248.423473:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126990080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997248.423515:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997248.423731:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126990080 00000100:00100000:2.0:1780997248.423737:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126990080 00000100:00100000:2.0:1780997248.423833:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:2.0:1780997248.423844:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126990080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780997248.423871:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997248.423875:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126989952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997248.423917:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126990080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997248.423936:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00100000:2.0:1780997248.423977:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126990080:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780997248.425042:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780997248.741802:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997249.765548:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780997250.469437:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997250.469444:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997250.469447:0:36:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997250.469455:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3772 00000100:00080000:2.0:1780997250.469460:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780997250.469466:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997250.469506:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc960000 x1867507126990336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997250.469550:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997250.469554:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997250.469556:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997250.469559:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3772 00000100:00080000:2.0:1780997250.469564:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1780997250.469564:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126990208:0@lo:400:kworker.0 00000100:00080000:2.0:1780997250.469582:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997250.469599:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b100b800 x1867507126990592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997250.469618:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000400:00000100:0.0:1780997250.469620:0:3499:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126990208 offset 0 length 224: 4 00000100:00080000:2.0:1780997250.469625:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997250.469628:0:36:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997250.469633:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3772 00000100:00080000:2.0:1780997250.469636:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780997250.469640:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997250.469653:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968889179c00 x1867507126990848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997250.469671:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1780997250.469675:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997250.469680:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1780997250.469681:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888917a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126991104:0@lo:400:kworker.0 00000100:00080000:2.0:1780997250.469683:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997250.469690:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3772 00000100:00080000:2.0:1780997250.469693:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780997250.469697:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997250.469713:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968888d7ea00 x1867507126991232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997250.469724:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997250.469747:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888917bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126990976:0@lo:400:kworker.0 00000100:00100000:0.0:1780997250.469770:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997250.469803:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126991104 00000100:00100000:2.0:1780997250.469811:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126991104 00000100:00080000:0.0:1780997250.469839:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997250.469862:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126990976 00000100:00100000:2.0:1780997250.469866:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126990976 00000100:00100000:0.0:1780997250.469878:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:0.0:1780997250.469892:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126991104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997250.469898:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:2.0:1780997250.469908:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126990976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997250.469951:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126991104:12345-0@lo:400:kworker.0 Request processed in 64us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997250.469960:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000100:00100000:2.0:1780997250.469964:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126990976:12345-0@lo:400:kworker.0 Request processed in 56us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997250.469973:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00080000:0.0:1780997250.469987:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780997250.470024:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888917a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126991104:0@lo:400:kworker.0 00000100:00100000:0.0:1780997250.470036:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888917bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126990976:0@lo:400:kworker.0 00000100:00100000:1.0:1780997250.470137:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126990336:0@lo:38:kworker.0 00000100:00100000:1.0:1780997250.470188:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997250.470202:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126990464:0@lo:400:kworker.0 00000100:00100000:1.0:1780997250.470219:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126990592:0@lo:38:kworker.0 00000100:00100000:3.0:1780997250.470238:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997250.470295:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126990336 00000100:00100000:2.0:1780997250.470300:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126990336 00000100:00100000:2.0:1780997250.470321:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126990464 00000100:00100000:2.0:1780997250.470323:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126990464 00000100:00100000:2.0:1780997250.470348:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:2.0:1780997250.470355:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126990464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997250.470394:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:0.0:1780997250.470406:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126990336:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1780997250.470410:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126990720:0@lo:400:kworker.0 00010000:00020000:0.0:1780997250.470427:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997250.474226:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507126990464:12345-0@lo:400:kworker.0 Request processed in 3861us (3978us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997250.474242:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00080000:2.0:1780997250.474358:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997250.474378:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997250.474411:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126990848:0@lo:38:kworker.0 00000100:00100000:2.0:1780997250.474446:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997250.474463:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888d7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126991232:0@lo:38:kworker.0 00000100:00100000:2.0:1780997250.476873:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997250.476946:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126990848 00000100:00100000:2.0:1780997250.476954:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126990848 00000100:00100000:2.0:1780997250.476993:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4088 00000100:00100000:2.0:1780997250.477002:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126990848:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997250.477025:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997250.477070:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126990848:12345-0@lo:38:kworker.0 Request processed in 68us (2622us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997250.477078:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4088 00000100:00100000:2.0:1780997250.477113:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126990592 00000100:00100000:2.0:1780997250.477118:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126990592 00000100:00100000:2.0:1780997250.477135:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126991232 00000100:00100000:2.0:1780997250.477138:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126991232 00000100:00100000:2.0:1780997250.477167:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:2.0:1780997250.477173:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126990592:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997250.477183:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997250.477212:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126990592:12345-0@lo:38:kworker.0 Request processed in 38us (2833us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997250.477217:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:2.0:1780997250.477227:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1780997250.477231:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126991232:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780997250.477239:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997250.477257:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126991232:12345-0@lo:38:kworker.0 Request processed in 25us (390us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997250.477262:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00080000:2.0:1780997250.477314:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997250.477319:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997250.477323:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126990592:0@lo:38:kworker.0 00000100:00080000:2.0:1780997250.477334:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997250.477337:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997250.477340:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126990848:0@lo:38:kworker.0 00000100:00080000:2.0:1780997250.477347:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997250.477350:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997250.477352:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888d7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126991232:0@lo:38:kworker.0 00000100:00100000:1.0:1780997250.478770:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997250.478884:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126990720 00000100:00100000:2.0:1780997250.478892:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126990720 00000100:00100000:2.0:1780997250.478954:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:2.0:1780997250.478963:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126990720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997250.479019:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126990720:12345-0@lo:400:kworker.0 Request processed in 57us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997250.479026:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00080000:1.0:1780997250.479100:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997250.479130:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126990720:0@lo:400:kworker.0 00000100:00100000:0.0:1780997250.480739:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126990336:12345-0@lo:38:kworker.0 Request processed in 10325us (10546us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997250.480749:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00080000:2.0:1780997250.481240:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997250.481246:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780997250.481250:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126990336:0@lo:38:kworker.0 00000100:00100000:3.0:1780997250.487719:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507126990464:0@lo:400:kworker.0 00010000:00010000:1.0:1780997250.789424:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997250.820477:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:3.0:1780997250.820520:0:3489:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110418176 offset 0 length 224: 4 00000100:00100000:3.0:1780997250.820556:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997250.820663:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110418688 00000100:00100000:1.0:1780997250.820679:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110418688 00000100:00100000:1.0:1780997250.820768:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2660 00000100:00080000:0.0:1780997250.820777:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997250.820783:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd01b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110418688:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997250.820885:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd01b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2397:x1867507110418688:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 108us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997250.820893:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2660 00000100:00100000:2.0:1780997250.822684:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110418432 00000100:00100000:2.0:1780997250.822695:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110418432 00000100:00100000:2.0:1780997250.822775:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1367 00000100:00100000:2.0:1780997250.822783:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2397:x1867507110418432:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997250.822860:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2397:x1867507110418432:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 77us (2396us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997250.822867:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1367 00000100:00080000:0.0:1780997250.823026:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997250.830413:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997250.830481:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997250.830609:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110418560 00000100:00100000:0.0:1780997250.830625:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110418560 00000100:00100000:2.0:1780997250.830658:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110418304 00000100:00100000:2.0:1780997250.830669:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110418304 00000100:00100000:0.0:1780997250.830724:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5970 00000100:00100000:2.0:1780997250.830734:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1425 00000100:00100000:0.0:1780997250.830742:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2393:x1867507110418560:12345-192.168.206.51@tcp:9:kworker.0 00000100:00100000:2.0:1780997250.830753:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1867507110418304:12345-192.168.206.51@tcp:38:kworker.0 00000020:00000080:0.0:1780997250.830776:0:8232:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305b33f 00000100:00080000:0.0:1780997250.830786:0:8232:0:(import.c:65:import_set_state_nolock()) ffff96888a814800 : changing import state from FULL to CLOSED 00010000:00020000:2.0:1780997250.830789:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000001:00000004:0.0:1780997250.830840:0:8232:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969455 00000100:00100000:2.0:1780997250.830890:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1867507110418304:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 138us (490us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997250.830901:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1425 00010000:00010000:2.0:1780997250.830976:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997250.831017:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+2:2393:x1867507110418560:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 280us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997250.831025:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5970 00000100:00080000:1.0:1780997250.831330:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780997251.813523:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997252.838188:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997253.541621:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997253.541640:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888d7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126991360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997253.541720:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997253.541796:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126991360 00000100:00100000:2.0:1780997253.541803:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126991360 00000100:00100000:2.0:1780997253.541888:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:2.0:1780997253.542053:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126991360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780997253.542153:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997253.542200:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126991360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 305us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997253.542208:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00080000:2.0:1780997253.542232:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997253.542247:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997253.542255:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126991488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997253.542353:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888d7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126991360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997253.542433:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997253.542529:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126991488 00000100:00100000:0.0:1780997253.542533:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126991488 00000100:00100000:0.0:1780997253.542577:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:0.0:1780997253.542586:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126991488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997253.542605:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997253.542647:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126991488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997253.542653:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00000100:00080000:2.0:1780997253.542776:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997253.542799:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126991488:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1780997253.861587:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997254.889911:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780997255.589514:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997255.589521:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997255.589525:0:38:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997255.589533:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3778 00000100:00080000:1.0:1780997255.589539:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1780997255.589545:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997255.589570:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7a4c000 x1867507126991744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997255.589592:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997255.589595:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997255.589596:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997255.589599:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3778 00000100:00080000:1.0:1780997255.589611:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1780997255.589615:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997255.589627:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7a4dc00 x1867507126992000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997255.589652:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997255.589655:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997255.589657:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997255.589661:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3778 00000100:00080000:1.0:1780997255.589663:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1780997255.589666:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997255.589678:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bff6c700 x1867507126992256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997255.589698:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997255.589700:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997255.589702:0:38:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997255.589705:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3778 00000100:00080000:1.0:1780997255.589707:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1780997255.589710:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997255.589718:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bff6fb80 x1867507126992640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997255.589743:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126991872:0@lo:400:kworker.0 00000100:00100000:1.0:1780997255.589809:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997255.589842:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1780997255.589848:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126991616:0@lo:400:kworker.0 00000400:00000100:1.0:1780997255.589878:0:3499:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126991616 offset 0 length 224: 4 00000100:00100000:1.0:1780997255.589899:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126992512:0@lo:400:kworker.0 00000100:00100000:1.0:1780997255.589924:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997255.589949:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126991744:0@lo:38:kworker.0 00000100:00100000:1.0:1780997255.589972:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997255.589987:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126992000:0@lo:38:kworker.0 00000100:00100000:1.0:1780997255.590006:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997255.590021:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126992256:0@lo:38:kworker.0 00000100:00100000:1.0:1780997255.590041:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997255.590076:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126992640:0@lo:38:kworker.0 00000100:00100000:1.0:1780997255.590097:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997255.590134:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126992384:0@lo:400:kworker.0 00000100:00100000:1.0:1780997255.590158:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997255.590176:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780997255.590182:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126992128:0@lo:400:kworker.0 00000100:00100000:1.0:1780997255.590202:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997255.590231:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126991872 00000100:00100000:1.0:1780997255.590238:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126991872 00000100:00100000:1.0:1780997255.590310:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126991744 00000100:00100000:1.0:1780997255.590313:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126991744 00000100:00100000:1.0:1780997255.590323:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126992000 00000100:00100000:1.0:1780997255.590325:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126992000 00000100:00100000:1.0:1780997255.590332:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126992640 00000100:00100000:1.0:1780997255.590334:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126992640 00000100:00100000:1.0:1780997255.590342:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126992128 00000100:00100000:1.0:1780997255.590344:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126992128 00000100:00100000:1.0:1780997255.590362:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:1.0:1780997255.590377:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126991872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997255.590425:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126991872:12345-0@lo:400:kworker.0 Request processed in 50us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997255.590432:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:1.0:1780997255.590450:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:1.0:1780997255.590456:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126992128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997255.590488:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126992128:12345-0@lo:400:kworker.0 Request processed in 32us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997255.590494:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:1.0:1780997255.590506:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1780997255.590510:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126991744:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997255.590528:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997255.590561:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126991744:12345-0@lo:38:kworker.0 Request processed in 49us (587us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997255.590567:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1780997255.590578:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1780997255.590581:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126992000:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997255.590590:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997255.590613:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126992000:12345-0@lo:38:kworker.0 Request processed in 30us (605us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997255.590618:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1780997255.590629:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1780997255.590632:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126992640:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997255.590642:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997255.590674:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126992640:12345-0@lo:38:kworker.0 Request processed in 40us (576us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997255.590681:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1780997255.590698:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126992512 00000100:00100000:1.0:1780997255.590701:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126992512 00000100:00100000:1.0:1780997255.590723:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126992384 00000100:00100000:1.0:1780997255.590726:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126992384 00000100:00100000:1.0:1780997255.590741:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:1.0:1780997255.590746:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126992512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997255.590771:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126992512:12345-0@lo:400:kworker.0 Request processed in 26us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997255.590777:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00000100:00100000:1.0:1780997255.590785:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:1.0:1780997255.590790:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126992384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997255.590809:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126992384:12345-0@lo:400:kworker.0 Request processed in 19us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997255.590814:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00100000:1.0:1780997255.590833:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126992256 00000100:00100000:1.0:1780997255.590835:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126992256 00000100:00100000:1.0:1780997255.590851:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4089 00000100:00100000:1.0:1780997255.590855:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126992256:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997255.590864:0:23042:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997255.590884:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126992256:12345-0@lo:38:kworker.0 Request processed in 28us (842us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997255.590889:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4089 00000100:00080000:1.0:1780997255.590909:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997255.590913:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997255.590920:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997255.590964:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126992128:0@lo:400:kworker.0 00000100:00100000:1.0:1780997255.590973:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126992384:0@lo:400:kworker.0 00000100:00080000:1.0:1780997255.590996:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997255.591000:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997255.591003:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126991744:0@lo:38:kworker.0 00000100:00080000:1.0:1780997255.591010:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997255.591013:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997255.591015:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126992000:0@lo:38:kworker.0 00000100:00080000:1.0:1780997255.591021:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997255.591024:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997255.591026:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126992256:0@lo:38:kworker.0 00000100:00080000:1.0:1780997255.591031:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997255.591034:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997255.591036:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126992640:0@lo:38:kworker.0 00000100:00100000:1.0:1780997255.591062:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126992512:0@lo:400:kworker.0 00000100:00100000:1.0:1780997255.591070:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126991872:0@lo:400:kworker.0 00010000:00010000:3.0:1780997255.910448:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997255.941923:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000400:00000100:1.0:1780997255.942023:0:3490:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110418816 offset 0 length 224: 4 00000100:00100000:1.0:1780997255.942049:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997255.942088:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997255.942159:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110419200 00000100:00100000:0.0:1780997255.942171:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110419200 00000100:00100000:0.0:1780997255.942333:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2663 00000100:00100000:0.0:1780997255.942344:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2396:x1867507110419200:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997255.942417:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2396:x1867507110419200:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 76us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997255.942426:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2663 00000100:00080000:3.0:1780997255.942570:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997255.943193:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110419072 00000100:00100000:2.0:1780997255.943201:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110419072 00000100:00100000:2.0:1780997255.943311:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110418944 00000100:00100000:2.0:1780997255.943316:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110418944 00000100:00100000:2.0:1780997255.943335:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1370 00000100:00100000:2.0:1780997255.943343:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2396:x1867507110419072:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997255.943391:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2396:x1867507110419072:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 50us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997255.943417:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1370 00000100:00100000:2.0:1780997255.943433:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1429 00000100:00100000:2.0:1780997255.943438:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110418944:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:2.0:1780997255.943460:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997255.943489:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110418944:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 50us (1400us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997255.943495:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1429 00000100:00080000:3.0:1780997255.943947:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:3.0:1780997255.952583:0:3489:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.206.51@tcp portal 26 match 1867507110419328 offset 0 length 520: 4 00000100:00000400:3.0:1780997256.488534:0:3498:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780997240/real 1780997240] req@ffff9689bfaad180 x1867507126987008/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997256 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997256.488570:0:3498:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9689bfaad180 x1867507126987008/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997256 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997256.488586:0:3498:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1780997256.488590:0:3498:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1780997256.488593:0:3498:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.151@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1780997256.488595:0:3498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1780997256.488600:0:3498:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689bfaad180 x1867507126987008/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780997256 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997256.488609:0:3498:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff968988611180 x1867507126988800/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997261 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997256.488620:0:3498:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689bc962a00 x1867507126990208/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997266 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997256.488639:0:3498:0:(client.c:3608:ptlrpc_abort_inflight()) @@@ inflight req@ffff9689b7a4e300 x1867507126991616/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997271 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1780997256.488647:0:3498:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1780997256.488650:0:3498:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1780997256.488651:0:3498:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1780997256.488653:0:3498:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1780997256.488680:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126987008:0@lo:400:kworker.0 00000100:00100000:2.0:1780997256.488820:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126991616:0@lo:400:kworker.0 00000100:00100000:2.0:1780997256.488833:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507126990208:0@lo:400:kworker.0 00000100:00100000:1.0:1780997256.489551:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507126988800:0@lo:400:kworker.0 00000100:00080000:1.0:1780997256.489589:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997256.489600:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1780997256.489603:0:38:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997256.489609:0:38:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3731 00000100:00080000:1.0:1780997256.489617:0:38:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997256.489647:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bff6f100 x1867507126992768/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997256.489677:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997256.489681:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997256.489682:0:38:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997256.489686:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3783 00000100:00080000:1.0:1780997256.489688:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997256.489692:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997256.489707:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bff6fb80 x1867507126992896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997256.489731:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997256.489735:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997256.489737:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997256.489740:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3783 00000100:00080000:1.0:1780997256.489742:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997256.489745:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997256.489754:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bff6c000 x1867507126993152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997256.489773:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997256.489776:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997256.489783:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997256.489788:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3783 00000100:00080000:1.0:1780997256.489790:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997256.489794:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997256.489807:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7a4e680 x1867507126993408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997256.489829:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997256.489832:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997256.489834:0:38:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997256.489837:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3783 00000100:00080000:1.0:1780997256.489839:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997256.489894:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997256.489906:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b7a4df80 x1867507126993792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997256.489931:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126993536:0@lo:400:kworker.0 00000100:00100000:1.0:1780997256.489992:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997256.490024:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780997256.490030:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126993280:0@lo:400:kworker.0 00000100:00100000:1.0:1780997256.490056:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997256.490086:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126993536 00000100:00100000:1.0:1780997256.490093:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126993536 00000100:00100000:3.0:1780997256.490247:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126992768:0@lo:250:kworker.0 00000400:00000100:3.0:1780997256.490295:0:3495:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1867507126992768 offset 0 length 520: 4 00000100:00100000:3.0:1780997256.490318:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126992896:0@lo:38:kworker.0 00000100:00100000:3.0:1780997256.490341:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997256.490382:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126993152:0@lo:38:kworker.0 00000100:00100000:3.0:1780997256.490404:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997256.490432:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126993408:0@lo:38:kworker.0 00000100:00100000:3.0:1780997256.490455:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997256.490483:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126993792:0@lo:38:kworker.0 00000100:00100000:3.0:1780997256.490504:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997256.490533:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126993280 00000100:00100000:3.0:1780997256.490537:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126993280 00000100:00100000:3.0:1780997256.490580:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126992896 00000100:00100000:3.0:1780997256.490583:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126992896 00000100:00100000:3.0:1780997256.490599:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126993152 00000100:00100000:3.0:1780997256.490601:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126993152 00000100:00100000:3.0:1780997256.490610:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126993792 00000100:00100000:3.0:1780997256.490611:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126993792 00000100:00100000:3.0:1780997256.490622:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:3.0:1780997256.490631:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126993280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997256.490681:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126993280:12345-0@lo:400:kworker.0 Request processed in 52us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997256.490689:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:3.0:1780997256.490706:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1780997256.490710:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126992896:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997256.490727:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997256.490758:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126992896:12345-0@lo:38:kworker.0 Request processed in 47us (416us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997256.490765:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1780997256.490775:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:3.0:1780997256.490778:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126993152:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997256.490786:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997256.490806:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126993152:12345-0@lo:38:kworker.0 Request processed in 26us (401us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997256.490810:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:3.0:1780997256.490829:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1780997256.490833:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126993792:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997256.490842:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997256.490864:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126993792:12345-0@lo:38:kworker.0 Request processed in 30us (358us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997256.490870:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1780997256.490888:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126993408 00000100:00100000:3.0:1780997256.490891:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126993408 00000100:00100000:3.0:1780997256.490911:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4090 00000100:00100000:3.0:1780997256.490916:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126993408:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997256.490925:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997256.490950:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126993408:12345-0@lo:38:kworker.0 Request processed in 33us (494us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997256.490956:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4090 00000100:00080000:3.0:1780997256.490991:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997256.490996:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997256.491000:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126992896:0@lo:38:kworker.0 00000100:00080000:3.0:1780997256.491009:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997256.491012:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997256.491015:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126993152:0@lo:38:kworker.0 00000100:00080000:3.0:1780997256.491023:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997256.491026:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997256.491028:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126993408:0@lo:38:kworker.0 00000100:00080000:3.0:1780997256.491034:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997256.491037:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780997256.491046:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126993792:0@lo:38:kworker.0 00000100:00100000:1.0:1780997256.492530:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664 00000100:00100000:1.0:1780997256.492546:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126993536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997256.492618:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126993536:12345-0@lo:400:kworker.0 Request processed in 78us (2625us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997256.492635:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664 00000100:00100000:1.0:1780997256.498502:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126993024:0@lo:400:kworker.0 00000100:00100000:1.0:1780997256.498576:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997256.498624:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780997256.498631:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126993664:0@lo:400:kworker.0 00000100:00100000:1.0:1780997256.498657:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997256.498714:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126993280:0@lo:400:kworker.0 00000100:00100000:1.0:1780997256.498728:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126993536:0@lo:400:kworker.0 00000100:00100000:3.0:1780997256.499253:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126993024 00000100:00100000:3.0:1780997256.499260:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126993024 00000100:00100000:2.0:1780997256.499553:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126993664 00000100:00100000:2.0:1780997256.499558:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126993664 00000100:00100000:2.0:1780997256.499591:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:2.0:1780997256.499601:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126993664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997256.499659:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126993664:12345-0@lo:400:kworker.0 Request processed in 59us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997256.499667:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:1.0:1780997256.499748:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126993664:0@lo:400:kworker.0 00000100:00100000:3.0:1780997256.500070:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:3.0:1780997256.500080:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126993024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997256.500135:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507126993024:12345-0@lo:400:kworker.0 Request processed in 57us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997256.500142:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:1.0:1780997256.500233:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507126993024:0@lo:400:kworker.0 00000001:00100000:3.0:1780997256.623002:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000020:00000080:3.0:1780997256.623011:0:8226:0:(genops.c:906:class_export_put()) final put ffff96888a817800/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000020:00000080:2.0:1780997256.623074:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96888a817800/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 for lustre-OST0000 00000020:00000080:2.0:1780997256.623134:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96888a814800 for lustre-OST0000 00010000:00010000:3.0:1780997256.935078:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997257.961888:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997258.662193:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126993920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997258.662291:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997258.662349:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126993920 00000100:00100000:1.0:1780997258.662358:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126993920 00000100:00100000:1.0:1780997258.662550:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138 00000100:00100000:1.0:1780997258.662562:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126993920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780997258.662595:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780997258.662646:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507126993920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997258.662654:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138 00000100:00080000:1.0:1780997258.663027:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997258.663145:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507126993920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997258.668215:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126994048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997258.668335:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997258.669030:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126994048 00000100:00100000:0.0:1780997258.669053:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126994048 00000100:00100000:0.0:1780997258.669131:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:0.0:1780997258.669142:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126994048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997258.669176:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1780997258.669249:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997258.675538:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126994048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6385us (7190us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997258.675553:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:1.0:1780997258.676168:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126994048:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1780997258.981503:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997260.005529:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997261.029430:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997261.066346:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997261.066409:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997261.066437:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997261.066471:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110419712 00000100:00100000:0.0:1780997261.066480:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110419712 00000100:00100000:0.0:1780997261.066550:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5971 00000100:00100000:0.0:1780997261.066562:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2393:x1867507110419712:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:0.0:1780997261.066611:0:25174:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305ae68 00000100:00080000:0.0:1780997261.066623:0:25174:0:(import.c:65:import_set_state_nolock()) ffff9689bcc17000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780997261.066678:0:25174:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969457 00000100:00100000:0.0:1780997261.066865:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+2:2393:x1867507110419712:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 306us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997261.067037:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110419584 00000100:00100000:1.0:1780997261.067042:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110419584 00000100:00100000:1.0:1780997261.067072:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110419456 00000100:00100000:1.0:1780997261.067075:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110419456 00000100:00100000:1.0:1780997261.067091:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1373 00000100:00100000:1.0:1780997261.067110:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2395:x1867507110419584:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997261.067155:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2395:x1867507110419584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 46us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997261.067163:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1373 00000100:00100000:1.0:1780997261.067180:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1433 00000100:00100000:1.0:1780997261.067184:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110419456:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:1.0:1780997261.067210:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997261.067236:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1867507110419456:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 50us (827us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997261.067242:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1433 00000100:00080000:1.0:1780997261.067309:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997261.067314:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1780997261.067330:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997261.068252:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5971 00000100:00080000:0.0:1780997261.733591:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997261.733600:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1780997261.733603:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997261.733607:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997261.733611:0:38:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997261.733624:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3784 00000100:00080000:0.0:1780997261.733629:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997261.733638:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997261.733707:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988612680 x1867507126994176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997261.733761:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997261.733765:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997261.733767:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997261.733786:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3784 00000100:00080000:1.0:1780997261.733788:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997261.733793:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997261.733806:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988613b80 x1867507126994432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997261.733833:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997261.733837:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997261.733839:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997261.733843:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3784 00000100:00080000:1.0:1780997261.733846:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1780997261.733848:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126994176:0@lo:38:kworker.0 00000100:00080000:1.0:1780997261.733852:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997261.733868:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988611f80 x1867507126994688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997261.733895:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997261.733899:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780997261.733901:0:38:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997261.733904:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3784 00000100:00080000:1.0:1780997261.733907:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780997261.733911:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997261.733922:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9688884a8380 x1867507126995072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997261.733940:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997261.733961:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126994304:0@lo:400:kworker.0 00000100:00100000:0.0:1780997261.733976:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126994432:0@lo:38:kworker.0 00000100:00100000:1.0:1780997261.733998:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997261.734019:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126994176 00000100:00100000:1.0:1780997261.734030:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997261.734040:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126994176 00000100:00100000:1.0:1780997261.734044:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126994944:0@lo:400:kworker.0 00000100:00100000:1.0:1780997261.734072:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997261.734078:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126994304 00000100:00100000:0.0:1780997261.734083:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126994304 00000100:00100000:1.0:1780997261.734119:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126994560:0@lo:400:kworker.0 00000100:00100000:0.0:1780997261.734142:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1780997261.734150:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997261.734155:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126994304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997261.734174:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780997261.734180:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126994816:0@lo:400:kworker.0 00000100:00100000:1.0:1780997261.734213:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997261.734225:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507126994304:12345-0@lo:400:kworker.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997261.734236:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1780997261.734253:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126994560 00000100:00100000:1.0:1780997261.734258:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126994560 00000100:00100000:0.0:1780997261.734261:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:0.0:1780997261.734267:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126994176:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1780997261.734319:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00010000:00020000:0.0:1780997261.734321:0:63419:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997261.734328:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126994560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997261.734372:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507126994176:12345-0@lo:38:kworker.0 Request processed in 102us (432us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997261.734380:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507126994560:12345-0@lo:400:kworker.0 Request processed in 52us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997261.734384:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:1.0:1780997261.734394:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00080000:0.0:1780997261.734412:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997261.734449:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507126994304:0@lo:400:kworker.0 00000100:00100000:0.0:1780997261.734475:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997261.734499:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126994688:0@lo:38:kworker.0 00000100:00100000:0.0:1780997261.734526:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997261.734557:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126995072:0@lo:38:kworker.0 00000100:00100000:0.0:1780997261.734578:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780997261.734604:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997261.734609:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997261.734611:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126994176:0@lo:38:kworker.0 00000100:00100000:0.0:1780997261.734632:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126994432 00000100:00100000:0.0:1780997261.734635:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126994432 00000100:00100000:0.0:1780997261.734651:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126995072 00000100:00100000:0.0:1780997261.734653:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126995072 00000100:00100000:0.0:1780997261.734662:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1780997261.734666:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126994432:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997261.734678:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997261.734714:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126994432:12345-0@lo:38:kworker.0 Request processed in 46us (238us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997261.734721:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1780997261.734733:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:0.0:1780997261.734737:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126995072:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780997261.734746:0:65272:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997261.734778:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3495:x1867507126995072:12345-0@lo:38:kworker.0 Request processed in 39us (198us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997261.734784:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00080000:0.0:1780997261.734811:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997261.734815:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997261.734817:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126995072:0@lo:38:kworker.0 00000100:00080000:0.0:1780997261.734825:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997261.734828:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997261.734831:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126994432:0@lo:38:kworker.0 00000100:00100000:0.0:1780997261.734865:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126994944 00000100:00100000:0.0:1780997261.734869:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126994944 00000100:00100000:0.0:1780997261.734899:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126994816 00000100:00100000:0.0:1780997261.734902:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126994816 00000100:00100000:0.0:1780997261.734920:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:0.0:1780997261.734927:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126994944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997261.734963:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126994944:12345-0@lo:400:kworker.0 Request processed in 37us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997261.734970:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:0.0:1780997261.734981:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:0.0:1780997261.734987:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126994816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997261.735014:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126994816:12345-0@lo:400:kworker.0 Request processed in 27us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997261.735020:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00080000:0.0:1780997261.735046:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780997261.735049:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997261.735066:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126994944:0@lo:400:kworker.0 00000100:00100000:0.0:1780997261.735131:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126994816:0@lo:400:kworker.0 00000100:00100000:0.0:1780997261.735143:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507126994560:0@lo:400:kworker.0 00000100:00100000:3.0:1780997261.735560:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126994688 00000100:00100000:3.0:1780997261.735566:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126994688 00000100:00100000:3.0:1780997261.735600:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4091 00000100:00100000:3.0:1780997261.735605:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126994688:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997261.735619:0:23042:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997261.735657:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126994688:12345-0@lo:38:kworker.0 Request processed in 51us (1130us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997261.735664:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4091 00000100:00080000:0.0:1780997261.738027:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997261.738039:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997261.738043:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126994688:0@lo:38:kworker.0 00010000:00010000:0.0:1780997262.053453:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997263.078395:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997263.782076:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780997263.782100:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126995200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780997263.782185:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997263.782518:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126995200 00000100:00100000:1.0:1780997263.782527:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126995200 00000100:00100000:1.0:1780997263.782582:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:1.0:1780997263.782591:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126995200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997263.782620:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997263.782663:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507126995200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997263.782671:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00100000:0.0:1780997263.782882:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126995328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997263.782912:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997263.783564:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126995328 00000100:00100000:0.0:1780997263.783570:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126995328 00000100:00100000:3.0:1780997263.783620:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126995200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997263.784294:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:0.0:1780997263.784304:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126995328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997263.784398:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997263.784578:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126995328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 276us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997263.784587:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00080000:0.0:1780997263.784608:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780997263.784611:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997263.784685:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126995328:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1780997264.102701:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1780997264.125061:0:90239:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1780997264.125070:0:90239:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1780997264.125072:0:90239:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1780997264.126369:0:90239:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9689a5877000 00000020:01000004:2.0:1780997264.126812:0:90239:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1780997264.126839:0:90239:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1780997264.126855:0:90239:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff968990fe0000) 00000020:00000080:2.0:1780997264.126873:0:90239:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1780997264.330754:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1780997264.331581:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1780997264.333765:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1780997264.333965:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1780997264.334620:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1780997264.334882:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1780997264.335410:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1780997264.335872:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1780997264.336091:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1780997264.336751:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1780997264.336925:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1780997264.337515:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1780997264.337719:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1780997264.337942:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1780997264.340611:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1780997264.353832:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1780997264.354621:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1780997264.355021:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1780997264.355559:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1780997264.355832:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1780997264.356062:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.356805:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1780997264.357136:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.357618:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1780997264.357826:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.358422:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.359008:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.360682:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.362601:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.363025:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.363464:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1780997264.363725:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1780997264.363991:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1780997264.364466:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1780997264.365539:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.366123:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.366610:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1780997264.366872:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1780997264.367147:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.367600:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1780997264.367868:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.368093:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1780997264.368617:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.369085:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1780997264.369533:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1780997264.369746:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1780997264.370229:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1780997264.372352:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1780997264.372926:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1780997264.373448:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1780997264.373523:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:2.0:1780997264.373555:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00100000:10000000:2.0:1780997264.373583:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:2.0:1780997264.374001:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1780997264.374548:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1780997264.374963:0:90239:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1780997264.376201:0:90239:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1780997264.376676:0:90239:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1780997264.376684:0:90239:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1780997264.376695:0:90239:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305b465 00000020:01000004:2.0:1780997264.376701:0:90239:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1780997264.376714:0:90239:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1780997264.376719:0:90239:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9689a5877000 from MGS 00000020:01000004:2.0:1780997264.376723:0:90239:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1780997264.376733:0:90239:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff968990fe4d40) 00000020:00000080:2.0:1780997264.376745:0:90239:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1780997264.376807:0:90239:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689a5877000 from MGS, refs=2 00080000:01000000:2.0:1780997264.376812:0:90239:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1780997264.376817:0:90239:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305b473 00010000:00010000:2.0:1780997264.376930:0:90239:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1780997264.382248:0:90239:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1780997264.385639:0:90243:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1780997264.385720:0:90239:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1780997264.385773:0:90239:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1780997264.391377:0:90239:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1780997264.391629:0:90239:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1780997264.391792:0:90239:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1780997264.391799:0:90239:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1780997264.392164:0:90239:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1780997264.392170:0:90239:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1780997264.392323:0:90239:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1780997264.392329:0:90239:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1780997264.402754:0:90239:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1780997264.402786:0:90239:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1780997264.402788:0:90239:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1780997264.402793:0:90239:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1780997264.402800:0:90239:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96898d0e6000 already not connected (conn 75, was 0): CONNECTING 00000100:00100000:0.0:1780997264.402807:0:90239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00010000:00010000:2.0:1780997265.128256:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997266.149598:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997266.184776:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997266.184838:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997266.184882:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997266.185098:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110420096 00000100:00100000:2.0:1780997266.185109:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110420096 00000100:00100000:2.0:1780997266.185174:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110419968 00000100:00100000:2.0:1780997266.185178:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110419968 00000100:00100000:2.0:1780997266.185214:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1376 00000100:00100000:2.0:1780997266.185226:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2394:x1867507110420096:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997266.185352:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2394:x1867507110420096:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 128us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997266.185359:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1376 00000100:00100000:2.0:1780997266.185379:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1437 00000100:00100000:2.0:1780997266.185383:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1867507110419968:12345-192.168.206.51@tcp:38:kworker.0 00010000:00020000:2.0:1780997266.185406:0:63584:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780997266.185432:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1867507110419968:12345-192.168.206.51@tcp:38:kworker.0 Request processed in 47us (549us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780997266.185438:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1437 00000100:00100000:1.0:1780997266.185456:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110419840 00000100:00100000:1.0:1780997266.185461:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110419840 00000100:00100000:1.0:1780997266.185493:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1780997266.185498:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2393:x1867507110419840:12345-192.168.206.51@tcp:250:kworker.0 00010000:00080000:1.0:1780997266.185515:0:90245:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp t0 exp 0000000000000000 cur 3793 last 0 00000020:00000080:1.0:1780997266.185542:0:90245:0:(genops.c:1406:class_connect()) connect: client cf5d474c-5b3a-4e23-b534-5ea64925b132, cookie 0x30fd811c0305b47a 00000100:00080000:1.0:1780997266.185673:0:90245:0:(import.c:65:import_set_state_nolock()) ffff96888a811800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997266.185703:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+4:2393:x1867507110419840:12345-192.168.206.51@tcp:250:kworker.0 Request processed in 203us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997266.185720:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00080000:3.0:1780997266.191809:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:3.0:1780997266.346502:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000020:00000080:3.0:1780997266.346514:0:9294:0:(genops.c:906:class_export_put()) final put ffff9689bcc14000/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000020:00000080:1.0:1780997266.346603:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bcc14000/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 for lustre-OST0001 00000020:00000080:1.0:1780997266.346667:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bcc17000 for lustre-OST0001 00000100:00020000:0.0:1780997266.405876:0:90239:0:(import.c:339:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) 00000100:00020000:0.0:1780997266.420132:0:90239:0:(import.c:363:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff9689bff6f100 x1867507126992768/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1780997266 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00020000:0.0:1780997266.451326:0:90239:0:(import.c:373:ptlrpc_invalidate_import()) MGS: Unregistering RPCs found (0). Network is sluggish? Waiting for them to error out. 00000100:00100000:0.0:1780997266.465987:0:90239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1780997266.854153:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997266.854162:0:13646:0:(pinger.c:249:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1780997266.854165:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997266.854169:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997266.854173:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997266.854181:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3789 00000100:00080000:0.0:1780997266.854185:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997266.854191:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997266.854232:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988613b80 x1867507126995456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997266.854288:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997266.854292:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997266.854294:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997266.854297:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3789 00000100:00080000:0.0:1780997266.854300:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997266.854318:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997266.854331:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968988611f80 x1867507126995712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997266.854356:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997266.854360:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997266.854361:0:13646:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997266.854366:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3789 00000100:00080000:0.0:1780997266.854368:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997266.854371:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997266.854384:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968986937100 x1867507126995968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997266.854405:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997266.854409:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780997266.854411:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997266.854414:0:13646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3789 00000100:00080000:0.0:1780997266.854416:0:13646:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780997266.854420:0:13646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997266.854430:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968889179500 x1867507126996352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997266.854484:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888d7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126996224:0@lo:400:kworker.0 00000100:00100000:0.0:1780997266.854550:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997266.854587:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997266.854593:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126995584:0@lo:400:kworker.0 00000100:00100000:0.0:1780997266.854622:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997266.854660:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126996096:0@lo:400:kworker.0 00000100:00100000:0.0:1780997266.854685:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997266.854702:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997266.854707:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126995840:0@lo:400:kworker.0 00000100:00100000:0.0:1780997266.854728:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997266.854752:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126996224 00000100:00100000:0.0:1780997266.854758:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126996224 00000100:00100000:1.0:1780997266.854875:0:3495:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780997256/real 1780997256] req@ffff9689bff6f100 x1867507126992768/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780997266 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997266.854897:0:3495:0:(client.c:2511:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9689bff6f100 x1867507126992768/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780997266 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997266.854910:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126995456:0@lo:38:kworker.0 00000100:00100000:1.0:1780997266.854951:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997266.854967:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126995712:0@lo:38:kworker.0 00000100:00100000:1.0:1780997266.854984:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997266.854999:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126995968:0@lo:38:kworker.0 00000100:00100000:1.0:1780997266.855018:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997266.855030:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126996352:0@lo:38:kworker.0 00000100:00100000:1.0:1780997266.855045:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780997266.855058:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997266.855080:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1780997266.855088:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126992768:0@lo:250:kworker.0 00000100:00100000:1.0:1780997266.855117:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126995584 00000100:00100000:1.0:1780997266.855121:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126995584 00000100:00100000:1.0:1780997266.855165:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126995840 00000100:00100000:1.0:1780997266.855168:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126995840 00000100:00100000:1.0:1780997266.855178:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126995456 00000100:00100000:1.0:1780997266.855180:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126995456 00000100:00100000:1.0:1780997266.855187:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126995712 00000100:00100000:1.0:1780997266.855196:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126995712 00000100:00100000:1.0:1780997266.855205:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126996352 00000100:00100000:1.0:1780997266.855206:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126996352 00000100:00100000:1.0:1780997266.855216:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1780997266.855224:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888917bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126995584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997266.855286:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888917bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507126995584:12345-0@lo:400:kworker.0 Request processed in 46us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997266.855294:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1780997266.855311:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1780997266.855317:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126995840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997266.855351:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507126995840:12345-0@lo:400:kworker.0 Request processed in 34us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997266.855357:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1780997266.855369:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1780997266.855373:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126995456:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997266.855389:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997266.855420:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126995456:12345-0@lo:38:kworker.0 Request processed in 46us (468us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997266.855427:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1780997266.855437:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1780997266.855441:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126995712:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997266.855450:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997266.855468:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126995712:12345-0@lo:38:kworker.0 Request processed in 27us (483us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997266.855475:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1780997266.855484:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:1.0:1780997266.855493:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126996352:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780997266.855503:0:80049:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997266.855521:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507126996352:12345-0@lo:38:kworker.0 Request processed in 28us (476us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997266.855526:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:1.0:1780997266.855570:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507126995584:0@lo:400:kworker.0 00000100:00080000:1.0:1780997266.855593:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997266.855597:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997266.855600:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507126995456:0@lo:38:kworker.0 00000100:00080000:1.0:1780997266.855607:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997266.855609:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997266.855612:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507126995712:0@lo:38:kworker.0 00000100:00080000:1.0:1780997266.855618:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997266.855621:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997266.855624:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507126996352:0@lo:38:kworker.0 00000100:00080000:1.0:1780997266.855643:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997266.855646:0:13646:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1780997266.855648:0:13646:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997266.855652:0:13646:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3784 00000100:00080000:1.0:1780997266.855654:0:13646:0:(import.c:591:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780997266.855658:0:13646:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997266.855674:0:13646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968889179500 x1867507126996480/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:1.0:1780997266.855698:0:3495:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff968889179500 x1867507126996480/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997266.856367:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126995968 00000100:00100000:3.0:1780997266.856376:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126995968 00000100:00100000:3.0:1780997266.856403:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4092 00000100:00100000:3.0:1780997266.856408:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b78dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126995968:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780997266.856420:0:8241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997266.856466:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b78dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126995968:12345-0@lo:38:kworker.0 Request processed in 57us (1446us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997266.856474:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4092 00000100:00080000:3.0:1780997266.856492:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997266.856530:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126996096 00000100:00100000:3.0:1780997266.856534:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126996096 00000100:00100000:3.0:1780997266.856565:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668 00000100:00100000:3.0:1780997266.856571:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888917a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126996096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997266.856607:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888917a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507126996096:12345-0@lo:400:kworker.0 Request processed in 36us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997266.856613:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668 00000100:00080000:3.0:1780997266.856632:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997266.856684:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507126995840:0@lo:400:kworker.0 00000100:00100000:3.0:1780997266.856697:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507126996096:0@lo:400:kworker.0 10000000:01000000:3.0:1780997266.856721:0:90239:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1780997266.856734:0:90239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305ad8f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305ad96 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997266.856745:0:90239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305ad8f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305ad96 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997266.856752:0:90239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1780997266.856836:0:90239:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1780997266.856846:0:90239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc843e00/0x30fd811c0305ad8f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305ad96 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.856864:0:90239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968980031000/0x30fd811c0305b186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305b18d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997266.856872:0:90239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968980031000/0x30fd811c0305b186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305b18d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997266.856877:0:90239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997266.856881:0:90239:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1780997266.856884:0:90239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968980031000/0x30fd811c0305b186 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305b18d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.856895:0:90239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968889ffca00/0x30fd811c0305b194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305b19b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997266.856902:0:90239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968889ffca00/0x30fd811c0305b194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305b19b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997266.857513:0:90239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997266.857538:0:90239:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1780997266.857545:0:90239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968889ffca00/0x30fd811c0305b194 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305b19b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.857555:0:90239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305b1a9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997266.857561:0:90239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305b1a9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997266.857566:0:90239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997266.857569:0:90239:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1780997266.857572:0:90239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b1a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305b1a9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.857581:0:90239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b1b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305b1b7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997266.857588:0:90239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b1b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305b1b7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997266.857592:0:90239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997266.857595:0:90239:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1780997266.857598:0:90239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b1b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305b1b7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.857606:0:90239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b1be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305b1c5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997266.857624:0:90239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b1be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305b1c5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997266.857629:0:90239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997266.857633:0:90239:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1780997266.857637:0:90239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b1be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305b1c5 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.857646:0:90239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968889ffc200/0x30fd811c0305b1cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305b1d3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997266.857652:0:90239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968889ffc200/0x30fd811c0305b1cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305b1d3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997266.857656:0:90239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997266.857659:0:90239:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1780997266.857662:0:90239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968889ffc200/0x30fd811c0305b1cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305b1d3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.857670:0:90239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305b1e1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997266.857676:0:90239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305b1e1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997266.857681:0:90239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997266.857684:0:90239:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1780997266.857687:0:90239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02400/0x30fd811c0305b1da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305b1e1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.857710:0:90239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc843400/0x30fd811c0305ad03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305ad0a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997266.857717:0:90239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc843400/0x30fd811c0305ad03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305ad0a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997266.857722:0:90239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997266.857725:0:90239:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1780997266.857728:0:90239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc843400/0x30fd811c0305ad03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305ad0a expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.857738:0:90239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305ad1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305ad26 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997266.857744:0:90239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305ad1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305ad26 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997266.857749:0:90239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997266.857751:0:90239:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1780997266.857754:0:90239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc842c00/0x30fd811c0305ad1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305ad26 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997266.858131:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:0.0:1780997266.858141:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126996224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997266.858209:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507126996224:12345-0@lo:400:kworker.0 Request processed in 70us (3658us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997266.858215:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00080000:0.0:1780997266.858237:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997266.858265:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888d7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507126996224:0@lo:400:kworker.0 00010000:00010000:3.0:1780997266.858867:0:90239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bb4efe00/0x30fd811c0305ad2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305ad34 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997266.858879:0:90239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bb4efe00/0x30fd811c0305ad2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305ad34 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997266.858885:0:90239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1780997266.858956:0:90239:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1780997266.858964:0:90239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bb4efe00/0x30fd811c0305ad2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305ad34 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.858977:0:90239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968888955a00/0x30fd811c0305ad57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305ad5e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997266.858984:0:90239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968888955a00/0x30fd811c0305ad57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305ad5e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997266.858989:0:90239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1780997266.872285:0:90239:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1780997266.872303:0:90239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968888955a00/0x30fd811c0305ad57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305ad5e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.872326:0:90239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968983ce2800/0x30fd811c0305ad81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x30fd811c0305ad88 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997266.872334:0:90239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968983ce2800/0x30fd811c0305ad81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x30fd811c0305ad88 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997266.872340:0:90239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1780997266.872346:0:90239:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1780997266.872349:0:90239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968983ce2800/0x30fd811c0305ad81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x30fd811c0305ad88 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1780997266.892919:0:90239:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96898d0e6000 already not connected (conn 76, was 0): CONNECTING 00000100:00080000:3.0:1780997266.892930:0:90239:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:1.0:1780997266.894890:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997266.895178:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:1.0:1780997266.895197:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:0:1867507126996480:0@lo:250:kworker.0 00000100:00080000:1.0:1780997266.895236:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997266.895239:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997266.895243:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507126995968:0@lo:38:kworker.0 00000100:00080000:2.0:1780997266.898871:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997266.898880:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1780997266.898883:0:38:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997266.898891:0:38:0:(import.c:512:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 3794 00000100:00080000:2.0:1780997266.898897:0:38:0:(import.c:591:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780997266.898904:0:38:0:(import.c:626:import_select_connection()) MGC192.168.206.151@tcp: import ffff96898d0e6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997266.899493:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bc960000 x1867507126996608/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997266.899573:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126996608:0@lo:250:kworker.0 00000100:00100000:1.0:1780997266.899647:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997266.900145:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126996608 00000100:00100000:3.0:1780997266.900153:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126996608 00000100:00100000:2.0:1780997266.900545:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1780997266.900553:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3495:x1867507126996608:12345-0@lo:250:kworker.0 00010000:00080000:2.0:1780997266.900577:0:90247:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo t0 exp 0000000000000000 cur 3794 last 0 00000020:00000080:2.0:1780997266.900603:0:90247:0:(genops.c:1406:class_connect()) connect: client bdcd4e03-8d56-43b8-bfda-3b2f97e67d18, cookie 0x30fd811c0305b481 00000100:00080000:2.0:1780997266.900733:0:90247:0:(import.c:65:import_set_state_nolock()) ffff968990f90800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997266.900936:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:3495:x1867507126996608:12345-0@lo:250:kworker.0 Request processed in 382us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997266.900944:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1780997266.902202:0:3495:0:(client.c:3131:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 28 00000100:00080000:3.0:1780997266.902226:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:3.0:1780997266.902235:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1780997266.902240:0:3495:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1780997266.902244:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898d0e6000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1780997266.902247:0:3495:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1780997266.902452:0:3495:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1780997266.902464:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3495:1867507126996608:0@lo:250:kworker.0 00000020:01000000:3.0:1780997266.902594:0:38:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.206.151@tcp 10000000:01000000:3.0:1780997266.902614:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1780997266.902617:0:38:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1780997266.902619:0:38:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780997266.902620:0:38:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997266.902621:0:38:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997266.902622:0:38:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997266.902624:0:38:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997266.902625:0:38:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780997266.902627:0:38:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997266.902628:0:38:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1780997266.902685:0:38:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1780997266.902692:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1780997266.902693:0:38:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1780997266.902695:0:38:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1780997266.902696:0:38:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997266.902697:0:38:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997266.902698:0:38:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997266.902699:0:38:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997266.902700:0:38:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780997266.902701:0:38:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997266.902702:0:38:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1780997266.902722:0:38:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1780997266.902726:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1780997266.902728:0:38:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1780997266.902729:0:38:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1780997266.902730:0:38:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997266.902731:0:38:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997266.902732:0:38:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997266.902733:0:38:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997266.902734:0:38:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780997266.902735:0:38:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997266.902736:0:38:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1780997266.902757:0:38:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1780997266.902897:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997266.902924:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126996736:0@lo:253:kworker.0 00000100:00100000:2.0:1780997266.902998:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997266.903045:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126996736 00000100:00100000:2.0:1780997266.903051:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126996736 00000100:00100000:2.0:1780997266.903121:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1780997266.903131:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:3498:x1867507126996736:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1780997266.903158:0:90245:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:2.0:1780997266.903344:0:90248:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1780997266.903443:0:90245:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 120 00000100:00100000:0.0:1780997266.903844:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126996992:0@lo:253:kworker.0 00000100:00100000:0.0:1780997266.903899:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997266.903925:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997266.903932:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126996864:0@lo:253:kworker.0 00000100:00100000:0.0:1780997266.903959:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997266.903990:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126996992 00000100:00100000:0.0:1780997266.904011:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126996992 00000100:00100000:0.0:1780997266.904032:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126996864 00000100:00100000:0.0:1780997266.904034:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126996864 00000100:00100000:0.0:1780997266.904047:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1780997266.904054:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:3497:x1867507126996992:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1780997266.904087:0:90247:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:0.0:1780997266.905189:0:90239:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1780997266.905213:0:90239:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1780997266.905527:0:90239:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1780997266.905534:0:90239:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1780997266.905701:0:90239:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1780997266.905735:0:90239:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1780997266.905739:0:90239:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1780997266.905741:0:90239:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780997266.905742:0:90239:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997266.905743:0:90239:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997266.905744:0:90239:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997266.905745:0:90239:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997266.905747:0:90239:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997266.905748:0:90239:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780997266.905751:0:90239:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997266.905752:0:90239:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1780997266.905755:0:90239:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1780997266.905757:0:90239:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1780997266.905758:0:90239:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780997266.905759:0:90239:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780997266.905760:0:90239:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780997266.905761:0:90239:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780997266.905762:0:90239:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780997266.905763:0:90239:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780997266.905764:0:90239:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780997266.905764:0:90239:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780997266.905766:0:90239:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1780997266.905985:0:90239:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1780997266.906096:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126997120:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1780997266.906169:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997266.906220:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72780 going to sleep for 11 seconds 00000100:00100000:1.0:1780997266.906455:0:90246:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1780997266.906466:0:90246:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1780997266.907056:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126997120 00000100:00100000:0.0:1780997266.907074:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126997120 00000100:00100000:1.0:1780997266.907153:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1780997266.907163:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d2cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3497:x1867507126996864:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1780997266.907195:0:90250:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1780997266.912332:0:90249:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1780997266.912344:0:90249:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1780997266.912348:0:90249:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1780997266.912351:0:90249:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1780997266.912376:0:90249:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:0.0:1780997266.920019:0:90245:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1780997266.920042:0:90245:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1780997266.923190:0:90245:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1780997266.923216:0:90245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1780997266.923547:0:90247:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1780997266.923814:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3498:x1867507126996736:12345-0@lo:253:kworker.0 Request processed in 20680us (20821us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997266.923826:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1780997266.923866:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1780997266.923877:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a67c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:90239:x1867507126997120:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1780997266.923928:0:90245:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1780997266.923931:0:90245:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1780997266.923934:0:90245:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1780997266.923949:0:90245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:2.0:1780997266.924364:0:3498:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1780997266.924367:0:3498:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1780997266.924368:0:3498:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780997266.924369:0:3498:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780997266.924371:0:3498:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780997266.924373:0:3498:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780997266.924374:0:3498:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780997266.924376:0:3498:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780997266.924378:0:3498:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1780997266.924382:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ad884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507126996736:0@lo:253:kworker.0 20000000:01000000:3.0:1780997266.924490:0:90248:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1780997266.924495:0:90248:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1780997266.924519:0:90248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b488 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.924534:0:90248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b488 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780997266.924543:0:90248:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000048815s 00010000:00010000:3.0:1780997266.924548:0:90248:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b488 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.924554:0:90248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b488 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.924562:0:90248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b488 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.924569:0:90248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b488 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.924574:0:90248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997266.924578:0:90248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b488 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.924586:0:90248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b488 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.924598:0:90248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b488 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.924605:0:90248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b488 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.924625:0:90248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b488 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997266.928705:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a67c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:90239:x1867507126997120:12345-0@lo:253:mount.lustre.0 Request processed in 4821us (22526us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997266.928720:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 20000000:01000000:2.0:1780997266.929010:0:90247:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780997266.929018:0:90247:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1780997266.929136:0:90248:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1780997266.929141:0:90248:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1780997266.929162:0:90248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305b48f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.929178:0:90248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305b48f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780997266.929188:0:90248:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000048815s 00010000:00010000:3.0:1780997266.929193:0:90248:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305b48f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.929200:0:90248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305b48f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.929206:0:90248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305b48f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.929213:0:90248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305b48f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.929220:0:90248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997266.929224:0:90248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305b48f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.929250:0:90248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305b48f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.929263:0:90248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305b48f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.929292:0:90248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305b48f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.929300:0:90248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb3a00/0x30fd811c0305b48f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780997266.929330:0:90250:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1780997266.929742:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126997120:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1780997266.929757:0:90239:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1780997266.929760:0:90239:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1780997266.929833:0:90239:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780997266.929835:0:90239:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997266.929836:0:90239:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997266.929838:0:90239:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997266.929839:0:90239:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997266.929840:0:90239:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780997266.929841:0:90239:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780997266.929843:0:90239:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997266.929845:0:90239:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1780997266.929869:0:90239:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9689a5877000 from lustre-MDT0000 10000000:01000000:1.0:1780997266.929909:0:90239:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1780997266.929912:0:90239:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1780997266.929930:0:90239:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9689a5877000 10000000:01000000:1.0:1780997266.929941:0:90239:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1780997266.929947:0:90239:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9689a5877000 10000000:01000000:1.0:1780997266.929949:0:90239:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1780997266.929952:0:90239:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9689a5877000 from 1 10000000:01000000:1.0:1780997266.929954:0:90239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1780997266.930191:0:90239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305b496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.930201:0:90239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305b496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.930211:0:90239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305b496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997266.930235:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126997248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1780997266.930334:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997266.930367:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885805cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997266.930599:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126997248 00000100:00100000:2.0:1780997266.930607:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126997248 00000100:00100000:2.0:1780997266.930648:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1780997266.930657:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a67c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:90239:x1867507126997248:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997266.930670:0:90246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997266.930694:0:90246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba454000/0x30fd811c0305b49d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b496 expref: -99 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997266.930718:0:90246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454000/0x30fd811c0305b49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b496 expref: 7 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997266.930727:0:90246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba454000/0x30fd811c0305b49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b496 expref: 7 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997266.930735:0:90246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454000, rc 0) 00000100:00100000:0.0:1780997266.930980:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3497:x1867507126996992:12345-0@lo:253:kworker.0 Request processed in 26924us (27079us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997266.931192:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1780997266.931300:0:3497:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1780997266.931303:0:3497:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1780997266.931304:0:3497:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997266.931305:0:3497:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997266.931307:0:3497:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997266.931308:0:3497:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997266.931309:0:3497:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780997266.931311:0:3497:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997266.931312:0:3497:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1780997266.931316:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126996992:0@lo:253:kworker.0 00000100:00100000:2.0:1780997266.931391:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a67c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:90239:x1867507126997248:12345-0@lo:101:mount.lustre.0 Request processed in 735us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997266.931398:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1780997266.931602:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126997248:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997266.931618:0:90239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305b496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b49d expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.931627:0:90239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305b496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b49d expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997266.931640:0:90239:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1780997266.931656:0:90239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305b496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b49d expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.931675:0:90239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02c00/0x30fd811c0305b496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b49d expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997266.931682:0:90239:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1780997266.931686:0:90239:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1780997266.931691:0:90239:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9689a5877000 10000000:01000000:1.0:1780997266.931694:0:90239:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1780997266.931697:0:90239:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1780997266.931700:0:90239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1780997266.931724:0:90239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.931730:0:90239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.931738:0:90239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997266.931753:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126997376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1780997266.933261:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997266.933328:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885805cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997266.933506:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126997376 00000100:00100000:3.0:1780997266.933515:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126997376 00000100:00100000:3.0:1780997266.933559:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1780997266.933567:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a67c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:90239:x1867507126997376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997266.933582:0:90245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997266.933599:0:90245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b4ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b4a4 expref: -99 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.933641:0:90245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b4a4 expref: 7 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.933652:0:90245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b4a4 expref: 7 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997266.933661:0:90245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2800, rc 0) 00000100:00100000:3.0:1780997266.933715:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a67c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:90239:x1867507126997376:12345-0@lo:101:mount.lustre.0 Request processed in 148us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997266.933721:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1780997266.933744:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126997376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780997266.933761:0:90239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b4ab expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997266.933771:0:90239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b4ab expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997266.933866:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc962a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126997504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997266.933896:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997266.933934:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126997504 00000100:00100000:2.0:1780997266.933938:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126997504 00000100:00100000:2.0:1780997266.933962:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1780997266.933969:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:90239:x1867507126997504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780997266.934485:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff968983699e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780997266.934602:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:90239:x1867507126997504:12345-0@lo:501:mount.lustre.0 Request processed in 632us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997266.934623:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1780997266.934866:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc962a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126997504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780997266.934900:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126997632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780997266.935016:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997266.935096:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a2480 going to sleep for 11 seconds 20000000:01000000:3.0:1780997266.935753:0:90250:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1780997266.935774:0:90250:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1780997266.936049:0:90248:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780997266.936055:0:90248:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780997266.936090:0:90248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689bff02400/0x30fd811c0305b4b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.936106:0:90248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02400/0x30fd811c0305b4b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780997266.936126:0:90248:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000073509s 00010000:00010000:1.0:1780997266.936131:0:90248:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bff02400/0x30fd811c0305b4b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.936137:0:90248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bff02400/0x30fd811c0305b4b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.936144:0:90248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689bff02400/0x30fd811c0305b4b2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.936150:0:90248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689bff02400/0x30fd811c0305b4b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.936156:0:90248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997266.936160:0:90248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689bff02400/0x30fd811c0305b4b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.936168:0:90248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689bff02400/0x30fd811c0305b4b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.936180:0:90248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689bff02400/0x30fd811c0305b4b2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.936187:0:90248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689bff02400/0x30fd811c0305b4b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997266.936193:0:90248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02400/0x30fd811c0305b4b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997266.936455:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d2cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:3497:x1867507126996864:12345-0@lo:253:kworker.0 Request processed in 29291us (32492us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997266.936463:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1780997266.936500:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126997632 00000100:00100000:3.0:1780997266.936507:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126997632 00000020:01000004:1.0:1780997266.936582:0:3497:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1780997266.936591:0:3497:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1780997266.936593:0:3497:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997266.936594:0:3497:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997266.936595:0:3497:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997266.936597:0:3497:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997266.936598:0:3497:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1780997266.936601:0:3497:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997266.936602:0:3497:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1780997266.936605:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507126996864:0@lo:253:kworker.0 00000100:00100000:0.0:1780997266.936884:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1780997266.936894:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:90239:x1867507126997632:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780997266.937248:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:90239:x1867507126997632:12345-0@lo:503:mount.lustre.0 Request processed in 354us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997266.937256:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1780997266.937404:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126997632:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780997266.942552:0:90251:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90251:1867507126997760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997266.942650:0:90251:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997266.942751:0:90251:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72f00 going to sleep for 11 seconds 00000100:00100000:2.0:1780997266.945889:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126997760 00000100:00100000:2.0:1780997266.945904:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126997760 00000100:00100000:2.0:1780997266.946179:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1780997266.946193:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:90251:x1867507126997760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997266.947859:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:90251:x1867507126997760:12345-0@lo:502:llog_process_th.0 Request processed in 1661us (5200us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997266.947872:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1780997266.947999:0:90251:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90251:1867507126997760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780997266.948030:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997266.948041:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997266.948043:0:90251:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1780997266.948046:0:90251:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1780997266.948048:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780997266.948072:0:90251:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9688858c19c0) 00000020:00000080:1.0:1780997266.948097:0:90251:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:1.0:1780997266.948104:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1780997266.948198:0:90251:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1780997266.948205:0:90251:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305b4c0 00000020:00000080:1.0:1780997266.948510:0:90251:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1780997266.948515:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997266.948519:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997266.948520:0:90251:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1780997266.948523:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997266.948526:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997266.948527:0:90251:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1780997266.948530:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780997266.948538:0:90251:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff96888ac53380) 00000020:00000080:1.0:1780997266.948550:0:90251:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:1.0:1780997266.948554:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1780997266.948564:0:90251:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1780997266.948567:0:90251:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1780997266.948573:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1780997266.948623:0:90251:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689a5877000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1780997266.948636:0:90251:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff96888ac50000) 00000020:00000080:1.0:1780997266.948646:0:90251:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:1.0:1780997266.948694:0:90251:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1780997266.948700:0:90251:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305b4d5 00000020:00000080:1.0:1780997266.948796:0:90251:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1780997266.948802:0:90251:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1780997266.948808:0:90251:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x30fd811c0305b4dc 00080000:01000000:1.0:1780997266.948813:0:90251:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1780997266.948815:0:90251:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305b4e3 00010000:00010000:1.0:1780997267.022387:0:90251:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:1.0:1780997267.022940:0:90251:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 111669149700 srv lr: 115964116992 lx: 0 gen 21 00000001:00080000:1.0:1780997267.022979:0:90251:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 idx: 2 lr: 0 srv lr: 115964116992 lx: 0 gen 23 00000001:00000004:1.0:1780997267.023000:0:90251:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116992 00000001:00080000:1.0:1780997267.023110:0:90251:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1780997267.023169:0:90251:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9689bccb5e40: xid 1867507126982400, transno 115964117001, client gen 21, slot idx 0 00000001:00080000:1.0:1780997267.023178:0:90251:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9689bccb5240: xid 1867507126982656, transno 115964117002, client gen 21, slot idx 1 00000001:00080000:1.0:1780997267.023183:0:90251:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9689bccb53c0: xid 1867507110407808, transno 115964116998, client gen 23, slot idx 2 00000001:00080000:1.0:1780997267.023187:0:90251:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9689bccb56c0: xid 1867507110407424, transno 115964116997, client gen 23, slot idx 3 00000020:00000080:1.0:1780997267.023718:0:90251:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff96888ac54d40) 00000020:00000080:1.0:1780997267.023738:0:90251:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:1.0:1780997267.024460:0:90251:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1780997267.024471:0:90251:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305b4ff 00000020:00000080:2.0:1780997267.032026:0:90251:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1780997267.038355:0:90251:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x30fd811c0305b506 00000020:00000080:1.0:1780997267.038815:0:90251:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1780997267.038828:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997267.038834:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.038842:0:90251:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1780997267.038846:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780997267.038848:0:90251:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1780997267.038850:0:90251:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997267.038852:0:90251:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997267.038854:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780997267.039014:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.039016:0:90251:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780997267.039020:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997267.039025:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.039027:0:90251:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1780997267.039032:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1780997267.039085:0:90251:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1780997267.039103:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997267.039106:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.039108:0:90251:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1780997267.039111:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997267.039114:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.039115:0:90251:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1780997267.039118:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780997267.039124:0:90251:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:00000080:1.0:1780997267.039146:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780997267.039161:0:90251:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff96888ac519c0) 00000020:00000080:1.0:1780997267.039179:0:90251:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1780997267.039183:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1780997267.039237:0:90251:0:(osp_dev.c:1197:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1780997267.039243:0:90251:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1780997267.039248:0:90251:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305b514 00010000:00080000:1.0:1780997267.039347:0:90251:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689869cf800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1780997267.043930:0:90251:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1780997267.045738:0:90251:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997267.045755:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1780997267.045851:0:90251:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1780997267.045882:0:90251:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305b51b 00000100:00080000:1.0:1780997267.045892:0:90251:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780997267.045897:0:90251:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9689869cf800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997267.045933:0:90251:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968889179500 x1867507126997888/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997267.045962:0:90251:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1780997267.046008:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126997888:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1780997267.046055:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997267.046069:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.046071:0:90251:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1780997267.046075:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780997267.046078:0:90251:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1780997267.046079:0:90251:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997267.046081:0:90251:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997267.046083:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780997267.046086:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.046087:0:90251:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780997267.046090:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1780997267.046095:0:90251:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1780997267.046098:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.046099:0:90251:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1780997267.046102:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780997267.046106:0:90251:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:1.0:1780997267.046132:0:90251:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1780997267.046135:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780997267.046153:0:90251:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9689ba4e4d40) 00000020:00000080:1.0:1780997267.046171:0:90251:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1780997267.046176:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1780997267.046191:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1780997267.046287:0:90251:0:(osp_dev.c:1197:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1780997267.046294:0:90251:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1780997267.046301:0:90251:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305b529 00010000:00080000:1.0:1780997267.046331:0:90251:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96888a815000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00000100:00100000:3.0:1780997267.046397:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126997888 00000100:00100000:3.0:1780997267.046406:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126997888 00010000:00010000:1.0:1780997267.046532:0:90251:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1780997267.046614:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4093 00000100:00100000:3.0:1780997267.046622:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507126997888:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1780997267.046646:0:23042:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3794 last 0 00000020:00000080:3.0:1780997267.046689:0:23042:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305b530 00000004:00100000:3.0:1780997267.046702:0:23042:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780997267.046802:0:23042:0:(import.c:65:import_set_state_nolock()) ffff96888969e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780997267.046879:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126997888:12345-0@lo:38:llog_process_th.0 Request processed in 257us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997267.046887:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4093 00000100:00100000:1.0:1780997267.047219:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1780997267.047228:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1780997267.047236:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1780997267.047240:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1780997267.047243:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689869cf800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1780997267.047250:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126997888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780997267.047561:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126998016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997267.047594:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997267.048132:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126998016 00000100:00100000:3.0:1780997267.048141:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126998016 00000100:00100000:3.0:1780997267.048176:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4094 00000100:00100000:3.0:1780997267.048335:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126998016:12345-0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1780997267.048503:0:90251:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1780997267.048527:0:90251:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000004:00000024:3.0:1780997267.048570:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000040:00080000:1.0:1780997267.049411:0:90251:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000040:00080000:1.0:1780997267.051148:0:90251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780997267.051184:0:90251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000100:00100000:3.0:1780997267.055534:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126998016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7340us (7927us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997267.055550:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4094 00000100:00100000:2.0:1780997267.055717:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126998016:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1780997267.063897:0:90251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000040:00080000:2.0:1780997267.065378:0:90257:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:2.0:1780997267.065385:0:90257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1780997267.065571:0:90257:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000040:00080000:2.0:1780997267.065593:0:90257:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1780997267.065720:0:90257:0:(llog.c:800:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:2.0:1780997267.065724:0:90257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1780997267.066604:0:90251:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997267.066617:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1780997267.066654:0:90251:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1780997267.066674:0:90251:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305b537 00000100:00080000:1.0:1780997267.066684:0:90251:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780997267.066690:0:90251:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96888a815000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997267.066727:0:90251:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968889179500 x1867507126998144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997267.067475:0:90251:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1780997267.067589:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126998144:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780997267.067666:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997267.067760:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126998144 00000100:00100000:1.0:1780997267.067767:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126998144 00000100:00100000:1.0:1780997267.067806:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5972 00000100:00100000:1.0:1780997267.067813:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3495:x1867507126998144:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1780997267.067843:0:25168:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3794 last 0 00000020:00000080:1.0:1780997267.067886:0:25168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305b53e 00002000:00100000:1.0:1780997267.067900:0:25168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9689891ae800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1780997267.067904:0:25168:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1780997267.067907:0:25168:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1780997267.067979:0:25168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1780997267.068002:0:25168:0:(import.c:65:import_set_state_nolock()) ffff9689891ab000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997267.068050:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126998144:12345-0@lo:8:llog_process_th.0 Request processed in 236us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997267.068056:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5972 00000020:01000000:1.0:1780997267.068134:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997267.068139:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.068141:0:90251:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1780997267.068144:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780997267.068146:0:90251:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1780997267.068148:0:90251:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997267.068149:0:90251:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780997267.068151:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780997267.068152:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.068154:0:90251:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780997267.068156:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1780997267.068161:0:90251:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1780997267.068164:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.068165:0:90251:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1780997267.068167:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780997267.068171:0:90251:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:1.0:1780997267.068190:0:90251:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1780997267.068193:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780997267.068207:0:90251:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9689ba4e19c0) 00000020:00000080:1.0:1780997267.068224:0:90251:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:1.0:1780997267.068230:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1780997267.068334:0:90251:0:(osp_dev.c:1197:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1780997267.068340:0:90251:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1780997267.068411:0:90251:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x30fd811c0305b54c 00010000:00080000:1.0:1780997267.068439:0:90251:0:(ldlm_lib.c:102:import_set_conn()) imp ffff968886bc8000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1780997267.068633:0:90251:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1780997267.068701:0:90251:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1780997267.068720:0:90251:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1780997267.069496:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780997267.069507:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1780997267.069524:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1780997267.069530:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1780997267.069533:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000040:00080000:1.0:1780997267.069793:0:90251:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000100:00100000:3.0:1780997267.072664:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780997267.072686:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126998272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780997267.072754:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1780997267.073066:0:90251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1780997267.073100:0:90251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:3.0:1780997267.073401:0:90251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000100:00100000:0.0:1780997267.073484:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126998272 00000100:00100000:0.0:1780997267.073492:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126998272 00000100:00100000:0.0:1780997267.073554:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:0.0:1780997267.073565:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126998272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780997267.073599:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997267.073650:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507126998272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997267.073657:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00000100:00080000:3.0:1780997267.073720:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997267.073761:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507126998272:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1780997267.073965:0:3495:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:2.0:1780997267.073975:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126998144:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1780997267.073999:0:90257:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1780997267.074042:0:90257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3794619771073ns, next at 0ns, rc = 0 00080000:00080000:2.0:1780997267.074048:0:90257:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:0.0:1780997267.074703:0:90259:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:0.0:1780997267.074709:0:90259:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1780997267.074860:0:90259:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000020:00000080:1.0:1780997267.075814:0:90251:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780997267.075827:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1780997267.075864:0:90251:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1780997267.075882:0:90251:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305b553 00000100:00080000:1.0:1780997267.075891:0:90251:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780997267.075897:0:90251:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff968886bc8000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997267.075929:0:90251:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff968889179500 x1867507126998400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780997267.075951:0:90251:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000040:00080000:0.0:1780997267.076068:0:90259:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1780997267.076219:0:90259:0:(llog.c:800:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:0.0:1780997267.076224:0:90259:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:01000000:1.0:1780997267.076375:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997267.076380:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.076382:0:90251:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1780997267.076386:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997267.076390:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.076392:0:90251:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1780997267.076395:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1780997267.076397:0:90251:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1780997267.076399:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997267.076401:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.076403:0:90251:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1780997267.076406:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997267.076408:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.076409:0:90251:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1780997267.076422:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1780997267.076429:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780997267.076431:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.076433:0:90251:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000020:01000000:1.0:1780997267.076435:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997267.076439:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997267.076441:0:90251:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:1.0:1780997267.076444:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1780997267.076486:0:90251:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:1.0:1780997267.076863:0:90251:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90251:1867507126998528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997267.076946:0:90251:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997267.076980:0:90251:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986925e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780997267.077187:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126998400:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780997267.077227:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997267.077334:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126998400 00000100:00100000:1.0:1780997267.077341:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126998400 00000100:00100000:1.0:1780997267.077372:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5973 00000100:00100000:1.0:1780997267.077378:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3495:x1867507126998400:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1780997267.077410:0:25180:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3794 last 0 00000020:00000080:1.0:1780997267.077433:0:25180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x30fd811c0305b55a 00002000:00100000:1.0:1780997267.077446:0:25180:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff968886bcb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1780997267.077451:0:25180:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1780997267.077454:0:25180:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1780997267.077516:0:25180:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1780997267.077542:0:25180:0:(import.c:65:import_set_state_nolock()) ffff968886bcf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997267.077597:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3495:x1867507126998400:12345-0@lo:8:llog_process_th.0 Request processed in 218us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997267.077604:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5973 00000100:00100000:0.0:1780997267.077691:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126998528 00000100:00100000:0.0:1780997267.077696:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126998528 00000100:00100000:0.0:1780997267.077725:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1780997267.077733:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:90251:x1867507126998528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997267.077829:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:90251:x1867507126998528:12345-0@lo:502:llog_process_th.0 Request processed in 96us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997267.077836:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1780997267.077892:0:90251:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90251:1867507126998528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780997267.077922:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997267.077928:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997267.077930:0:90251:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:0.0:1780997267.077933:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780997267.077937:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997267.077938:0:90251:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1780997267.077941:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1780997267.077952:0:90251:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1780997267.078410:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780997267.078418:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1780997267.078426:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1780997267.078430:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1780997267.078434:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968886bc8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1780997267.078448:0:3495:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:2.0:1780997267.078454:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507126998400:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1780997267.078509:0:90259:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1780997267.078564:0:90259:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3794624293358ns, next at 0ns, rc = 0 00080000:00080000:1.0:1780997267.078571:0:90259:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1780997267.078663:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997267.078679:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126998656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780997267.078725:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997267.078758:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126998656 00000100:00100000:0.0:1780997267.078763:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126998656 00000100:00100000:0.0:1780997267.078803:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:0.0:1780997267.078812:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126998656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780997267.078833:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997267.078869:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507126998656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997267.078875:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00000100:00100000:0.0:1780997267.078909:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507126998656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780997267.080871:0:90251:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90251:1867507126998784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997267.080961:0:90251:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997267.081016:0:90251:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc723c0 going to sleep for 11 seconds 00000020:01000004:0.0:1780997267.081071:0:90261:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689a5877000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1780997267.081075:0:90261:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689a5877000 4 00000100:00100000:2.0:1780997267.081177:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126998784 00000100:00100000:2.0:1780997267.081192:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126998784 00000100:00100000:2.0:1780997267.081232:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1780997267.081240:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:90251:x1867507126998784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997267.081370:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:90251:x1867507126998784:12345-0@lo:502:llog_process_th.0 Request processed in 130us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997267.081377:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:2.0:1780997267.081496:0:90240:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:2.0:1780997267.082694:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997267.085264:0:90251:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90251:1867507126998784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780997267.085335:0:90251:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997267.085346:0:90251:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997267.085349:0:90251:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1780997267.085354:0:90251:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:3.0:1780997267.085845:0:90239:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:3.0:1780997267.085885:0:90239:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1780997267.085912:0:90239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b4ab expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.085924:0:90239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b4ab expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997267.085945:0:90239:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9689a5877000 from 1 10000000:01000000:3.0:1780997267.085947:0:90239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1780997267.085982:0:90239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.085990:0:90239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.086105:0:90239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997267.086128:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126998912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1780997267.086193:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997267.086231:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1780997267.086727:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126998912 00000100:00100000:0.0:1780997267.086735:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126998912 00000100:00100000:0.0:1780997267.086854:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1780997267.086865:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:90239:x1867507126998912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780997267.086879:0:90245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997267.086902:0:90245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968889ffda00/0x30fd811c0305b568 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b561 expref: -99 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.086926:0:90245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffda00/0x30fd811c0305b568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b561 expref: 8 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.086936:0:90245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968889ffda00/0x30fd811c0305b568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b561 expref: 8 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.086945:0:90245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffda00, rc 0) 00000100:00100000:0.0:1780997267.086990:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:90239:x1867507126998912:12345-0@lo:101:mount.lustre.0 Request processed in 127us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997267.087011:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1780997267.087110:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126998912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997267.087124:0:90239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b568 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.087133:0:90239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b568 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997267.087716:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126999040:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1780997267.087763:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997267.087791:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1780997267.088384:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126999040 00000100:00100000:2.0:1780997267.088399:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126999040 00000100:00100000:2.0:1780997267.088443:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1780997267.088452:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:90239:x1867507126999040:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1780997267.088469:0:90247:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1780997267.088487:0:90247:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1780997267.088491:0:90247:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1780997267.088495:0:90247:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1780997267.088497:0:90247:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 123 00000100:00100000:2.0:1780997267.088589:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:90239:x1867507126999040:12345-0@lo:256:mount.lustre.0 Request processed in 138us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997267.088596:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1780997267.090793:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126999040:0@lo:256:mount.lustre.0 00000004:00080000:3.0:1780997267.092743:0:90240:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:1.0:1780997267.093966:0:90239:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780997267.094003:0:90239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b568 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.094017:0:90239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b568 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997267.094115:0:90239:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9689a5877000 from 1 10000000:01000000:0.0:1780997267.094119:0:90239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780997267.094161:0:90239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffc400/0x30fd811c0305b56f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.094169:0:90239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968889ffc400/0x30fd811c0305b56f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.094179:0:90239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968889ffc400/0x30fd811c0305b56f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997267.094217:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126999168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780997267.094304:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997267.094352:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997267.094667:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126999168 00000100:00100000:1.0:1780997267.094674:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126999168 00000100:00100000:1.0:1780997267.094864:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1780997267.094875:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:90239:x1867507126999168:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997267.094889:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997267.094904:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff02400/0x30fd811c0305b576 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b56f expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.094929:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02400/0x30fd811c0305b576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b56f expref: 9 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.094939:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff02400/0x30fd811c0305b576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b56f expref: 9 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.094948:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02400, rc 0) 00000100:00100000:1.0:1780997267.095001:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:90239:x1867507126999168:12345-0@lo:101:mount.lustre.0 Request processed in 118us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997267.095008:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1780997267.095108:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126999168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780997267.095139:0:90239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968889ffc400/0x30fd811c0305b56f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b576 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.095148:0:90239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968889ffc400/0x30fd811c0305b56f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b576 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997267.095214:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126999296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780997267.095245:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997267.095266:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126999296 00000100:00100000:1.0:1780997267.095292:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126999296 00000100:00100000:3.0:1780997267.095296:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997267.095316:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1780997267.095329:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:90239:x1867507126999296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780997267.095645:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:90239:x1867507126999296:12345-0@lo:501:mount.lustre.0 Request processed in 316us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997267.095653:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1780997267.095827:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126999296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780997267.095857:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126999424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780997267.095898:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997267.095953:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1780997267.096234:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126999424 00000100:00100000:0.0:1780997267.096240:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126999424 00000100:00100000:3.0:1780997267.096648:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1780997267.096659:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:90239:x1867507126999424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780997267.096810:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:90239:x1867507126999424:12345-0@lo:503:mount.lustre.0 Request processed in 153us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997267.096817:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1780997267.097016:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126999424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780997267.097675:0:90262:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90262:1867507126999552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997267.097720:0:90262:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997267.097748:0:90262:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a2480 going to sleep for 11 seconds 00000100:00100000:0.0:1780997267.097951:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126999552 00000100:00100000:0.0:1780997267.097957:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126999552 00000100:00100000:2.0:1780997267.098035:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1780997267.098046:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:90262:x1867507126999552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997267.098590:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:90262:x1867507126999552:12345-0@lo:502:llog_process_th.0 Request processed in 546us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997267.098599:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1780997267.098734:0:90262:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90262:1867507126999552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780997267.098764:0:90262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997267.098774:0:90262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997267.098777:0:90262:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1780997267.098792:0:90262:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9689a5877000 00000020:00000080:3.0:1780997267.098794:0:90262:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1780997267.098803:0:90262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780997267.098805:0:90262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997267.098807:0:90262:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1780997267.098809:0:90262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997267.098812:0:90262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997267.098813:0:90262:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1780997267.098816:0:90262:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9689a5877000 00000020:00000080:3.0:1780997267.098818:0:90262:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1780997267.098905:0:90262:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90262:1867507126999680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997267.098946:0:90262:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997267.098979:0:90262:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898506eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1780997267.098983:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126999680 00000100:00100000:0.0:1780997267.098988:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126999680 00000100:00100000:0.0:1780997267.099073:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1780997267.099081:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:90262:x1867507126999680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997267.099165:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:90262:x1867507126999680:12345-0@lo:502:llog_process_th.0 Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997267.099171:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1780997267.102356:0:90262:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90262:1867507126999680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780997267.102402:0:90262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997267.102411:0:90262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997267.102414:0:90262:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1780997267.102417:0:90262:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1780997267.104534:0:90239:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1780997267.104565:0:90239:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1780997267.104590:0:90239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffc400/0x30fd811c0305b56f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b576 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.104604:0:90239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968889ffc400/0x30fd811c0305b56f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b576 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997267.104661:0:90239:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1780997267.104664:0:90239:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9689a5877000 10000000:01000000:1.0:1780997267.104668:0:90239:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9689a5877000 10000000:01000000:1.0:1780997267.104672:0:90239:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1780997267.104677:0:90239:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689a5877000 from 1 10000000:01000000:1.0:1780997267.104680:0:90239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780997267.104715:0:90239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.104723:0:90239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.104734:0:90239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997267.104758:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126999808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1780997267.104841:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997267.104887:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689ba1c20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997267.104968:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126999808 00000100:00100000:0.0:1780997267.104977:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126999808 00000100:00100000:0.0:1780997267.105027:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1780997267.105037:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:90239:x1867507126999808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780997267.105050:0:90245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997267.105074:0:90245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968889ffd800/0x30fd811c0305b584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b57d expref: -99 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.105096:0:90245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffd800/0x30fd811c0305b584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b57d expref: 10 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.105107:0:90245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968889ffd800/0x30fd811c0305b584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b57d expref: 10 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.105115:0:90245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffd800, rc 0) 00000100:00100000:0.0:1780997267.105164:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:90239:x1867507126999808:12345-0@lo:101:mount.lustre.0 Request processed in 128us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997267.105171:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1780997267.105253:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126999808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997267.105291:0:90239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b584 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.105301:0:90239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b584 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997267.105352:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126999936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780997267.105378:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997267.105401:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689ba1c20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997267.105572:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126999936 00000100:00100000:2.0:1780997267.105577:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126999936 00000100:00100000:2.0:1780997267.105613:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1780997267.105620:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:90239:x1867507126999936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997267.105735:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:90239:x1867507126999936:12345-0@lo:501:mount.lustre.0 Request processed in 116us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997267.105750:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1780997267.105796:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507126999936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780997267.105824:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507127000064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997267.105871:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997267.105886:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff968889e33b40 going to sleep for 11 seconds 00000100:00100000:2.0:1780997267.105898:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127000064 00000100:00100000:2.0:1780997267.105902:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127000064 00000100:00100000:2.0:1780997267.105922:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1780997267.105928:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:90239:x1867507127000064:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780997267.105998:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:90239:x1867507127000064:12345-0@lo:503:mount.lustre.0 Request processed in 69us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997267.106005:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1780997267.106044:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968889179500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507127000064:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780997267.106581:0:90264:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90264:1867507127000192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997267.106625:0:90264:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997267.106647:0:90264:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689ba1c26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997267.107117:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127000192 00000100:00100000:2.0:1780997267.107124:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127000192 00000100:00100000:2.0:1780997267.107160:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1780997267.107166:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:90264:x1867507127000192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997267.107302:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:90264:x1867507127000192:12345-0@lo:502:llog_process_th.0 Request processed in 136us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997267.107309:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1780997267.107462:0:90264:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90264:1867507127000192:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1780997267.107519:0:90264:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1780997267.107535:0:90264:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff968886ec3380) 00000020:00000080:0.0:1780997267.107568:0:90264:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1780997267.109606:0:90264:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689a5877000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1780997267.109617:0:90264:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9689a5877000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1780997267.109619:0:90264:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689a5877000 4 00010000:00080000:0.0:1780997267.109729:0:90264:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96898616b000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1780997267.113326:0:90264:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1780997267.113622:0:90264:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1780997267.113740:0:90264:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1780997267.113753:0:90264:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x30fd811c0305b592 00000100:00080000:0.0:1780997267.113831:0:90264:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1780997267.113838:0:90264:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96898616b000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997267.113942:0:90264:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9688858b2a00 x1867507127000320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997267.113973:0:90264:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1780997267.114161:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507127000320:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780997267.114227:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997267.114303:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127000320 00000100:00100000:0.0:1780997267.114310:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127000320 00000100:00100000:0.0:1780997267.114730:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1780997267.114739:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507127000320:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1780997267.115226:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3495:x1867507127000320:12345-0@lo:38:llog_process_th.0 Request processed in 484us (997us total) trans 0 rc -11/-11 00000100:00100000:0.0:1780997267.115236:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1780997267.115250:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780997267.115261:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898616b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780997267.115299:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1780997267.115304:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507127000320:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1780997267.116955:0:90264:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90264:1867507127000448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997267.117028:0:90264:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997267.117079:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127000448 00000100:00100000:0.0:1780997267.117081:0:90264:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688858050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997267.117086:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127000448 00000100:00100000:3.0:1780997267.117123:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1780997267.117133:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:90264:x1867507127000448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997267.117259:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:90264:x1867507127000448:12345-0@lo:502:llog_process_th.0 Request processed in 126us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997267.117267:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1780997267.119975:0:90264:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90264:1867507127000448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997267.120069:0:90264:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90264:1867507127000576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997267.120151:0:90264:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997267.120515:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127000576 00000100:00100000:1.0:1780997267.120523:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127000576 00000100:00100000:1.0:1780997267.120578:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1780997267.120588:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:90264:x1867507127000576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997267.120702:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:90264:x1867507127000576:12345-0@lo:502:llog_process_th.0 Request processed in 115us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997267.120710:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1780997267.122302:0:90264:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688858050c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997267.122333:0:90264:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90264:1867507127000576:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1780997267.122368:0:90264:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1780997267.129219:0:90239:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:1.0:1780997267.129283:0:90239:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780997267.129309:0:90239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b584 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.129344:0:90239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b584 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1780997267.129403:0:90239:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1780997267.129405:0:90239:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780997267.129406:0:90239:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997267.129407:0:90239:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997267.129409:0:90239:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997267.129410:0:90239:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997267.129412:0:90239:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780997267.129413:0:90239:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780997267.129415:0:90239:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997267.129417:0:90239:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1780997267.129421:0:90239:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1780997267.129423:0:90239:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1780997267.129425:0:90239:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780997267.129426:0:90239:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780997267.129427:0:90239:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780997267.129428:0:90239:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780997267.129429:0:90239:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780997267.129430:0:90239:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780997267.129432:0:90239:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780997267.129433:0:90239:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780997267.129434:0:90239:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1780997267.129463:0:90239:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1780997267.129483:0:90239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507127000704:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1780997267.129553:0:90239:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997267.129594:0:90239:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689ba1c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1780997267.129605:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127000704 00000100:00100000:0.0:1780997267.129612:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127000704 00000100:00100000:0.0:1780997267.129679:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1780997267.129688:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:90239:x1867507127000704:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1780997267.129723:0:90245:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1780997267.129738:0:90245:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1780997267.144233:0:90245:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1780997267.144252:0:90245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1780997267.144479:0:90248:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780997267.144484:0:90248:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780997267.144506:0:90248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.144525:0:90248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968889ffda00/0x30fd811c0305b568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b561 expref: 10 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.144548:0:90248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.144591:0:90248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968889ffda00/0x30fd811c0305b568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b561 expref: 10 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.144606:0:90248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968889ffda00/0x30fd811c0305b568 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b561 expref: 10 pid: 90245 timeout: 3894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997267.144620:0:90248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90248:1867507127000832:0@lo:104: 00000100:00100000:1.0:1780997267.144681:0:90248:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997267.144720:0:90248:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689ba1c20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997267.144748:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127000832 00000100:00100000:0.0:1780997267.144756:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127000832 00000100:00100000:0.0:1780997267.144809:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1780997267.144817:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:90248:x1867507127000832:12345-0@lo:104: 00010000:00010000:0.0:1780997267.144828:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b568 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.144892:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1780997267.144898:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:90248:x1867507127000832:12345-0@lo:104: Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997267.144905:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00010000:3.0:1780997267.145136:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997267.145143:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b568 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145150:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3a00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997267.145154:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b568 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145174:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b568 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997267.145182:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b568 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997267.145187:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997267.145226:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b568 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145233:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997267.145264:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b568 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145293:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b568 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145309:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997267.145311:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997267.145312:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997267.145325:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780997267.145335:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127000960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997267.145367:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997267.145403:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127000960 00000100:00100000:3.0:1780997267.145407:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127000960 00010000:00010000:3.0:1780997267.145424:0:6338:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968889ffda00/0x30fd811c0305b568 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b561 expref: 11 pid: 90245 timeout: 3894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997267.145445:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1780997267.145459:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:3496:x1867507127000960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997267.145470:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997267.145474:0:6338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968889ffda00/0x30fd811c0305b568 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b561 expref: 11 pid: 90245 timeout: 3894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145484:0:6338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968889ffda00/0x30fd811c0305b568 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b561 expref: 11 pid: 90245 timeout: 3894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145500:0:6338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145507:0:6338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780997267.145520:0:6338:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001036973s 00010000:00010000:3.0:1780997267.145525:0:6338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145532:0:6338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145540:0:6338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145547:0:6338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145552:0:6338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997267.145556:0:6338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145574:0:6338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145583:0:6338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997267.145593:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997267.145623:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:3496:x1867507127000960:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997267.145629:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1780997267.145667:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127000960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997267.145725:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:90239:x1867507127000704:12345-0@lo:253:mount.lustre.0 Request processed in 16038us (16172us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997267.145733:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1780997267.145785:0:90239:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688884a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:90239:1867507127000704:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1780997267.145795:0:90239:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1780997267.145798:0:90239:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1780997267.145800:0:90239:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780997267.145801:0:90239:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997267.145802:0:90239:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997267.145804:0:90239:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997267.145805:0:90239:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997267.145807:0:90239:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780997267.145808:0:90239:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780997267.145810:0:90239:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997267.145811:0:90239:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1780997267.145822:0:90239:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1780997267.146228:0:90248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffda00/0x30fd811c0305b568 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b561 expref: 9 pid: 90245 timeout: 3894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997267.146239:0:90248:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90248:1867507127000832:0@lo:104: 00010000:00010000:1.0:1780997267.146253:0:90248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.146261:0:90248:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.146286:0:90248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997267.146293:0:90248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff02000/0x30fd811c0305b599 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1780997267.163764:0:90239:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444067 00000040:01000000:1.0:1780997267.164381:0:90239:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1780997267.164662:0:90271:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1780997267.164891:0:90239:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:3.0:1780997267.165495:0:90270:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444067 00000020:00080000:3.0:1780997267.165500:0:90270:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444067 00000040:00080000:2.0:1780997267.165589:0:90271:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1780997267.167288:0:90272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90272:1867507127001088:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780997267.167358:0:90272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997267.167397:0:90272:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997267.167409:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127001088 00000100:00100000:3.0:1780997267.167419:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127001088 00000100:00100000:3.0:1780997267.167472:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4095 00000100:00100000:3.0:1780997267.167482:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90272:x1867507127001088:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780997267.167568:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90272:x1867507127001088:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997267.167576:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4095 00000040:01000000:0.0:1780997267.167850:0:90239:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1780997267.167893:0:90239:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1780997267.168353:0:90239:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1780997267.168360:0:90239:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1780997267.168395:0:90239:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1780997267.169379:0:90239:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1780997267.169934:0:90239:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1780997267.169987:0:90239:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1780997267.170104:0:90239:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1780997267.170656:0:90239:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00000040:00080000:2.0:1780997267.172100:0:90271:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000100:00100000:1.0:1780997267.172347:0:90272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90272:1867507127001088:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1780997267.172391:0:90272:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1780997267.172443:0:90272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90272:1867507127001216:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780997267.172510:0:90272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997267.172550:0:90272:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bbd80 going to sleep for 11 seconds 00000004:00080000:2.0:1780997267.173357:0:90271:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1780997267.173464:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127001216 00000100:00100000:3.0:1780997267.173471:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127001216 00000100:00100000:3.0:1780997267.173521:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4096 00000100:00100000:3.0:1780997267.173531:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90272:x1867507127001216:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780997267.173691:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90272:x1867507127001216:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 161us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997267.173699:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4096 00000100:00100000:1.0:1780997267.173735:0:90272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90272:1867507127001216:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780997267.173813:0:90272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90272:1867507127001344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780997267.173846:0:90272:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997267.173922:0:90272:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997267.174163:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127001344 00000100:00100000:3.0:1780997267.174168:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127001344 00000100:00100000:3.0:1780997267.174216:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4097 00000100:00100000:3.0:1780997267.174224:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90272:x1867507127001344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780997267.174315:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90272:x1867507127001344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 92us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997267.174322:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4097 00000100:00100000:1.0:1780997267.174571:0:90272:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90272:1867507127001344:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1780997267.174623:0:90272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1780997267.177361:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1780997267.182835:0:90239:0:(ldlm_lib.c:3037:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964117002 00000040:00080000:1.0:1780997267.183080:0:90272:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1780997267.183164:0:90272:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1780997267.183168:0:90272:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:3.0:1780997267.184635:0:90273:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 90273 00010000:02000000:3.0:1780997267.184649:0:90273:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1780997267.184653:0:90273:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1780997267.184656:0:90273:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1780997267.184810:0:90239:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1780997267.184827:0:90239:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1780997267.184845:0:90239:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:0.0:1780997267.184873:0:90239:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1780997267.185795:0:90239:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780997267.186054:0:90239:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1780997267.848110:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997267.848194:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110420224 00000100:00100000:2.0:1780997267.848204:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110420224 00000100:00100000:2.0:1780997267.848297:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1780997267.848309:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+4:70253:x1867507110420224:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997267.848327:0:90246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997267.848345:0:90246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455600/0x30fd811c0305b5a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e55 expref: -99 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997267.848378:0:90246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455600/0x30fd811c0305b5a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e55 expref: 5 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997267.848390:0:90246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455600/0x30fd811c0305b5a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e55 expref: 5 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997267.848400:0:90246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455600, rc 0) 00000100:00100000:2.0:1780997267.848469:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+5:70253:x1867507110420224:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 163us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997267.848476:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:0.0:1780997267.854157:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997267.854245:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110420352 00000100:00100000:3.0:1780997267.854262:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110420352 00000100:00100000:3.0:1780997267.854340:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1780997267.854350:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+5:70253:x1867507110420352:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780997267.854374:0:90250:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1780997267.854391:0:90250:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780997267.854395:0:90250:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1780997267.854398:0:90250:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1780997267.854401:0:90250:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1780997267.854403:0:90250:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 124 00000100:00100000:0.0:1780997267.855802:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+5:70253:x1867507110420352:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 Request processed in 1447us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997267.855814:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1780997267.858920:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997267.859024:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110420608 00000100:00100000:0.0:1780997267.859034:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110420608 00000100:00100000:0.0:1780997267.859099:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:0.0:1780997267.859110:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+5:70253:x1867507110420608:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997267.859129:0:90246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997267.859148:0:90246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968889ffc600/0x30fd811c0305b5a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e5c expref: -99 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.859175:0:90246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffc600/0x30fd811c0305b5a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e5c expref: 6 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.859187:0:90246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968889ffc600/0x30fd811c0305b5a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e5c expref: 6 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.859196:0:90246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffc600, rc 0) 00000100:00100000:0.0:1780997267.859245:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+6:70253:x1867507110420608:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 136us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997267.859264:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1780997267.862752:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997267.862841:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110420480 00000100:00100000:0.0:1780997267.862851:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110420480 00000100:00100000:0.0:1780997267.862898:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1442 00000100:00100000:0.0:1780997267.862906:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1867507110420480:12345-192.168.206.51@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1780997267.862935:0:63419:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'e4805cfa-ac6d-4d67-bb97-a6c06740fcd0' at ffff9689b79cb000, cookie 0x30fd811c0305b4f1 00010000:00080000:0.0:1780997267.862941:0:63419:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp recovering/t115964117003 exp ffff9689b79cb000 cur 3795 last 1780997267 00010000:02000400:0.0:1780997267.862950:0:63419:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1780997267.862956:0:63419:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1780997267.862978:0:63419:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1780997267.863135:0:63419:0:(import.c:65:import_set_state_nolock()) ffff96898616c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997267.863210:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110420480:12345-192.168.206.51@tcp:38:ll_cfg_requeue.0 Request processed in 303us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997267.863219:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1442 00000100:00100000:3.0:1780997267.863782:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997267.870538:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110420736 00000100:00100000:2.0:1780997267.870554:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110420736 00000100:00100000:2.0:1780997267.870619:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:2.0:1780997267.870630:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+6:70253:x1867507110420736:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997267.870816:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70253:x1867507110420736:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 187us (7034us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997267.870825:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1780997267.873343:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997267.873635:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110420864 00000100:00100000:2.0:1780997267.873647:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110420864 00000100:00100000:2.0:1780997267.873706:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1780997267.873716:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70253:x1867507110420864:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997267.873873:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70253:x1867507110420864:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 158us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997267.873881:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1780997267.878942:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997267.879224:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110412544 00000100:00100000:1.0:1780997267.879236:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110412544 00000100:00100000:1.0:1780997267.879317:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1443 00000100:00100000:1.0:1780997267.879327:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110412544:12345-192.168.206.51@tcp:36:mcreate.0 00010000:00080000:1.0:1780997267.879346:0:63417:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 115964117003, current: 115964117003, replaying 00000100:00100000:1.0:1780997267.879378:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110412544:12345-192.168.206.51@tcp:36:mcreate.0 Request processed in 54us (446us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997267.879384:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1443 00010000:00080000:3.0:1780997267.879515:0:90273:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1780997267.893626:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997267.895088:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110420992 00000100:00100000:2.0:1780997267.895100:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110420992 00000100:00100000:2.0:1780997267.895213:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:2.0:1780997267.895223:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70253:x1867507110420992:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997267.895240:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997267.895257:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455e00/0x30fd811c0305b5ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e63 expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997267.895309:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455e00/0x30fd811c0305b5ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e63 expref: 8 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997267.895321:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455e00/0x30fd811c0305b5ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e63 expref: 8 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997267.895331:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455e00, rc 0) 00000100:00100000:2.0:1780997267.895492:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110420992:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 270us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997267.895507:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1780997267.902248:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997267.905935:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110421120 00000100:00100000:2.0:1780997267.905950:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110421120 00000100:00100000:2.0:1780997267.906052:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1780997267.906072:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110421120:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997267.906254:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110421120:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 182us (4012us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997267.906262:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1780997267.908626:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997267.908692:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110421248 00000100:00100000:3.0:1780997267.908701:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110421248 00000100:00100000:3.0:1780997267.908752:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:3.0:1780997267.908762:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110421248:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997267.908899:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110421248:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 138us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997267.908906:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:1.0:1780997267.917297:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997267.917642:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110421376 00000100:00100000:0.0:1780997267.917654:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110421376 00000100:00100000:0.0:1780997267.917709:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:0.0:1780997267.917719:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110421376:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997267.917737:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997267.917755:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968889ffd600/0x30fd811c0305b5b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e6a expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.917789:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffd600/0x30fd811c0305b5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e6a expref: 9 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.917816:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968889ffd600/0x30fd811c0305b5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e6a expref: 9 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997267.917828:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffd600, rc 0) 00000100:00100000:0.0:1780997267.917902:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110421376:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 184us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997267.917909:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:2.0:1780997267.922177:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997267.922249:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110421504 00000100:00100000:3.0:1780997267.922259:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110421504 00000100:00100000:3.0:1780997267.922344:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:3.0:1780997267.922365:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110421504:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997267.922485:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110421504:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 122us (317us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780997267.927670:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00010000:00010000:2.0:1780997268.197774:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1780997268.837586:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1780997268.837594:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9689a5877000 from 124 10000000:01000000:0.0:1780997268.837599:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1780997268.837642:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.837653:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.837664:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997268.837689:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127001472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.837834:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997268.837940:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689869583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997268.838006:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127001472 00000100:00100000:2.0:1780997268.838014:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127001472 00000100:00100000:2.0:1780997268.838075:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1780997268.838085:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:6348:x1867507127001472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997268.838097:0:90246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997268.838110:0:90246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b5c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b5bc expref: -99 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.838132:0:90246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b5c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b5bc expref: 10 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.838142:0:90246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b5c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b5bc expref: 10 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.838151:0:90246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455c00, rc 0) 00000100:00100000:2.0:1780997268.838964:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507127001472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 877us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997268.838983:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1780997268.841783:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127001472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997268.841812:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5c3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.841826:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b5c3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997268.841901:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127001600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.841970:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.842863:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1780997268.842924:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127001600 00000100:00100000:2.0:1780997268.842932:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127001600 00000100:00100000:2.0:1780997268.842987:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1780997268.842997:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507127001600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1780997268.843018:0:90245:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1780997268.843038:0:90245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1780997268.843041:0:90245:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 124 00000100:00100000:2.0:1780997268.843171:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507127001600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 174us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997268.843180:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1780997268.843229:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127001600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1780997268.843308:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780997268.843317:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5c3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.843329:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5c3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997268.843340:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780997268.843343:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968886f5e000 from 58 10000000:01000000:1.0:1780997268.843351:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780997268.843376:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.843384:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.843393:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997268.843408:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127001728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.843439:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.843473:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1780997268.843529:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127001728 00000100:00100000:2.0:1780997268.843533:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127001728 00000100:00100000:2.0:1780997268.843567:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1780997268.843574:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:6348:x1867507127001728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997268.843583:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997268.843595:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455800/0x30fd811c0305b5d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b5ca expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.843616:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455800/0x30fd811c0305b5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b5ca expref: 11 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.843627:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455800/0x30fd811c0305b5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b5ca expref: 11 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.843635:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455800, rc 0) 00000100:00100000:2.0:1780997268.843670:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507127001728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997268.843687:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1780997268.843705:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127001728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997268.843718:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5d1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.843727:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b5d1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997268.843778:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127001856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.843803:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.843824:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1780997268.843913:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127001856 00000100:00100000:2.0:1780997268.843918:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127001856 00000100:00100000:2.0:1780997268.843947:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1780997268.843954:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507127001856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.844072:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507127001856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997268.844079:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1780997268.844091:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127001856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.844136:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127001984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.844198:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.844218:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1780997268.844298:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127001984 00000100:00100000:3.0:1780997268.844303:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127001984 00000100:00100000:3.0:1780997268.844331:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1780997268.844338:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507127001984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997268.844427:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507127001984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997268.844435:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1780997268.844465:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127001984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780997268.851884:0:90359:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:3.0:1780997268.852991:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:3.0:1780997268.853025:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780997268.853039:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5d1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997268.853064:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5d1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997268.853074:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1780997268.853077:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff968886f5e000 from 121 10000000:01000000:3.0:1780997268.853080:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1780997268.853122:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997268.853130:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997268.853141:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997268.853166:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997268.853248:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997268.853429:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640600 going to sleep for 11 seconds 00000100:00100000:2.0:1780997268.853596:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127002112 00000100:00100000:2.0:1780997268.853605:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127002112 00000100:00100000:2.0:1780997268.853687:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1780997268.853697:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:6348:x1867507127002112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997268.853710:0:90245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997268.853723:0:90245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba454400/0x30fd811c0305b5df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b5d8 expref: -99 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.853747:0:90245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454400/0x30fd811c0305b5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b5d8 expref: 12 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.853769:0:90245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba454400/0x30fd811c0305b5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b5d8 expref: 12 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.853778:0:90245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454400, rc 0) 00000100:00100000:2.0:1780997268.853828:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507127002112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997268.853844:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1780997268.853928:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997268.853942:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5df expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997268.853951:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b5df expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997268.853999:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1780997268.854038:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997268.856213:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640600 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.856258:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127002240 00000100:00100000:0.0:1780997268.856266:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127002240 00000100:00100000:0.0:1780997268.856332:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1780997268.856341:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507127002240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1780997268.856362:0:90247:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1780997268.856379:0:90247:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1780997268.856384:0:90247:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1780997268.856387:0:90247:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1780997268.856390:0:90247:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1780997268.856392:0:90247:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 124 00000100:00100000:0.0:1780997268.856623:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507127002240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 281us (2583us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997268.856632:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1780997268.858598:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1780997268.858699:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1780997268.858710:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5df expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997268.858721:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5df expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997268.858730:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1780997268.858733:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:3.0:1780997268.858736:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1780997268.859645:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997268.859659:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997268.859679:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997268.859704:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997268.859789:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997268.859829:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640600 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.861149:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127002368 00000100:00100000:0.0:1780997268.861161:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127002368 00000100:00100000:0.0:1780997268.861264:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1780997268.861289:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+12:6348:x1867507127002368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997268.861304:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997268.861320:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968889ffc000/0x30fd811c0305b5ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b5e6 expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.861348:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffc000/0x30fd811c0305b5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b5e6 expref: 13 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.861360:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968889ffc000/0x30fd811c0305b5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b5e6 expref: 13 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.861369:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffc000, rc 0) 00000100:00100000:0.0:1780997268.861436:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507127002368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997268.861443:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1780997268.861935:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997268.861954:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5ed expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997268.861964:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b5ed expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997268.862064:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997268.862118:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997268.862160:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640600 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.862563:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127002496 00000100:00100000:0.0:1780997268.862570:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127002496 00000100:00100000:0.0:1780997268.862611:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1780997268.862620:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507127002496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.863651:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507127002496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1029us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997268.863663:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1780997268.863844:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997268.863965:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997268.864028:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997268.864103:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640600 going to sleep for 11 seconds 00000100:00100000:2.0:1780997268.864138:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127002624 00000100:00100000:2.0:1780997268.864144:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127002624 00000100:00100000:2.0:1780997268.864214:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1780997268.864222:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507127002624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.864377:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507127002624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997268.864384:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1780997268.864471:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997268.865154:0:90362:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:3.0:1780997268.865226:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:3.0:1780997268.865248:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1780997268.865290:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5ed expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997268.865301:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5ed expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997268.865310:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1780997268.865313:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff968886f5e000 from 1 10000000:01000000:3.0:1780997268.865316:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1780997268.865347:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b5f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997268.865355:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b5f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997268.865364:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b5f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997268.865381:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997268.865429:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997268.866259:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640300 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.866428:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127002752 00000100:00100000:0.0:1780997268.866436:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127002752 00000100:00100000:0.0:1780997268.866935:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1780997268.866946:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+13:6348:x1867507127002752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997268.866961:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997268.866981:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968889ffc800/0x30fd811c0305b5fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b5f4 expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.867010:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffc800/0x30fd811c0305b5fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b5f4 expref: 14 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.867021:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968889ffc800/0x30fd811c0305b5fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b5f4 expref: 14 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.867030:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffc800, rc 0) 00000100:00100000:0.0:1780997268.867094:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507127002752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997268.867102:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1780997268.867151:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997268.867165:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b5f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5fb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.867174:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b5f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b5fb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997268.867188:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1780997268.867192:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b5f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5fb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.867210:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3a00/0x30fd811c0305b5f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b5fb expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997268.867217:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1780997268.867219:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff968886f5e000 from 7 10000000:01000000:0.0:1780997268.867222:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780997268.867241:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffd000/0x30fd811c0305b602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.867248:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968889ffd000/0x30fd811c0305b602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.867255:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968889ffd000/0x30fd811c0305b602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997268.867301:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.867341:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997268.867359:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885e41240 going to sleep for 11 seconds 00000100:00100000:1.0:1780997268.867779:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127002880 00000100:00100000:1.0:1780997268.867786:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127002880 00000100:00100000:1.0:1780997268.867813:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1780997268.867820:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507127002880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997268.867828:0:90246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997268.867838:0:90246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff03800/0x30fd811c0305b609 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b602 expref: -99 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.867854:0:90246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03800/0x30fd811c0305b609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b602 expref: 15 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.867863:0:90246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff03800/0x30fd811c0305b609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b602 expref: 15 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.867869:0:90246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03800, rc 0) 00000100:00100000:1.0:1780997268.867903:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127002880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997268.867909:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1780997268.868564:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127002880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997268.868578:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968889ffd000/0x30fd811c0305b602 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b609 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.868587:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968889ffd000/0x30fd811c0305b602 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b609 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997268.868650:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.868691:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997268.868733:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885e41240 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.869536:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127003008 00000100:00100000:0.0:1780997268.869545:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127003008 00000100:00100000:0.0:1780997268.869588:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1780997268.869595:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127003008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.869718:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127003008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997268.869725:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1780997268.870564:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.870609:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.870668:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997268.870703:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885e41240 going to sleep for 11 seconds 00000100:00100000:3.0:1780997268.872626:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127003136 00000100:00100000:3.0:1780997268.872648:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127003136 00000100:00100000:3.0:1780997268.872724:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1780997268.872736:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127003136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997268.874659:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127003136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1913us (3978us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997268.874674:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1780997268.875390:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997268.880086:0:90366:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1780997268.883062:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1780997268.883100:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1780997268.883112:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffd000/0x30fd811c0305b602 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b609 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.883126:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968889ffd000/0x30fd811c0305b602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b609 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997268.883136:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780997268.883139:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689bfa99000 from 58 10000000:01000000:1.0:1780997268.883142:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780997268.883180:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.883195:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.883208:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997268.883236:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.883360:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.883410:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968887ce4840 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.883509:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127003264 00000100:00100000:0.0:1780997268.883519:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127003264 00000100:00100000:0.0:1780997268.883574:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1780997268.883584:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127003264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997268.883605:0:90245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997268.883621:0:90245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968889ffd400/0x30fd811c0305b617 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b610 expref: -99 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.883652:0:90245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffd400/0x30fd811c0305b617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b610 expref: 16 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.883664:0:90245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968889ffd400/0x30fd811c0305b617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b610 expref: 16 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.883687:0:90245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffd400, rc 0) 00000100:00100000:0.0:1780997268.883726:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127003264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997268.883733:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1780997268.884101:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997268.884120:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b617 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.884130:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b617 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997268.884196:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.884234:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.884797:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968887ce4840 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.888080:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127003392 00000100:00100000:0.0:1780997268.888101:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127003392 00000100:00100000:1.0:1780997268.888265:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1780997268.888402:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127003392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.889081:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127003392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 682us (4842us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997268.889091:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1780997268.889881:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.890093:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.890180:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.890224:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034d80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.890423:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127003520 00000100:00100000:0.0:1780997268.890431:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127003520 00000100:00100000:0.0:1780997268.890474:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1780997268.890483:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127003520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.890595:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127003520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997268.890603:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1780997268.890784:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780997268.892759:0:90370:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:2.0:1780997268.893001:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:2.0:1780997268.893021:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780997268.893127:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b617 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.893140:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b617 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997268.893149:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1780997268.893152:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1780997268.893155:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1780997268.893189:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.893197:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.893219:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997268.893241:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.893384:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997268.893461:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689850ae0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997268.893545:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127003648 00000100:00100000:1.0:1780997268.893552:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127003648 00000100:00100000:1.0:1780997268.893598:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1780997268.893607:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127003648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997268.893619:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997268.893635:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff03000/0x30fd811c0305b625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b61e expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.893658:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03000/0x30fd811c0305b625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b61e expref: 17 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.893668:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff03000/0x30fd811c0305b625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b61e expref: 17 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.893676:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03000, rc 0) 00000100:00100000:1.0:1780997268.893786:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127003648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997268.893794:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1780997268.897107:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997268.897139:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b625 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.897152:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b625 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997268.897237:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.897400:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997268.897470:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689850ae0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.897570:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127003776 00000100:00100000:0.0:1780997268.897577:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127003776 00000100:00100000:0.0:1780997268.897656:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1780997268.897671:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127003776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.897826:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127003776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997268.897834:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1780997268.897973:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.898013:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.898064:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997268.898216:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689850ae0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997268.898243:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127003904 00000100:00100000:1.0:1780997268.898248:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127003904 00000100:00100000:0.0:1780997268.898383:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1780997268.898391:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127003904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997268.901377:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127004032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780997268.901451:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997268.901509:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127004032 00000100:00100000:3.0:1780997268.901518:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127004032 00000100:00100000:3.0:1780997268.901572:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:3.0:1780997268.901582:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127004032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997268.901615:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997268.901658:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127004032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997268.901666:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000100:00080000:3.0:1780997268.901687:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997268.901700:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127004160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780997268.901726:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997268.901753:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127004160 00000100:00100000:3.0:1780997268.901757:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127004160 00000100:00100000:3.0:1780997268.901823:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:3.0:1780997268.901830:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127004160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997268.901848:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997268.901880:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127004160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997268.901887:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:3.0:1780997268.901932:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127004160:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1780997268.901935:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997268.901964:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127004032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780997268.902064:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127003904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3657us (3982us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997268.902083:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1780997268.902098:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127003904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780997268.909820:0:90373:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1780997268.910349:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1780997268.910381:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1780997268.910395:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b625 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.910424:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b625 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997268.910434:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1780997268.910438:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9689bfa99000 from 7 10000000:01000000:1.0:1780997268.910525:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1780997268.910574:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c0305b62c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.910583:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c0305b62c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.910594:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c0305b62c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997268.910621:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127004288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.910690:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.910777:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997268.910819:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127004288 00000100:00100000:2.0:1780997268.910828:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127004288 00000100:00100000:2.0:1780997268.911074:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1780997268.911085:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127004288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997268.911107:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997268.911122:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455000/0x30fd811c0305b633 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b62c expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.911149:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455000/0x30fd811c0305b633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b62c expref: 18 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.911159:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455000/0x30fd811c0305b633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b62c expref: 18 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.911168:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455000, rc 0) 00000100:00100000:2.0:1780997268.911226:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127004288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997268.911232:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1780997268.911397:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127004288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997268.911420:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c0305b62c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b633 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.911430:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c0305b62c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b633 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997268.911508:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127004416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.911539:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.911735:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127004416 00000100:00100000:1.0:1780997268.911741:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127004416 00000100:00100000:1.0:1780997268.911771:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1780997268.911778:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127004416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.911899:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127004416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997268.911906:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1780997268.912254:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885e410c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.912354:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127004416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.912386:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127004544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.912429:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997268.912547:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968885e410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997268.912584:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127004544 00000100:00100000:1.0:1780997268.912589:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127004544 00000100:00100000:1.0:1780997268.912649:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1780997268.912662:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127004544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.912742:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127004544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997268.912748:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1780997268.912808:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127004544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997268.913773:0:90375:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1780997268.913930:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1780997268.913953:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780997268.913962:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c0305b62c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b633 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.913972:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c0305b62c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b633 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997268.913980:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780997268.914059:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968990f90000 from 58 10000000:01000000:2.0:1780997268.914062:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780997268.914093:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.914114:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.914123:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997268.914140:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127004672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.914181:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997268.914212:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689850ae840 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.914372:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127004672 00000100:00100000:0.0:1780997268.914378:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127004672 00000100:00100000:0.0:1780997268.914422:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1780997268.914430:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127004672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997268.914536:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997268.914550:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b641 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b63a expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.914570:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b63a expref: 19 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.914580:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b63a expref: 19 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.914599:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffcc00, rc 0) 00000100:00100000:0.0:1780997268.914640:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127004672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997268.914646:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1780997268.914715:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127004672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997268.914730:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b641 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.914737:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b641 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997268.914786:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127004800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.914811:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997268.914832:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689850ae840 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.914922:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127004800 00000100:00100000:0.0:1780997268.914927:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127004800 00000100:00100000:0.0:1780997268.914956:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1780997268.914963:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127004800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.915182:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127004800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997268.915189:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1780997268.915248:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127004800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.915302:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127004928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.915339:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997268.915354:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689850ae840 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.915404:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127004928 00000100:00100000:0.0:1780997268.915408:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127004928 00000100:00100000:0.0:1780997268.915439:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1780997268.915509:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127004928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.915581:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127004928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997268.915669:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127004928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.915804:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000040:00080000:1.0:1780997268.916657:0:90376:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:0.0:1780997268.916912:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:0.0:1780997268.916935:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780997268.916944:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b641 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.916954:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b641 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997268.916972:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1780997268.916975:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1780997268.916978:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1780997268.917082:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.917091:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.917099:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997268.917115:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.917156:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997268.917227:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898a58b180 going to sleep for 11 seconds 00000100:00100000:1.0:1780997268.917260:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127005056 00000100:00100000:1.0:1780997268.917266:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127005056 00000100:00100000:1.0:1780997268.917464:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1780997268.917473:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127005056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997268.917484:0:90245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997268.917496:0:90245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bff03c00/0x30fd811c0305b64f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b648 expref: -99 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.917517:0:90245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bff03c00/0x30fd811c0305b64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b648 expref: 20 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.917527:0:90245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bff03c00/0x30fd811c0305b64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b648 expref: 20 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.917534:0:90245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03c00, rc 0) 00000100:00100000:1.0:1780997268.917613:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127005056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997268.917620:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1780997268.917695:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997268.917716:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b64f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.917725:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b64f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997268.917781:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.917820:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997268.917857:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689850ae840 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.917898:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127005184 00000100:00100000:0.0:1780997268.917902:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127005184 00000100:00100000:0.0:1780997268.917935:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1780997268.917942:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127005184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.918143:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127005184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997268.918150:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1780997268.918301:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.918330:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.918364:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997268.918383:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689850ae840 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.918434:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127005312 00000100:00100000:0.0:1780997268.918439:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127005312 00000100:00100000:0.0:1780997268.918469:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1780997268.918475:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127005312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.919963:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127005312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1481us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997268.919979:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1780997268.920099:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780997268.921127:0:90377:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1780997268.924977:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1780997268.925166:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1780997268.925182:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b64f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.925207:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b64f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997268.925215:0:6348:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1780997268.925218:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff968990f90000 from 7 10000000:01000000:1.0:1780997268.925220:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1780997268.925263:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.925939:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.925954:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997268.926116:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.926200:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.927078:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc9dda80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.931121:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127005440 00000100:00100000:0.0:1780997268.931138:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127005440 00000100:00100000:0.0:1780997268.931242:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1780997268.931254:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127005440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997268.931297:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997268.931316:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968889ffc200/0x30fd811c0305b65d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b656 expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.931358:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968889ffc200/0x30fd811c0305b65d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b656 expref: 21 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.931371:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968889ffc200/0x30fd811c0305b65d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b656 expref: 21 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997268.931379:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffc200, rc 0) 00000100:00100000:0.0:1780997268.931460:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127005440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (5260us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997268.931467:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1780997268.931558:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997268.931577:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.931587:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997268.931668:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.931706:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997268.933649:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127005568 00000100:00100000:2.0:1780997268.933662:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127005568 00000100:00100000:2.0:1780997268.933711:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1780997268.933719:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a67c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127005568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.933979:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a67c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127005568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997268.933986:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1780997268.934941:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc9dda80 going to sleep for 11 seconds 00000100:00100000:1.0:1780997268.934969:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.935151:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.935209:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.935289:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc9dda80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997268.935469:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127005696 00000100:00100000:0.0:1780997268.935476:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127005696 00000100:00100000:0.0:1780997268.935547:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1780997268.935557:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127005696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997268.935697:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127005696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997268.935705:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1780997268.935777:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780997268.936821:0:90378:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1780997268.937634:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1780997268.937662:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1780997268.937674:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.937686:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997268.937696:0:6348:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1780997268.937698:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9689b6283380 from 1 10000000:01000000:1.0:1780997268.937701:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1780997268.937758:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c0305b664 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.937768:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c0305b664 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.937778:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c0305b664 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997268.937804:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.938499:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.938553:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc9dda80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997268.938602:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127005824 00000100:00100000:2.0:1780997268.938609:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127005824 00000100:00100000:2.0:1780997268.938654:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1780997268.938670:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a67c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127005824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997268.938684:0:90246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997268.938699:0:90246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba454800/0x30fd811c0305b66b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b664 expref: -99 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.938722:0:90246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454800/0x30fd811c0305b66b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b664 expref: 22 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.938733:0:90246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba454800/0x30fd811c0305b66b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b664 expref: 22 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.938743:0:90246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454800, rc 0) 00000100:00100000:2.0:1780997268.938783:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a67c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127005824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997268.938791:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1780997268.938876:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997268.938890:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c0305b664 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b66b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.938899:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c0305b664 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b66b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997268.938917:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1780997268.938921:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c0305b664 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b66b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.938928:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff03a00/0x30fd811c0305b664 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b66b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997268.938935:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1780997268.938937:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9689b6283380 from 1 10000000:01000000:1.0:1780997268.938940:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1780997268.938956:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.938963:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.938972:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997268.938995:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.939022:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.939043:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc9dda80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997268.939309:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127005952 00000100:00100000:2.0:1780997268.939315:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127005952 00000100:00100000:2.0:1780997268.939507:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1780997268.939516:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a67c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127005952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997268.939524:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997268.939533:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b679 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b672 expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.939548:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b672 expref: 23 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.939557:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b672 expref: 23 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997268.939573:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454e00, rc 0) 00000100:00100000:2.0:1780997268.939602:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a67c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507127005952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997268.939608:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1780997268.940007:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127005952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997268.940021:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b679 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.940030:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b679 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997268.940218:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127006080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997268.940249:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997268.940299:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc9dda80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997268.940503:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127006080 00000100:00100000:2.0:1780997268.940509:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127006080 00000100:00100000:2.0:1780997268.940541:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1780997268.940548:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507127006080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997268.940633:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507127006080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (382us total) trans 0 rc -2/-2 00000100:00100000:2.0:1780997268.940716:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1780997268.940999:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127006080:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1780997268.941030:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1780997268.941037:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b679 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997268.941046:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b679 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997269.222447:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997270.245449:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1780997270.871534:0:90507:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1780997271.269450:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997271.301091:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997271.301183:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997271.301495:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110421760 00000100:00100000:0.0:1780997271.301506:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110421760 00000100:00100000:0.0:1780997271.301587:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1379 00000100:00100000:0.0:1780997271.301598:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2395:x1867507110421760:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997271.301679:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2395:x1867507110421760:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 83us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997271.301686:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1379 00000100:00080000:1.0:1780997271.303399:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997271.304423:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110421632 00000100:00100000:2.0:1780997271.304436:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110421632 00000100:00100000:2.0:1780997271.304513:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:2.0:1780997271.304522:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d2cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110421632:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997271.304670:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d2cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110421632:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 148us (3589us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997271.304679:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000020:00000004:3.0:1780997271.713869:0:90559:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1780997271.714515:0:90559:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1780997272.293399:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997272.485943:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997272.485969:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127006208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997272.486046:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:2.0:1780997272.486970:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000004:0.0:1780997272.488713:0:90609:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:3.0:1780997272.489281:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127006208 00000100:00100000:3.0:1780997272.489293:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127006208 00000100:00100000:3.0:1780997272.489362:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4098 00000100:00100000:3.0:1780997272.489374:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507127006208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780997272.489412:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:3.0:1780997272.489496:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507127006208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (3448us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997272.489504:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4098 00000020:00000004:0.0:1780997272.489742:0:90609:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1780997272.490186:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997272.490200:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997272.490204:0:38:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997272.490210:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3794 00000100:00080000:2.0:1780997272.490214:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997272.490219:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9688858f6800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997272.490240:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b11a8000 x1867507127006464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997272.490299:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997272.490304:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997272.490305:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997272.490309:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3794 00000100:00080000:2.0:1780997272.490312:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997272.490316:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9689bcdfb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997272.490338:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b11a9880 x1867507127006720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997272.490355:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997272.490358:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997272.490360:0:38:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997272.490364:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3794 00000100:00080000:2.0:1780997272.490366:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997272.490370:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9689ae566000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997272.490380:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b11aa300 x1867507127006976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997272.490400:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997272.490408:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997272.490410:0:38:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997272.490414:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3794 00000100:00080000:2.0:1780997272.490416:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780997272.490419:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96888b416000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997272.490430:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b11a9500 x1867507127007360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780997272.490452:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1780997272.490455:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780997272.490457:0:38:0:(import.c:65:import_set_state_nolock()) ffff96898616b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997272.490461:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96898616b000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997272.490472:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b11e6680 x1867507127007744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997272.490498:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507127006464:0@lo:38:kworker.0 00000100:00100000:2.0:1780997272.490543:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997272.490571:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507127006720:0@lo:38:kworker.0 00000100:00100000:2.0:1780997272.490590:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997272.490607:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127006976:0@lo:38:kworker.0 00000100:00100000:2.0:1780997272.490629:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997272.490645:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507127007360:0@lo:38:kworker.0 00000100:00100000:2.0:1780997272.490663:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997272.490679:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507127007744:0@lo:38:kworker.0 00000100:00100000:2.0:1780997272.490697:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997272.490724:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507127006592:0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.490754:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997272.490772:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127007488:0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.490795:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997272.490812:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1780997272.490818:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127006848:0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.490838:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997272.490854:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127007616:0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.490873:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997272.490899:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127006464 00000100:00100000:2.0:1780997272.490906:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127006464 00000100:00100000:2.0:1780997272.490939:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127006720 00000100:00100000:2.0:1780997272.490943:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127006720 00000100:00100000:2.0:1780997272.490950:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127007360 00000100:00100000:2.0:1780997272.490952:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127007360 00000100:00100000:2.0:1780997272.490960:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127007744 00000100:00100000:2.0:1780997272.490962:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127007744 00000100:00100000:2.0:1780997272.490969:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127006592 00000100:00100000:2.0:1780997272.490972:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127006592 00000100:00100000:2.0:1780997272.490996:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127006848 00000100:00100000:2.0:1780997272.490999:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127006848 00000100:00100000:2.0:1780997272.491015:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:2.0:1780997272.491021:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507127006592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.491075:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507127006592:12345-0@lo:400:kworker.0 Request processed in 54us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997272.491083:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:2.0:1780997272.491098:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:2.0:1780997272.491104:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127006848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.491129:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127006848:12345-0@lo:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997272.491142:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:2.0:1780997272.491154:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1780997272.491158:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507127006464:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780997272.491179:0:63419:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3800 last 0 00000020:00000080:2.0:1780997272.491212:0:63419:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x30fd811c0305b680 00000004:00100000:2.0:1780997272.491227:0:63419:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1780997272.491377:0:63419:0:(import.c:65:import_set_state_nolock()) ffff9689bfab4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997272.491415:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3495:x1867507127006464:12345-0@lo:38:kworker.0 Request processed in 255us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997272.491422:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1780997272.491435:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1780997272.491439:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507127006720:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780997272.491451:0:63419:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3800 last 0 00000020:00000080:2.0:1780997272.491475:0:63419:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x30fd811c0305b687 00000004:00100000:2.0:1780997272.491480:0:63419:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1780997272.491500:0:63419:0:(import.c:65:import_set_state_nolock()) ffff9689891aa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997272.491527:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3495:x1867507127006720:12345-0@lo:38:kworker.0 Request processed in 86us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997272.491533:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1780997272.491544:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1780997272.491548:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507127007360:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780997272.491560:0:63419:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3800 last 0 00000020:00000080:2.0:1780997272.491580:0:63419:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x30fd811c0305b68e 00000004:00100000:2.0:1780997272.491585:0:63419:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1780997272.491605:0:63419:0:(import.c:65:import_set_state_nolock()) ffff968986142800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997272.491633:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3495:x1867507127007360:12345-0@lo:38:kworker.0 Request processed in 83us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997272.491639:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1780997272.491652:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1780997272.491656:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3495:x1867507127007744:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780997272.491666:0:63419:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3800 last 0 00000020:00000080:2.0:1780997272.491686:0:63419:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x30fd811c0305b695 00000004:00100000:2.0:1780997272.491692:0:63419:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1780997272.491706:0:63419:0:(import.c:65:import_set_state_nolock()) ffff9689bcd7b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997272.491732:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1867507127007744:12345-0@lo:38:kworker.0 Request processed in 74us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997272.491738:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1780997272.491768:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127006976 00000100:00100000:2.0:1780997272.491773:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127006976 00000100:00100000:2.0:1780997272.491793:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4099 00000100:00100000:2.0:1780997272.491798:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3495:x1867507127006976:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780997272.491811:0:8242:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9689b79c9000, cookie 0x30fd811c0305b4ea 00010000:00080000:2.0:1780997272.491816:0:8242:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t115964117001 exp ffff9689b79c9000 cur 3800 last 1780997267 00000004:00100000:2.0:1780997272.491824:0:8242:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1780997272.491839:0:8242:0:(import.c:65:import_set_state_nolock()) ffff9689bcd7c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997272.491874:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507127006976:12345-0@lo:38:kworker.0 Request processed in 74us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997272.491880:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4099 00000100:00100000:2.0:1780997272.491909:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127007488 00000100:00100000:2.0:1780997272.491912:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127007488 00000100:00100000:2.0:1780997272.491948:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127007616 00000100:00100000:2.0:1780997272.491951:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127007616 00000100:00100000:2.0:1780997272.491972:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670 00000100:00100000:2.0:1780997272.491978:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127007488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.492009:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127007488:12345-0@lo:400:kworker.0 Request processed in 31us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997272.492015:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670 00000100:00100000:2.0:1780997272.492038:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:2.0:1780997272.492046:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507127007616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.492071:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507127007616:12345-0@lo:400:kworker.0 Request processed in 27us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997272.492077:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00080000:2.0:1780997272.492100:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997272.492104:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997272.492106:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1780997272.492118:0:90273:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1780997272.492123:0:90273:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 115964117003 00000020:00080000:2.0:1780997272.492128:0:90273:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997272.492131:0:90273:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 115964117003, next_transno: 115964117003 00010000:00080000:2.0:1780997272.492135:0:90273:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (115964117003) 00000020:00080000:2.0:1780997272.492137:0:90273:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997272.492147:0:90273:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110412544 t115964117003 from 192.168.206.51@tcp req@ffff9689b7a4c000 x1867507110412544/t0(115964117003) o36->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:598/0 lens 528/0 e 0 to 0 dl 1780997278 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997272.492219:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127006336:0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.492254:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997272.492302:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127007232:0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.492338:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997272.492379:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127006208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997272.492396:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997272.492402:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127007104:0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.492422:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997272.492448:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127006336 00000100:00100000:2.0:1780997272.492452:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127006336 00000100:00100000:2.0:1780997272.492476:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1780997272.492482:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507127006336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.492514:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507127006336:12345-0@lo:400:kworker.0 Request processed in 32us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997272.492521:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1780997272.492544:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127007232 00000100:00100000:2.0:1780997272.492547:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127007232 00000100:00100000:2.0:1780997272.492569:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127007104 00000100:00100000:2.0:1780997272.492572:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127007104 00000100:00100000:2.0:1780997272.492592:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:2.0:1780997272.492598:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127007232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.492625:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127007232:12345-0@lo:400:kworker.0 Request processed in 27us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997272.492631:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:2.0:1780997272.492642:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:2.0:1780997272.492647:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127007104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.492670:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127007104:12345-0@lo:400:kworker.0 Request processed in 23us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997272.492675:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00080000:2.0:1780997272.492706:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997272.492709:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997272.492730:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127006848:0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.492741:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127007616:0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.492753:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507127006592:0@lo:400:kworker.0 00000100:00100000:2.0:1780997272.492763:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127007488:0@lo:400:kworker.0 00010000:00080000:2.0:1780997272.492795:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689b11a8000 x1867507127006464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780997272.492807:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00080000:2.0:1780997272.498834:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9689b11a8000 x1867507127006464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997297 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780997272.498847:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1780997272.498852:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1780997272.498857:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1780997272.498863:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507127006464:0@lo:38:kworker.0 00010000:00080000:2.0:1780997272.498900:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689b11a9880 x1867507127006720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780997272.499054:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000001:00100000:1.0:1780997272.499746:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:2.0:1780997272.500159:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9689b11a9880 x1867507127006720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997297 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780997272.500168:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1780997272.500172:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcdfb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1780997272.500175:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1780997272.500189:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3495:1867507127006720:0@lo:38:kworker.0 00000100:00100000:2.0:1780997272.500210:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117002 gen 3 00000004:00080000:2.0:1780997272.500216:0:3495:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964117001 committed transno 115964117002 00000004:00080000:2.0:1780997272.500234:0:3495:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964117002 committed transno 115964117002 00000100:00080000:2.0:1780997272.500248:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:2.0:1780997272.500256:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1780997272.500260:0:3495:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1780997272.500262:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117002 gen 3 00000100:00080000:2.0:1780997272.500265:0:3495:0:(recover.c:53:ptlrpc_replay_next()) import ffff9689ae566000 from lustre-MDT0000_UUID committed 115964117002 last 0 00000100:00080000:2.0:1780997272.500268:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000001:00100000:0.0:1780997272.501417:0:72364:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1780997272.501532:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127007104:0@lo:400:kworker.0 00000100:00100000:3.0:1780997272.501547:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127006336:0@lo:400:kworker.0 00000100:00100000:3.0:1780997272.501559:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127007232:0@lo:400:kworker.0 00000004:00080000:3.0:1780997272.503066:0:90273:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 10872us 00000100:00100000:1.0:1780997272.513096:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127006976:0@lo:38:kworker.0 00010000:00080000:1.0:1780997272.513149:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689b11a9500 x1867507127007360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997272.513167:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00000100:00080000:1.0:1780997272.514085:0:3495:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9689b11a9500 x1867507127007360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997297 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997272.514114:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1780997272.514120:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888b416000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780997272.514124:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1780997272.514129:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3495:1867507127007360:0@lo:38:kworker.0 00010000:00080000:1.0:1780997272.514162:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689b11e6680 x1867507127007744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997272.514173:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00080000:1.0:1780997272.514179:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1780997272.514183:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1780997272.514185:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96898616b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1780997272.514189:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3495:1867507127007744:0@lo:38:kworker.0 00010000:00080000:3.0:1780997272.517054:0:90611:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1780997272.517062:0:90611:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1780997272.517067:0:90611:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:2.0:1780997272.517745:0:90611:0:(ldlm_request.c:2848:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954400/0x30fd811c0305addc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ade3 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1780997272.517770:0:90611:0:(ldlm_request.c:2898:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:1.0:1780997272.520188:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127007872:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1780997272.520436:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997272.521051:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127007872 00000100:00100000:3.0:1780997272.521061:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127007872 00000100:00100000:3.0:1780997272.521120:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4100 00000100:00100000:3.0:1780997272.521129:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507127007872:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:3.0:1780997272.521152:0:8241:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689a5d80000 x1867507127007872/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:603/0 lens 328/0 e 0 to 0 dl 1780997283 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997272.521172:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3495:x1867507127007872:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 45us (737us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997272.521178:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4100 00010000:00010000:3.0:1780997272.533159:0:90273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2a00/0x30fd811c0305b69c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533182:0:90273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2a00/0x30fd811c0305b69c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533197:0:90273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2a00/0x30fd811c0305b69c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533208:0:90273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305b6a3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533214:0:90273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305b6a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533220:0:90273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305b6a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533706:0:90273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2a00/0x30fd811c0305b69c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533717:0:90273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2a00/0x30fd811c0305b69c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533723:0:90273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2a00/0x30fd811c0305b69c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533729:0:90273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997272.533745:0:90273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2a00/0x30fd811c0305b69c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533752:0:90273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2a00/0x30fd811c0305b69c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533766:0:90273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689bc42a400) 00010000:00010000:3.0:1780997272.533769:0:90273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997272.533774:0:90273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2a00/0x30fd811c0305b69c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533781:0:90273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2a00/0x30fd811c0305b69c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997272.533798:0:90273:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006562869a reply state 00000000955a14eb transno 115964117003 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305b6a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533808:0:90273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305b6a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.533815:0:90273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689bc42a100) 00010000:00010000:3.0:1780997272.533818:0:90273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997272.533821:0:90273:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1780997272.533951:0:90273:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1780997272.539003:0:90273:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997272.539009:0:90273:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117004 00000020:00080000:3.0:1780997272.539014:0:90273:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780997272.539016:0:90273:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117004 00000001:00080000:1.0:1780997272.541586:0:90240:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117003 is committed 00010000:00010000:1.0:1780997272.541634:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305b6a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.541647:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305b6a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.541655:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305b6a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.541661:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997272.541665:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305b6a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.541687:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305b6a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.541707:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689bc42a100) 00010000:00010000:1.0:1780997272.541709:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997272.541714:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305b6a3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.541720:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305b6a3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997272.542477:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997272.543516:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110413056 00000100:00100000:2.0:1780997272.543528:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110413056 00000100:00100000:2.0:1780997272.543588:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1448 00000100:00100000:2.0:1780997272.543599:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110413056:12345-192.168.206.51@tcp:36:rm.0 00010000:00080000:2.0:1780997272.543618:0:63419:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 115964117004, current: 115964117004, replaying 00000100:00100000:2.0:1780997272.543632:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110413056:12345-192.168.206.51@tcp:36:rm.0 Request processed in 37us (1161us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780997272.543639:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1448 00000020:00080000:2.0:1780997272.543656:0:90273:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997272.543660:0:90273:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 115964117004, next_transno: 115964117004 00010000:00080000:2.0:1780997272.543664:0:90273:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (115964117004) 00000020:00080000:2.0:1780997272.543667:0:90273:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997272.543682:0:90273:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110413056 t115964117004 from 192.168.206.51@tcp req@ffff9689a5d80e00 x1867507110413056/t0(115964117004) o36->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:603/0 lens 512/0 e 0 to 0 dl 1780997283 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1780997272.543771:0:90273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b6aa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.543788:0:90273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b6aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.543804:0:90273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b6aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.543816:0:90273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b6b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.543823:0:90273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.543830:0:90273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.543949:0:90273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b6b8 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.544024:0:90273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b6b8 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.544042:0:90273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b6b8 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.544790:0:90273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b6b8 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.544801:0:90273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b6b8 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.544817:0:90273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b6b8 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.544824:0:90273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997272.544828:0:90273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b6b8 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.544836:0:90273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b6b8 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.544850:0:90273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9689a5f8f700) 00010000:00010000:2.0:1780997272.544853:0:90273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1780997272.544858:0:90273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b6b8 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.544865:0:90273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b6b8 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.545062:0:90273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b6aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.545069:0:90273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b6aa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.545075:0:90273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b6aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.545080:0:90273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997272.545083:0:90273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b6aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.545100:0:90273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b6aa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.545108:0:90273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689a5f8f300) 00010000:00010000:2.0:1780997272.545110:0:90273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997272.545113:0:90273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b6aa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.545118:0:90273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b6aa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997272.545131:0:90273:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054c36291 reply state 00000000eff89db5 transno 115964117004 ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.545143:0:90273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b6b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.545149:0:90273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689a5f8f500) 00010000:00010000:2.0:1780997272.545151:0:90273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997272.545153:0:90273:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1780997272.545244:0:90273:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1780997272.545262:0:90273:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997272.545265:0:90273:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117005 00000020:00080000:2.0:1780997272.545292:0:90273:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780997272.545294:0:90273:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117005 00000100:00100000:1.0:1780997272.564523:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997272.564586:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110421888 00000100:00100000:2.0:1780997272.564596:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110421888 00000100:00100000:2.0:1780997272.564655:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1382 00000100:00100000:2.0:1780997272.564666:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2393:x1867507110421888:12345-192.168.206.51@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1780997272.564702:0:63417:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff9689b11e6680 x1867507110421888/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:603/0 lens 224/0 e 0 to 0 dl 1780997283 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997272.564729:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2393:x1867507110421888:12345-192.168.206.51@tcp:400:ldlm_lock_repla.0 Request processed in 66us (215us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780997272.564738:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1382 00000020:00080000:1.0:1780997272.564779:0:90273:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780997272.564783:0:90273:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964117005 00010000:00080000:1.0:1780997272.564787:0:90273:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1780997272.564789:0:90273:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780997272.564795:0:90273:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1780997272.564798:0:90273:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1780997272.564805:0:90273:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff9689a5d80000 x1867507127007872/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:603/0 lens 328/0 e 0 to 0 dl 1780997283 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1780997272.564823:0:90273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997272.564850:0:90273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968980031000/0x30fd811c0305b6bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30fd811c0305addc expref: -99 pid: 90273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.564876:0:90273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968980031000/0x30fd811c0305b6bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305addc expref: 7 pid: 90273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.564891:0:90273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968980031000/0x30fd811c0305b6bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305addc expref: 7 pid: 90273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.564906:0:90273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968980031000, rc 0) 00010000:00080000:1.0:1780997272.564988:0:90273:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1780997272.565001:0:90273:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00010000:2.0:1780997272.565076:0:3495:0:(ldlm_request.c:2765:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff968888954400/0x30fd811c0305addc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b6bf expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1780997272.565086:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1780997272.565110:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127007872:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1780997272.565133:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127008000:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1780997272.565164:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997272.565331:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127008000 00000100:00100000:0.0:1780997272.565336:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127008000 00000100:00100000:0.0:1780997272.565363:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4101 00000100:00100000:0.0:1780997272.565370:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3495:x1867507127008000:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1780997272.565379:0:8242:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff9689bb524e00 x1867507127008000/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:603/0 lens 224/0 e 0 to 0 dl 1780997283 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997272.565392:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3495:x1867507127008000:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 24us (229us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997272.565397:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4101 00010000:00080000:1.0:1780997272.566211:0:90273:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1780997272.566427:0:90273:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 00000001:00100000:2.0:1780997272.567769:0:90240:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1780997272.567780:0:90240:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000001:00080000:2.0:1780997272.567804:0:90240:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117004 is committed 00000001:00080000:1.0:1780997272.568515:0:90273:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1780997272.568554:0:90273:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1780997272.568570:0:90273:0:(ldlm_lib.c:2924:target_recovery_thread()) @@@ processing final ping from 192.168.206.51@tcp: req@ffff9689b11e6680 x1867507110421888/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:603/0 lens 224/0 e 0 to 0 dl 1780997283 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1780997272.568823:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b6b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.568833:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b6b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.568842:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b6b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.568857:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997272.568862:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b6b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.568869:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b6b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.568887:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff9689a5f8f500) 00010000:00010000:0.0:1780997272.568891:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997272.568896:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b6b1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.568903:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b6b1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1780997272.568950:0:90273:0:(ldlm_lib.c:2924:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9689bb524e00 x1867507127008000/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:603/0 lens 224/0 e 0 to 0 dl 1780997283 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1780997272.569045:0:90273:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1780997272.572395:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1780997272.572411:0:3495:0:(client.c:3253:ptlrpc_resend_req()) @@@ going to resend req@ffff9689bb524700 x1867507127008000/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997288 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997272.572423:0:3495:0:(client.c:3262:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9689bb524700 x1867507127008000/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997288 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997272.572430:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ae566000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780997272.572443:0:3495:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1780997272.572449:0:3495:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000bda502bb): req@ffff9689a5d83b80 x1867507126986880/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997256 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997272.572463:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127008000:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1780997272.572546:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688858b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127008128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997272.572618:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997272.572655:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997272.572690:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127008128 00000100:00100000:0.0:1780997272.572697:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127008128 00000100:00100000:0.0:1780997272.572735:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507126986880 00000100:00100000:0.0:1780997272.572738:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507126986880 00000100:00100000:0.0:1780997272.572757:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4102 00000100:00100000:0.0:1780997272.572765:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3496:x1867507127008128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780997272.572796:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:0.0:1780997272.572840:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3496:x1867507127008128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997272.572846:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4102 00000100:00100000:0.0:1780997272.572863:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4103 00000100:00100000:0.0:1780997272.572869:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507126986880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780997272.572880:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:0.0:1780997272.575331:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507126986880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2458us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997272.575342:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4103 00000100:00100000:0.0:1780997272.575411:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688858b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127008128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997272.575423:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507126986880:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1780997272.604938:0:90273:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8c8c7593e10 00100000:10000000:0.0:1780997272.604958:0:90273:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1780997272.614253:0:90260:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x303:0x0] 00000100:00100000:1.0:1780997272.614413:0:90260:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90260:1867507127008256:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1780997272.614496:0:90260:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997272.614531:0:90260:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bc9dd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997272.614848:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127008256 00000100:00100000:2.0:1780997272.614855:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127008256 00000100:00100000:2.0:1780997272.614910:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5974 00000100:00100000:2.0:1780997272.614919:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:90260:x1867507127008256:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1780997272.614946:0:25173:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -94 00002000:02000040:2.0:1780997272.614952:0:25173:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:772 to 0x2c0000401:865) 00000004:00080000:3.0:1780997272.617189:0:90258:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x302:0x0] 00000100:00100000:3.0:1780997272.617237:0:90258:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90258:1867507127008384:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1780997272.617325:0:90258:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997272.617356:0:90258:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984a72d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997272.617396:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127008384 00000100:00100000:3.0:1780997272.617403:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127008384 00000100:00100000:3.0:1780997272.617441:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5975 00000100:00100000:3.0:1780997272.617450:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:90258:x1867507127008384:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1780997272.617475:0:25177:0:(ofd_dev.c:1639:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -95 00002000:02000040:3.0:1780997272.617480:0:25177:0:(ofd_dev.c:1490:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:771 to 0x280000400:865) 00002000:00010000:1.0:1780997272.636252:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.636291:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a393e723/0x30fd811c0305b6c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636310:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.636312:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.636318:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a393e723/0x30fd811c0305b6c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636415:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a393e723/0x30fd811c0305b6c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636426:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a393e723/0x30fd811c0305b6c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636435:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a393e723/0x30fd811c0305b6c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636459:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997272.636613:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.636619:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305b6cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636627:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.636628:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.636631:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305b6cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636639:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305b6cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636646:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305b6cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636653:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305b6cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636680:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780997272.636722:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.636727:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040d4b986/0x30fd811c0305b6d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636734:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.636735:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.636738:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040d4b986/0x30fd811c0305b6d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636746:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040d4b986/0x30fd811c0305b6d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636753:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040d4b986/0x30fd811c0305b6d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636760:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040d4b986/0x30fd811c0305b6d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636772:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1780997272.636808:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.636813:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b6db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636819:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.636820:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.636829:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b6db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636838:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b6db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636844:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b6db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636850:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b6db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636862:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1780997272.636928:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.636933:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf2ef847/0x30fd811c0305b6e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636940:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.636941:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.636944:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2ef847/0x30fd811c0305b6e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.636952:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf2ef847/0x30fd811c0305b6e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637037:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1780997272.637046:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a393e723/0x30fd811c0305b6c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637065:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997272.637070:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a393e723/0x30fd811c0305b6c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637079:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a393e723/0x30fd811c0305b6c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637097:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a393e723/0x30fd811c0305b6c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637105:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a393e723/0x30fd811c0305b6c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637123:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1780997272.637126:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305b6cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637132:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997272.637135:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305b6cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637142:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305b6cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637150:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305b6cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637163:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305b6cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637176:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780997272.637179:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040d4b986/0x30fd811c0305b6d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637185:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997272.637189:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040d4b986/0x30fd811c0305b6d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637196:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040d4b986/0x30fd811c0305b6d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637206:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040d4b986/0x30fd811c0305b6d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637212:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040d4b986/0x30fd811c0305b6d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637223:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997272.637226:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b6db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637233:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980030000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997272.637241:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b6db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637250:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b6db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637260:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b6db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637266:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c64a5bd/0x30fd811c0305b6db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997272.637298:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997272.637299:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997272.637301:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997272.637307:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.638113:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.638526:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf2ef847/0x30fd811c0305b6e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.638555:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2ef847/0x30fd811c0305b6e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.638613:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997272.638706:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.638712:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000999b8e9b/0x30fd811c0305b6e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.638722:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.638724:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.638728:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000999b8e9b/0x30fd811c0305b6e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.638740:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000999b8e9b/0x30fd811c0305b6e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.638747:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000999b8e9b/0x30fd811c0305b6e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.638753:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000999b8e9b/0x30fd811c0305b6e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.640246:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997272.640261:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf2ef847/0x30fd811c0305b6e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.640363:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.640368:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2ef847/0x30fd811c0305b6e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.640379:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2ef847/0x30fd811c0305b6e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.640402:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf2ef847/0x30fd811c0305b6e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.640410:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf2ef847/0x30fd811c0305b6e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.640443:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997272.640447:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000999b8e9b/0x30fd811c0305b6e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.640453:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956fa00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.640457:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000999b8e9b/0x30fd811c0305b6e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.640464:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000999b8e9b/0x30fd811c0305b6e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.640474:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000999b8e9b/0x30fd811c0305b6e9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.640488:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.640490:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.640492:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.641435:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.644440:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1780997272.644442:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.644455:0:25173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000999b8e9b/0x30fd811c0305b6e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997272.644607:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.644614:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058e514cc/0x30fd811c0305b6f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644627:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.644629:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.644634:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058e514cc/0x30fd811c0305b6f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644647:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058e514cc/0x30fd811c0305b6f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644657:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058e514cc/0x30fd811c0305b6f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644666:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058e514cc/0x30fd811c0305b6f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644688:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997272.644726:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.644732:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000191c0b65/0x30fd811c0305b6f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644739:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.644741:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.644743:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000191c0b65/0x30fd811c0305b6f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644758:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000191c0b65/0x30fd811c0305b6f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644767:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000191c0b65/0x30fd811c0305b6f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644774:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000191c0b65/0x30fd811c0305b6f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644790:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780997272.644800:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997272.644806:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058e514cc/0x30fd811c0305b6f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644814:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997272.644818:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058e514cc/0x30fd811c0305b6f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644827:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058e514cc/0x30fd811c0305b6f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644844:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058e514cc/0x30fd811c0305b6f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644851:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058e514cc/0x30fd811c0305b6f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.644871:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997272.644878:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.646222:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000191c0b65/0x30fd811c0305b6f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.646239:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956fe00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997272.646244:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000191c0b65/0x30fd811c0305b6f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.646255:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000191c0b65/0x30fd811c0305b6f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.646284:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000191c0b65/0x30fd811c0305b6f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.646292:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000191c0b65/0x30fd811c0305b6f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.646315:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.646317:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.646319:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.646823:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.646834:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f092eed/0x30fd811c0305b6fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.646846:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.646848:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.646852:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f092eed/0x30fd811c0305b6fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.646866:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f092eed/0x30fd811c0305b6fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.646876:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f092eed/0x30fd811c0305b6fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.646883:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f092eed/0x30fd811c0305b6fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.646905:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997272.646923:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.646928:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f092eed/0x30fd811c0305b6fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.646934:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.646938:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f092eed/0x30fd811c0305b6fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.646945:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f092eed/0x30fd811c0305b6fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.646957:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f092eed/0x30fd811c0305b6fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.646964:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f092eed/0x30fd811c0305b6fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.646980:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.646982:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.646983:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.647089:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1780997272.647089:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.647095:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beed4172/0x30fd811c0305b705 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647095:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000524b339/0x30fd811c0305b70c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647104:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.647104:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.647106:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.647109:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000beed4172/0x30fd811c0305b705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647112:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.647115:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000524b339/0x30fd811c0305b70c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647126:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000524b339/0x30fd811c0305b70c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647127:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000beed4172/0x30fd811c0305b705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647135:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beed4172/0x30fd811c0305b705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647142:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000beed4172/0x30fd811c0305b705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647158:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997272.647166:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.647170:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000beed4172/0x30fd811c0305b705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647177:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.647180:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000beed4172/0x30fd811c0305b705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647189:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000beed4172/0x30fd811c0305b705 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647200:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000beed4172/0x30fd811c0305b705 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647208:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000beed4172/0x30fd811c0305b705 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647209:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000524b339/0x30fd811c0305b70c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647217:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000524b339/0x30fd811c0305b70c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647226:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.647229:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000524b339/0x30fd811c0305b70c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647231:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1780997272.647236:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997272.647238:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.647239:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000524b339/0x30fd811c0305b70c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647246:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000524b339/0x30fd811c0305b70c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647257:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000524b339/0x30fd811c0305b70c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647264:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000524b339/0x30fd811c0305b70c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997272.647292:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.647297:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000330b343b/0x30fd811c0305b713 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647299:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.647301:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.647303:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.647306:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.647307:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.647310:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000330b343b/0x30fd811c0305b713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647319:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000330b343b/0x30fd811c0305b713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997272.647365:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.647370:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000153755d4/0x30fd811c0305b71a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647379:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.647385:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.647389:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000153755d4/0x30fd811c0305b71a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647398:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000153755d4/0x30fd811c0305b71a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647407:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000153755d4/0x30fd811c0305b71a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647414:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000153755d4/0x30fd811c0305b71a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647436:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997272.647452:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000330b343b/0x30fd811c0305b713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.647466:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997272.647467:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000330b343b/0x30fd811c0305b713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.647477:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000153755d4/0x30fd811c0305b71a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997272.647478:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.647486:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305b721 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647490:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997272.647491:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.647497:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000153755d4/0x30fd811c0305b71a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647502:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.647505:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.647511:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305b721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.647513:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000153755d4/0x30fd811c0305b71a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997272.647528:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.647533:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305b721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647536:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc04bcc3/0x30fd811c0305b728 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.647540:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000153755d4/0x30fd811c0305b71a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647544:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305b721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647545:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.647548:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.647551:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc04bcc3/0x30fd811c0305b728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.647562:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000153755d4/0x30fd811c0305b71a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647567:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc04bcc3/0x30fd811c0305b728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647576:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305b721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647576:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc04bcc3/0x30fd811c0305b728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647591:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc04bcc3/0x30fd811c0305b728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647593:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.647597:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000330b343b/0x30fd811c0305b713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.647604:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.647605:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956ea00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997272.647605:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1780997272.647610:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000330b343b/0x30fd811c0305b713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.647612:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc04bcc3/0x30fd811c0305b728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647613:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.647628:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000330b343b/0x30fd811c0305b713 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647645:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000330b343b/0x30fd811c0305b713 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.647647:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e000 already unused, calling callback (ffffffffc0ecc850) 00002000:00010000:1.0:1780997272.647648:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997272.647654:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc04bcc3/0x30fd811c0305b728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647656:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000330b343b/0x30fd811c0305b713 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647656:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075b5c411/0x30fd811c0305b72f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647678:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997272.647679:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc04bcc3/0x30fd811c0305b728 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647680:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.647683:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.647685:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.647685:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075b5c411/0x30fd811c0305b72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647688:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.647700:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997272.647704:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc04bcc3/0x30fd811c0305b728 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647705:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997272.647705:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075b5c411/0x30fd811c0305b72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647714:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305b721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647729:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075b5c411/0x30fd811c0305b72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647731:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.647731:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc04bcc3/0x30fd811c0305b728 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647736:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305b721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647740:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075b5c411/0x30fd811c0305b72f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647756:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305b721 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647760:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997272.647765:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997272.647767:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.647768:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305b721 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.647771:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075b5c411/0x30fd811c0305b72f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647783:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ec2604/0x30fd811c0305b721 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.647787:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.647793:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075b5c411/0x30fd811c0305b72f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647801:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.647803:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075b5c411/0x30fd811c0305b72f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647805:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780997272.647807:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.647808:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.647816:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ed15353/0x30fd811c0305b736 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.647822:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075b5c411/0x30fd811c0305b72f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647826:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.647829:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.647833:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ed15353/0x30fd811c0305b736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.647841:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075b5c411/0x30fd811c0305b72f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647846:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ed15353/0x30fd811c0305b736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997272.647850:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.647856:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305b73d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.647860:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.647865:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.647866:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.647869:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997272.647870:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.647872:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305b73d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.647873:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ed15353/0x30fd811c0305b736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647893:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305b73d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647901:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305b73d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647909:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305b73d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647928:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997272.647967:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.647972:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305b744 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647979:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.647980:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.647983:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305b744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647991:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305b744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.647999:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305b744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648006:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305b744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648039:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997272.648047:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997272.648051:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305b73d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648058:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.648061:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305b73d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648069:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305b73d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648079:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305b73d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648086:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae88f4fc/0x30fd811c0305b73d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648099:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.648102:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305b744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648107:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.648110:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305b744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648129:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305b744 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648140:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305b744 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648147:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dbb98cd/0x30fd811c0305b744 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648158:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.648160:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.648161:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.648204:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997272.648208:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.648210:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305b74b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648219:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.648220:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.648224:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305b74b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648232:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305b74b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648240:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305b74b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648255:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305b74b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648378:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997272.648421:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.648426:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305b752 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648433:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.648435:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.648437:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305b752 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648445:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305b752 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648452:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305b752 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648459:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305b752 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648472:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997272.648478:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997272.648482:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305b74b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648497:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.648500:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305b74b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648508:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305b74b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648518:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305b74b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648525:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a58eadef/0x30fd811c0305b74b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648537:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.648540:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305b752 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648546:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.648549:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305b752 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648556:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305b752 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648566:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305b752 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648578:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afd09116/0x30fd811c0305b752 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648590:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.648592:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.648593:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.648636:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.648640:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305b759 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648648:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.648649:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.648652:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305b759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648660:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305b759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648668:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305b759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648674:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305b759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648686:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997272.648691:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.648699:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305b759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648705:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.648708:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305b759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648715:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305b759 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648725:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305b759 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648731:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003c0264c/0x30fd811c0305b759 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648743:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.648744:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.648746:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.648779:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.648783:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305b760 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648790:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.648791:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.648794:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305b760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648811:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305b760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648818:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305b760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648825:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305b760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648836:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997272.648842:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.648846:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305b760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648851:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.648854:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305b760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648861:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305b760 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648870:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305b760 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648876:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8c62e49/0x30fd811c0305b760 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648894:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.648896:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.648898:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.648941:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.648946:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009006dbc1/0x30fd811c0305b767 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648953:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.648955:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.648958:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009006dbc1/0x30fd811c0305b767 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648966:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009006dbc1/0x30fd811c0305b767 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648973:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009006dbc1/0x30fd811c0305b767 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648980:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009006dbc1/0x30fd811c0305b767 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.648993:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997272.648998:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.649002:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009006dbc1/0x30fd811c0305b767 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.649018:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.649021:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009006dbc1/0x30fd811c0305b767 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649240:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ed15353/0x30fd811c0305b736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649257:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997272.649497:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.649504:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8efe3d/0x30fd811c0305b76e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649513:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.649514:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.649517:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e8efe3d/0x30fd811c0305b76e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649528:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e8efe3d/0x30fd811c0305b76e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649536:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8efe3d/0x30fd811c0305b76e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649543:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e8efe3d/0x30fd811c0305b76e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649557:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780997272.649604:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.649609:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc33734e/0x30fd811c0305b775 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649617:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.649618:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.649621:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc33734e/0x30fd811c0305b775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649631:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc33734e/0x30fd811c0305b775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649638:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc33734e/0x30fd811c0305b775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649645:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc33734e/0x30fd811c0305b775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649654:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1780997272.649686:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.649690:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059b4ca3c/0x30fd811c0305b77c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649697:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.649699:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.649702:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059b4ca3c/0x30fd811c0305b77c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649710:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059b4ca3c/0x30fd811c0305b77c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649723:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059b4ca3c/0x30fd811c0305b77c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649731:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059b4ca3c/0x30fd811c0305b77c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649739:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1780997272.649773:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.649778:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e387f1d/0x30fd811c0305b783 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649785:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.649786:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.649789:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e387f1d/0x30fd811c0305b783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649798:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e387f1d/0x30fd811c0305b783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649806:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e387f1d/0x30fd811c0305b783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649813:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e387f1d/0x30fd811c0305b783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649821:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1780997272.649862:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.649866:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077df01a4/0x30fd811c0305b78a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649873:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.649874:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.649890:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077df01a4/0x30fd811c0305b78a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649900:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077df01a4/0x30fd811c0305b78a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649913:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077df01a4/0x30fd811c0305b78a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649920:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077df01a4/0x30fd811c0305b78a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.649928:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1780997272.650199:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1780997272.650207:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ed15353/0x30fd811c0305b736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650217:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.650221:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ed15353/0x30fd811c0305b736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650231:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ed15353/0x30fd811c0305b736 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650245:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ed15353/0x30fd811c0305b736 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650253:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ed15353/0x30fd811c0305b736 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650303:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1780997272.650313:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e8efe3d/0x30fd811c0305b76e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650321:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.650324:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8efe3d/0x30fd811c0305b76e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650332:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8efe3d/0x30fd811c0305b76e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650343:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e8efe3d/0x30fd811c0305b76e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650351:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e8efe3d/0x30fd811c0305b76e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650365:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1780997272.650368:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc33734e/0x30fd811c0305b775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650374:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956ec00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.650377:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc33734e/0x30fd811c0305b775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650384:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc33734e/0x30fd811c0305b775 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650406:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc33734e/0x30fd811c0305b775 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650413:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc33734e/0x30fd811c0305b775 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650425:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780997272.650429:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059b4ca3c/0x30fd811c0305b77c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650435:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.650439:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059b4ca3c/0x30fd811c0305b77c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650446:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059b4ca3c/0x30fd811c0305b77c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650455:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059b4ca3c/0x30fd811c0305b77c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650462:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059b4ca3c/0x30fd811c0305b77c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650473:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997272.650476:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e387f1d/0x30fd811c0305b783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650489:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956ee00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.650492:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e387f1d/0x30fd811c0305b783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650515:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e387f1d/0x30fd811c0305b783 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650527:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e387f1d/0x30fd811c0305b783 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650534:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e387f1d/0x30fd811c0305b783 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650546:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997272.650549:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077df01a4/0x30fd811c0305b78a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650555:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956fc00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.650557:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077df01a4/0x30fd811c0305b78a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650564:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077df01a4/0x30fd811c0305b78a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650572:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077df01a4/0x30fd811c0305b78a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650584:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077df01a4/0x30fd811c0305b78a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.650596:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.650598:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.650600:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780997272.651239:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.651246:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000635f2ec0/0x30fd811c0305b791 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651256:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.651258:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.651261:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000635f2ec0/0x30fd811c0305b791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651285:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000635f2ec0/0x30fd811c0305b791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651304:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000635f2ec0/0x30fd811c0305b791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651311:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000635f2ec0/0x30fd811c0305b791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651535:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997272.651609:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.651615:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb6eb3e6/0x30fd811c0305b798 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651623:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.651625:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.651628:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb6eb3e6/0x30fd811c0305b798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651638:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb6eb3e6/0x30fd811c0305b798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651646:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb6eb3e6/0x30fd811c0305b798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651654:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb6eb3e6/0x30fd811c0305b798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651662:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780997272.651701:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.651706:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e39d904/0x30fd811c0305b79f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651714:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.651715:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.651719:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e39d904/0x30fd811c0305b79f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651728:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e39d904/0x30fd811c0305b79f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651736:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e39d904/0x30fd811c0305b79f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651744:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e39d904/0x30fd811c0305b79f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651751:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1780997272.651781:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.651786:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000794d842d/0x30fd811c0305b7a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651793:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.651794:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.651797:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000794d842d/0x30fd811c0305b7a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651806:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000794d842d/0x30fd811c0305b7a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651820:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000794d842d/0x30fd811c0305b7a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651829:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000794d842d/0x30fd811c0305b7a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651838:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1780997272.651856:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1780997272.651865:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000635f2ec0/0x30fd811c0305b791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997272.651870:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997272.651876:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.651882:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000635f2ec0/0x30fd811c0305b791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.651891:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000635f2ec0/0x30fd811c0305b791 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.651894:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004218bb1a/0x30fd811c0305b7ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.651914:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000635f2ec0/0x30fd811c0305b791 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.651923:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000635f2ec0/0x30fd811c0305b791 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.651943:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780997272.651946:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb6eb3e6/0x30fd811c0305b798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.651960:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.651963:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb6eb3e6/0x30fd811c0305b798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.651971:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb6eb3e6/0x30fd811c0305b798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.651981:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb6eb3e6/0x30fd811c0305b798 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.651987:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb6eb3e6/0x30fd811c0305b798 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.651999:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997272.652003:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e39d904/0x30fd811c0305b79f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.652018:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.652021:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e39d904/0x30fd811c0305b79f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.652037:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e39d904/0x30fd811c0305b79f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.652047:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e39d904/0x30fd811c0305b79f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.652061:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e39d904/0x30fd811c0305b79f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.652076:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997272.652080:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000794d842d/0x30fd811c0305b7a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.652086:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.652089:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000794d842d/0x30fd811c0305b7a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.652098:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000794d842d/0x30fd811c0305b7a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.652119:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000794d842d/0x30fd811c0305b7a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.652451:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000794d842d/0x30fd811c0305b7a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.652474:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.652476:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.652478:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.653055:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.653059:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.653063:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004218bb1a/0x30fd811c0305b7ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653082:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004218bb1a/0x30fd811c0305b7ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653093:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004218bb1a/0x30fd811c0305b7ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653101:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004218bb1a/0x30fd811c0305b7ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653125:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997272.653224:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997272.653231:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004218bb1a/0x30fd811c0305b7ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653244:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.653248:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004218bb1a/0x30fd811c0305b7ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653256:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004218bb1a/0x30fd811c0305b7ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653302:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004218bb1a/0x30fd811c0305b7ad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653312:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.653313:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.653315:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.653393:0:25173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004218bb1a/0x30fd811c0305b7ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997272.653497:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.653502:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005352d36c/0x30fd811c0305b7b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653510:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.653511:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.653514:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005352d36c/0x30fd811c0305b7b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653524:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005352d36c/0x30fd811c0305b7b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653531:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005352d36c/0x30fd811c0305b7b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653538:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005352d36c/0x30fd811c0305b7b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653554:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780997272.653586:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.653591:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006906ba84/0x30fd811c0305b7bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653598:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.653599:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.653606:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006906ba84/0x30fd811c0305b7bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653615:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006906ba84/0x30fd811c0305b7bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653623:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006906ba84/0x30fd811c0305b7bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653625:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997272.653632:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005352d36c/0x30fd811c0305b7b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653634:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006906ba84/0x30fd811c0305b7bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653652:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997272.653654:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997272.653658:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005352d36c/0x30fd811c0305b7b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653667:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005352d36c/0x30fd811c0305b7b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653680:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005352d36c/0x30fd811c0305b7b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997272.653692:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780997272.653696:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005352d36c/0x30fd811c0305b7b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653699:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e73c5b/0x30fd811c0305b7c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653713:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.653715:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.653718:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083e73c5b/0x30fd811c0305b7c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653719:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997272.653725:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006906ba84/0x30fd811c0305b7bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653729:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083e73c5b/0x30fd811c0305b7c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653735:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.653740:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006906ba84/0x30fd811c0305b7bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653743:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e73c5b/0x30fd811c0305b7c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653759:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006906ba84/0x30fd811c0305b7bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653784:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006906ba84/0x30fd811c0305b7bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653784:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083e73c5b/0x30fd811c0305b7c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653806:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006906ba84/0x30fd811c0305b7bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653807:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780997272.653823:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997272.653827:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083e73c5b/0x30fd811c0305b7c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653834:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.653843:0:14480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e73c5b/0x30fd811c0305b7c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997272.653846:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.653855:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004de764b6/0x30fd811c0305b7c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653857:0:14480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e73c5b/0x30fd811c0305b7c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.653869:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.653871:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.653875:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004de764b6/0x30fd811c0305b7c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653876:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083e73c5b/0x30fd811c0305b7c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653886:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083e73c5b/0x30fd811c0305b7c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.653899:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.653901:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.653902:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.654409:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009006dbc1/0x30fd811c0305b767 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654423:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009006dbc1/0x30fd811c0305b767 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654431:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009006dbc1/0x30fd811c0305b767 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654454:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.654456:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.654459:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.654466:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.654471:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.654536:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.654541:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edfa17d0/0x30fd811c0305b7d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654550:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.654551:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.654554:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edfa17d0/0x30fd811c0305b7d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654576:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edfa17d0/0x30fd811c0305b7d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654585:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edfa17d0/0x30fd811c0305b7d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654593:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edfa17d0/0x30fd811c0305b7d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654596:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004de764b6/0x30fd811c0305b7c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654604:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004de764b6/0x30fd811c0305b7c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654610:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004de764b6/0x30fd811c0305b7c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654611:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997272.654628:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997272.654632:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997272.654635:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edfa17d0/0x30fd811c0305b7d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654642:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.654646:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edfa17d0/0x30fd811c0305b7d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654654:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edfa17d0/0x30fd811c0305b7d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654663:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edfa17d0/0x30fd811c0305b7d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997272.654666:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.654671:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edfa17d0/0x30fd811c0305b7d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654671:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c2bc427/0x30fd811c0305b7d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654685:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.654686:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.654690:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c2bc427/0x30fd811c0305b7d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654691:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.654694:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004de764b6/0x30fd811c0305b7c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654699:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c2bc427/0x30fd811c0305b7d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654701:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.654704:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004de764b6/0x30fd811c0305b7c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654707:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c2bc427/0x30fd811c0305b7d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654712:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004de764b6/0x30fd811c0305b7c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654715:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c2bc427/0x30fd811c0305b7d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654722:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004de764b6/0x30fd811c0305b7c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654727:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997272.654728:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004de764b6/0x30fd811c0305b7c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654739:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.654742:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c2bc427/0x30fd811c0305b7d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654748:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.654752:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c2bc427/0x30fd811c0305b7d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997272.654758:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.654762:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9d872ff/0x30fd811c0305b7de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654768:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c2bc427/0x30fd811c0305b7d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654769:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.654771:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.654774:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9d872ff/0x30fd811c0305b7de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654779:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c2bc427/0x30fd811c0305b7d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654783:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9d872ff/0x30fd811c0305b7de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654787:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c2bc427/0x30fd811c0305b7d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654800:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.654800:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9d872ff/0x30fd811c0305b7de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654801:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.654803:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.654807:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9d872ff/0x30fd811c0305b7de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654808:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.654825:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997272.654827:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.654831:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9d872ff/0x30fd811c0305b7de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654839:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.654842:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9d872ff/0x30fd811c0305b7de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654850:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9d872ff/0x30fd811c0305b7de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654859:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9d872ff/0x30fd811c0305b7de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997272.654863:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.654868:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1bc80a/0x30fd811c0305b7e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654872:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9d872ff/0x30fd811c0305b7de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654875:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.654876:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.654893:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a1bc80a/0x30fd811c0305b7e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654894:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.654896:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.654898:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.654902:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a1bc80a/0x30fd811c0305b7e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654920:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1bc80a/0x30fd811c0305b7e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997272.654923:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.654929:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000012f60ee/0x30fd811c0305b7ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654929:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a1bc80a/0x30fd811c0305b7e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654937:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.654939:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.654942:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000012f60ee/0x30fd811c0305b7ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654946:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997272.654952:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000012f60ee/0x30fd811c0305b7ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654960:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000012f60ee/0x30fd811c0305b7ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654967:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000012f60ee/0x30fd811c0305b7ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654976:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.654980:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a1bc80a/0x30fd811c0305b7e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.654992:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9400 already unused, calling callback (ffffffffc0ecc850) 00002000:00010000:1.0:1780997272.654994:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.654995:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1bc80a/0x30fd811c0305b7e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.654999:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000125fbd40/0x30fd811c0305b7f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.655003:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1bc80a/0x30fd811c0305b7e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.655006:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.655007:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.655011:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000125fbd40/0x30fd811c0305b7f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.655013:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a1bc80a/0x30fd811c0305b7e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.655019:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000125fbd40/0x30fd811c0305b7f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.655021:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a1bc80a/0x30fd811c0305b7e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.655038:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000125fbd40/0x30fd811c0305b7f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.655044:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.655046:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.655046:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000125fbd40/0x30fd811c0305b7f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.655047:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.655058:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780997272.656425:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780997272.656516:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780997272.656524:0:25173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc303d24/0x30fd811c0305b7fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.656539:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.656541:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997272.656545:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc303d24/0x30fd811c0305b7fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.656557:0:25173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc303d24/0x30fd811c0305b7fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.656578:0:25173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc303d24/0x30fd811c0305b7fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.656586:0:25173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc303d24/0x30fd811c0305b7fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.656613:0:25173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1780997272.656778:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780997272.656787:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000012f60ee/0x30fd811c0305b7ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656798:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.656803:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000012f60ee/0x30fd811c0305b7ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656813:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000012f60ee/0x30fd811c0305b7ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656831:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000012f60ee/0x30fd811c0305b7ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656847:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000012f60ee/0x30fd811c0305b7ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656872:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997272.656876:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000125fbd40/0x30fd811c0305b7f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656883:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.656886:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000125fbd40/0x30fd811c0305b7f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656899:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000125fbd40/0x30fd811c0305b7f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656910:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000125fbd40/0x30fd811c0305b7f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656918:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000125fbd40/0x30fd811c0305b7f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656933:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997272.656936:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc303d24/0x30fd811c0305b7fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656942:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.656951:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc303d24/0x30fd811c0305b7fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656959:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc303d24/0x30fd811c0305b7fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656969:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc303d24/0x30fd811c0305b7fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.656976:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc303d24/0x30fd811c0305b7fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.656990:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.656993:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.656997:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.657000:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.657001:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.657076:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.657082:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cc89c22/0x30fd811c0305b801 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657091:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.657093:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.657096:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cc89c22/0x30fd811c0305b801 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657112:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cc89c22/0x30fd811c0305b801 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657119:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cc89c22/0x30fd811c0305b801 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657126:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cc89c22/0x30fd811c0305b801 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657146:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997272.657187:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.657192:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82227e9/0x30fd811c0305b808 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657199:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.657200:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.657202:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e82227e9/0x30fd811c0305b808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657211:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e82227e9/0x30fd811c0305b808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657218:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82227e9/0x30fd811c0305b808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657226:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e82227e9/0x30fd811c0305b808 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657246:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997272.657254:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997272.657258:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cc89c22/0x30fd811c0305b801 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657264:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.657267:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cc89c22/0x30fd811c0305b801 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657289:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cc89c22/0x30fd811c0305b801 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657300:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cc89c22/0x30fd811c0305b801 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657307:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cc89c22/0x30fd811c0305b801 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657321:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.657323:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e82227e9/0x30fd811c0305b808 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657330:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.657333:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82227e9/0x30fd811c0305b808 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657353:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82227e9/0x30fd811c0305b808 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657363:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e82227e9/0x30fd811c0305b808 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657369:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e82227e9/0x30fd811c0305b808 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657385:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.657387:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.657390:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.657398:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.657434:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.657440:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005298fbc2/0x30fd811c0305b80f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657448:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.657449:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.657452:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005298fbc2/0x30fd811c0305b80f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657461:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005298fbc2/0x30fd811c0305b80f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657469:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005298fbc2/0x30fd811c0305b80f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657486:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005298fbc2/0x30fd811c0305b80f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657507:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997272.657544:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.657549:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c471ea7d/0x30fd811c0305b816 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657558:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.657559:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.657563:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c471ea7d/0x30fd811c0305b816 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657572:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c471ea7d/0x30fd811c0305b816 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657579:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c471ea7d/0x30fd811c0305b816 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657587:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c471ea7d/0x30fd811c0305b816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657599:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997272.657605:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997272.657608:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005298fbc2/0x30fd811c0305b80f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657625:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2055e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.657629:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005298fbc2/0x30fd811c0305b80f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657635:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005298fbc2/0x30fd811c0305b80f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657645:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005298fbc2/0x30fd811c0305b80f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657653:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005298fbc2/0x30fd811c0305b80f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657667:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.657670:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c471ea7d/0x30fd811c0305b816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657676:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.657679:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c471ea7d/0x30fd811c0305b816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657687:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c471ea7d/0x30fd811c0305b816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657695:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c471ea7d/0x30fd811c0305b816 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.657710:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.657711:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c471ea7d/0x30fd811c0305b816 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657726:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.657728:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.657730:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.657771:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.657776:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305b81d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657784:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.657786:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.657789:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305b81d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657798:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305b81d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657804:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305b81d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657811:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305b81d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657831:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997272.657868:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.657879:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305b824 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657900:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.657901:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.657904:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305b824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657913:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305b824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657921:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305b824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657928:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305b824 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657942:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997272.657949:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997272.657953:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305b81d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657960:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.657963:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305b81d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657969:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305b81d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657990:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305b81d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.657998:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005fa4b8d/0x30fd811c0305b81d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658012:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.658015:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305b824 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658021:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.658023:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305b824 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658041:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305b824 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.658044:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.658054:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305b824 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658061:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f16438d/0x30fd811c0305b824 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658072:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.658074:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.658080:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.658124:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.658129:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305b82b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658137:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.658138:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.658141:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305b82b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658149:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305b82b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658156:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305b82b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658163:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305b82b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658183:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997272.658227:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.658232:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305b832 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658239:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.658242:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997272.658242:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.658245:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305b832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.658249:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305b82b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658290:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305b832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.658293:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997272.658300:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305b82b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658303:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305b832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.658321:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305b82b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658322:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305b832 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658347:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997272.658357:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997272.658358:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305b82b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658361:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305b832 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.658372:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb6af9a1/0x30fd811c0305b82b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658375:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.658381:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305b832 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658391:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305b832 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.658391:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.658394:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.658397:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.658408:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305b832 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658416:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee9a0b1e/0x30fd811c0305b832 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658439:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.658440:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.658443:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.658481:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.658486:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305b839 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658494:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.658495:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.658498:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305b839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658507:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305b839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658516:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305b839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1780997272.658522:0:25173:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:771 00010000:00010000:3.0:1780997272.658523:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305b839 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658543:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997272.658576:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.658580:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305b840 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658596:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.658597:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.658600:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305b840 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658609:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305b840 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658616:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305b840 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997272.658620:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:90260:x1867507127008256:12345-0@lo:5:osp-pre-1-0.0 Request processed in 43698us (44120us total) trans 0 rc 0/0 00010000:00010000:3.0:1780997272.658623:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305b840 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997272.658630:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5974 00010000:00010000:3.0:1780997272.658635:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997272.658642:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997272.658647:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305b839 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.658647:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997272.658655:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305b840 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658657:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.658662:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305b839 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.658670:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.658676:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305b839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.658677:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305b840 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997272.658685:0:90260:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90260:1867507127008256:0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1780997272.658697:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305b840 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780997272.658703:0:90260:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x361:0x0] from OST, last_created [0x2c0000401:0x361:0x0]last_used is [0x2c0000401:0x303:0x0] 00010000:00010000:2.0:1780997272.658721:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305b840 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658723:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305b839 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997272.658742:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005749adda/0x30fd811c0305b840 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658743:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f457437/0x30fd811c0305b839 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658765:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.658768:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.658771:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997272.658781:0:90260:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90260:1867507127008640:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1780997272.658783:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127008512:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1780997272.658784:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.658788:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.658791:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997272.658817:0:90260:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997272.658818:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997272.658840:0:90260:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5300 going to sleep for 11 seconds 00000100:00100000:1.0:1780997272.658857:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127008640 00000100:00100000:1.0:1780997272.658862:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127008640 00002000:00010000:3.0:1780997272.658887:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.658892:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305b847 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658900:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.658902:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.658906:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305b847 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658915:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305b847 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658922:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305b847 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658939:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305b847 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658952:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997272.658959:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.658963:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305b847 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658969:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.658972:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305b847 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658979:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305b847 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658989:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305b847 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.658996:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418a31f1/0x30fd811c0305b847 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659009:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.659011:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.659012:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.659066:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.659077:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305b84e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659085:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.659086:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.659088:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305b84e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659097:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305b84e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659105:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305b84e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659112:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305b84e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659125:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997272.659133:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.659137:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305b84e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659143:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.659147:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305b84e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659154:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305b84e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659174:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305b84e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659182:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcadbb82/0x30fd811c0305b84e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659196:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.659198:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.659199:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.659242:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.659248:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305b855 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659254:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.659256:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.659258:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305b855 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659266:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305b855 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659294:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305b855 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659303:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305b855 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659326:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997272.659365:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.659370:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305b85c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659378:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.659379:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.659383:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305b85c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659391:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305b85c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659400:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305b85c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659407:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305b85c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659419:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997272.659424:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997272.659428:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305b855 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659434:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.659437:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305b855 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659453:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305b855 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659464:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305b855 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659471:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008193abd0/0x30fd811c0305b855 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659485:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.659489:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305b85c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659495:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.659498:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305b85c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659505:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305b85c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659514:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305b85c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659521:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb8c2293/0x30fd811c0305b85c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659543:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.659544:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.659546:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780997272.659586:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.659590:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305b863 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659597:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.659599:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.659601:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305b863 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659610:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305b863 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659617:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305b863 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659622:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305b863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659634:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997272.659639:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.659643:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305b863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659660:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1e00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.659663:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305b863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659670:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305b863 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659680:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305b863 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659687:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000660e77ba/0x30fd811c0305b863 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659702:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.659704:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.659707:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997272.659707:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127008512 00000100:00100000:2.0:1780997272.659716:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127008512 00002000:00010000:3.0:1780997272.659762:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.659769:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305b86a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659776:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1780997272.659779:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00010000:00010000:3.0:1780997272.659780:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.659785:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305b86a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997272.659794:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688884a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507127008512:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1780997272.659798:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305b86a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659813:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305b86a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659819:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305b86a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:2.0:1780997272.659824:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00010000:00010000:3.0:1780997272.659840:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997272.659847:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.659851:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305b86a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659859:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0600 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.659863:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305b86a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659871:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305b86a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.659882:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305b86a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997272.659891:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688884a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507127008512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1069us total) trans 0 rc 0/0 00010000:00010000:3.0:1780997272.659892:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf461455/0x30fd811c0305b86a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997272.659907:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00010000:00010000:3.0:1780997272.659917:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.659925:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.659928:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997272.659934:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997272.659962:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127008512:0@lo:13:osp-pre-1-0.0 00002000:00010000:3.0:1780997272.660018:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.660023:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305b871 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997272.660231:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5976 00000100:00100000:1.0:1780997272.660242:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:90260:x1867507127008640:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1780997272.660648:0:25173:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 866 00010000:00010000:0.0:1780997272.664022:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.667459:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.667461:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.667468:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305b871 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667486:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305b871 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667498:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305b871 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667505:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305b871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667534:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780997272.667632:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.667638:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305b878 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667644:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.667646:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.667657:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305b878 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667665:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305b878 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667672:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305b878 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667677:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305b878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667691:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780997272.667702:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997272.667708:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305b871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667715:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1000 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.667720:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305b871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667728:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305b871 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667744:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305b871 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997272.667747:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:90260:x1867507127008640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7504us (8925us total) trans 4294969458 rc 0/0 00000100:00100000:1.0:1780997272.667757:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5976 00010000:00010000:3.0:1780997272.667761:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002414bd4a/0x30fd811c0305b871 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667783:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997272.667787:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305b878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667793:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0a00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997272.667796:0:37626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305b878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667803:0:37626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305b878 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667812:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305b878 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667819:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb88755/0x30fd811c0305b878 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997272.667821:0:90260:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90260:1867507127008640:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1780997272.667832:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.667834:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997272.667836:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1780997272.667838:0:90260:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x361:0x0]-[0x2c0000401:0x381:0x0] 00002000:00010000:3.0:1780997272.667878:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780997272.667965:0:25177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305b87f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667981:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.667983:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997272.667986:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305b87f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.667995:0:25177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305b87f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.668002:0:25177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305b87f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.668009:0:25177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305b87f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997272.668037:0:25177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780997272.668425:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997272.668432:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305b87f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.668440:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1800 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:1.0:1780997272.668443:0:6340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305b87f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.668451:0:6340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305b87f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.668463:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305b87f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.668471:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000647f67b9/0x30fd811c0305b87f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997272.668486:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.668488:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997272.668490:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1780997272.668543:0:25177:0:(ofd_dev.c:1517:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:770 00000100:00100000:3.0:1780997272.668610:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:90258:x1867507127008384:12345-0@lo:5:osp-pre-0-0.0 Request processed in 51160us (51283us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997272.668619:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5975 00000100:00100000:1.0:1780997272.669186:0:90258:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90258:1867507127008384:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1780997272.669199:0:90258:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x361:0x0] from OST, last_created [0x280000400:0x361:0x0]last_used is [0x280000400:0x302:0x0] 00000100:00100000:1.0:1780997272.669348:0:90258:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90258:1867507127008896:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1780997272.669401:0:90258:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997272.669423:0:90258:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5300 going to sleep for 11 seconds 00000100:00100000:1.0:1780997272.669436:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780997272.669446:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127008768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997272.669472:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997272.670475:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127008768 00000100:00100000:3.0:1780997272.670486:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127008768 00000100:00100000:3.0:1780997272.670561:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:3.0:1780997272.670571:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127008768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780997272.670599:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997272.670655:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127008768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997272.670676:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00100000:3.0:1780997272.670716:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127008768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780997272.670924:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127008896 00000100:00100000:0.0:1780997272.670929:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127008896 00000100:00100000:0.0:1780997272.671117:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5977 00000100:00100000:0.0:1780997272.671127:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:90258:x1867507127008896:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1780997272.671156:0:25181:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 866 00010000:00010000:1.0:1780997272.673407:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997272.676400:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:90258:x1867507127008896:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5265us (6987us total) trans 4294969456 rc 0/0 00000100:00100000:0.0:1780997272.676418:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5977 00000100:00100000:3.0:1780997272.676816:0:90258:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90258:1867507127008896:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1780997272.676840:0:90258:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x361:0x0]-[0x280000400:0x381:0x0] 00010000:00010000:0.0:1780997273.318604:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997273.346820:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997273.347338:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110422016 00000100:00100000:2.0:1780997273.347351:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110422016 00000100:00100000:2.0:1780997273.347419:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:2.0:1780997273.347429:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110422016:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997273.347513:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110422016:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 85us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997273.347522:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:2.0:1780997273.352905:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997273.352946:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997273.353120:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110422144 00000100:00100000:0.0:1780997273.353131:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110422144 00000100:00100000:0.0:1780997273.353202:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110422272 00000100:00100000:0.0:1780997273.353205:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110422272 00000100:00100000:0.0:1780997273.353244:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1383 00000100:00100000:0.0:1780997273.353252:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2395:x1867507110422144:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997273.353355:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2395:x1867507110422144:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 103us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997273.353362:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1383 00000100:00100000:0.0:1780997273.353377:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1384 00000100:00100000:0.0:1780997273.353383:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2394:x1867507110422272:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997273.353408:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2394:x1867507110422272:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997273.353413:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1384 00000100:00080000:1.0:1780997273.353552:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997274.021544:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127009024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997274.021638:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997274.021754:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127009024 00000100:00100000:3.0:1780997274.021763:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127009024 00000100:00100000:3.0:1780997274.021819:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:3.0:1780997274.021831:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127009024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997274.021856:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1780997274.022448:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997274.022464:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780997274.022493:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127009152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997274.022530:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997274.022560:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127009152 00000100:00100000:1.0:1780997274.022564:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127009152 00000100:00100000:1.0:1780997274.022607:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149 00000100:00100000:1.0:1780997274.022614:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127009152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780997274.022626:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780997274.022659:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127009152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997274.022666:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149 00000100:00080000:1.0:1780997274.022688:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780997274.022730:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127009152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780997274.025120:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127009024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3282us (3471us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997274.025135:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00100000:2.0:1780997274.025316:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127009024:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1780997274.345345:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997274.442943:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997274.443174:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110422400 00000100:00100000:1.0:1780997274.443185:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110422400 00000100:00100000:1.0:1780997274.443261:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1449 00000100:00100000:1.0:1780997274.443304:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:71674:x1867507110422400:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780997274.443325:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997274.443347:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8600/0x30fd811c0305b886 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e71 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997274.443432:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305b88d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997274.443449:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305b88d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997274.443461:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305b88d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997274.443519:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780997274.443522:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780997274.443557:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305b88d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997274.443595:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8600/0x30fd811c0305b886 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e71 expref: 8 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997274.443615:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305b88d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e71 expref: 7 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997274.443623:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:1.0:1780997274.443626:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780997274.443629:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8800, rc 0) 00000100:00100000:1.0:1780997274.443716:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71674:x1867507110422400:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 447us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997274.443723:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1449 00000100:00080000:2.0:1780997274.444131:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780997274.452396:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997274.452509:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110422528 00000100:00100000:2.0:1780997274.452520:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110422528 00000100:00100000:2.0:1780997274.452604:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1450 00000100:00100000:2.0:1780997274.452617:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71674:x1867507110422528:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:2.0:1780997274.452674:0:80049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:2.0:1780997274.452762:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71674:x1867507110422528:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 148us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997274.452771:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1450 00000100:00100000:3.0:1780997274.459821:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997274.460121:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110422656 00000100:00100000:2.0:1780997274.460134:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110422656 00000100:00100000:2.0:1780997274.460192:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1451 00000100:00100000:2.0:1780997274.460201:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71674:x1867507110422656:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:2.0:1780997274.460240:0:63418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:2.0:1780997274.460414:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71674:x1867507110422656:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 213us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997274.460421:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1451 00000100:00100000:1.0:1780997274.477851:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997274.477939:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110422784 00000100:00100000:2.0:1780997274.477961:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110422784 00000100:00100000:2.0:1780997274.478003:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5978 00000100:00100000:2.0:1780997274.478009:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1867507110422784:12345-192.168.206.51@tcp:8:lfs.0 00010000:00080000:2.0:1780997274.478051:0:8233:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp t0 exp 0000000000000000 cur 3802 last 0 00000020:00000080:2.0:1780997274.478084:0:8233:0:(genops.c:1406:class_connect()) connect: client e4805cfa-ac6d-4d67-bb97-a6c06740fcd0, cookie 0x30fd811c0305b894 00002000:00100000:2.0:1780997274.478096:0:8233:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e4805cfa-ac6d-4d67-bb97-a6c06740fcd0/ffff9689b11b8000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1780997274.478113:0:8233:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1780997274.478182:0:8233:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1780997274.478223:0:8233:0:(import.c:65:import_set_state_nolock()) ffff9689b1066000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780997274.478326:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110422784:12345-192.168.206.51@tcp:8:lfs.0 Request processed in 316us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997274.478334:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5978 00000100:00100000:0.0:1780997274.482491:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997274.482731:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110422912 00000100:00100000:2.0:1780997274.482742:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110422912 00000100:00100000:2.0:1780997274.482867:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2150 00000100:00100000:2.0:1780997274.482877:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:71674:x1867507110422912:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1780997274.482910:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997274.483309:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:71674:x1867507110422912:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 432us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997274.483317:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2150 00000100:00080000:1.0:1780997274.483989:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997274.486485:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997274.486696:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110423040 00000100:00100000:0.0:1780997274.486706:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110423040 00000100:00100000:0.0:1780997274.486753:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5979 00000100:00100000:0.0:1780997274.486761:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2393:x1867507110423040:12345-192.168.206.51@tcp:8:lfs.0 00010000:00080000:0.0:1780997274.486798:0:25182:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp t0 exp 0000000000000000 cur 3802 last 0 00000020:00000080:0.0:1780997274.486831:0:25182:0:(genops.c:1406:class_connect()) connect: client e4805cfa-ac6d-4d67-bb97-a6c06740fcd0, cookie 0x30fd811c0305b89b 00002000:00100000:0.0:1780997274.486844:0:25182:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e4805cfa-ac6d-4d67-bb97-a6c06740fcd0/ffff96888b414800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1780997274.486861:0:25182:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1780997274.486921:0:25182:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1780997274.486946:0:25182:0:(import.c:65:import_set_state_nolock()) ffff96888b413000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780997274.487005:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110423040:12345-192.168.206.51@tcp:8:lfs.0 Request processed in 244us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997274.487032:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5979 00000100:00100000:1.0:1780997274.501499:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997274.502672:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110423168 00000100:00100000:2.0:1780997274.502686:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110423168 00000100:00100000:2.0:1780997274.502781:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2151 00000100:00100000:2.0:1780997274.502792:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:71674:x1867507110423168:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1780997274.502826:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997274.502919:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:71674:x1867507110423168:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 128us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997274.502927:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2151 00000100:00080000:1.0:1780997274.503424:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1780997275.365454:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997276.389626:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997277.413624:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997277.606688:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507127009408:0@lo:400:kworker.0 00000100:00100000:3.0:1780997277.606761:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997277.606791:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127009920:0@lo:400:kworker.0 00000100:00100000:3.0:1780997277.606818:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997277.606837:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127010432:0@lo:400:kworker.0 00000100:00100000:3.0:1780997277.606864:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997277.606892:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1780997277.606908:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507127009536:0@lo:400:kworker.0 00000100:00100000:3.0:1780997277.606949:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997277.606969:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127010048:0@lo:400:kworker.0 00000100:00100000:3.0:1780997277.606994:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997277.607022:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127010560:0@lo:400:kworker.0 00000100:00100000:3.0:1780997277.607043:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997277.607075:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127009920 00000100:00100000:3.0:1780997277.607082:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127009920 00000100:00100000:3.0:1780997277.607125:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127010432 00000100:00100000:3.0:1780997277.607128:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127010432 00000100:00100000:3.0:1780997277.607148:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4104 00000100:00100000:3.0:1780997277.607156:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127009920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997277.607212:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127009920:12345-0@lo:400:kworker.0 Request processed in 55us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997277.607220:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4104 00000100:00100000:3.0:1780997277.607239:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4105 00000100:00100000:3.0:1780997277.607246:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127010432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997277.607256:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688874f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507127009664:0@lo:400:kworker.0 00000100:00100000:0.0:1780997277.607317:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997277.607337:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127010176:0@lo:400:kworker.0 00000100:00100000:0.0:1780997277.607359:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997277.607375:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127010688:0@lo:400:kworker.0 00000100:00100000:0.0:1780997277.607392:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997277.607410:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1780997277.607416:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127009280:0@lo:400:kworker.0 00000100:00100000:0.0:1780997277.607439:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997277.607463:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507127009792:0@lo:400:kworker.0 00000100:00100000:0.0:1780997277.607485:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997277.607501:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507127010304:0@lo:400:kworker.0 00000100:00100000:0.0:1780997277.607521:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997277.607537:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968887e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507127010816:0@lo:400:kworker.0 00000100:00100000:0.0:1780997277.607562:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997277.607592:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127009408 00000100:00100000:0.0:1780997277.607597:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127009408 00000100:00100000:0.0:1780997277.607630:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127009536 00000100:00100000:0.0:1780997277.607633:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127009536 00000100:00100000:0.0:1780997277.607645:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127009664 00000100:00100000:0.0:1780997277.607648:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127009664 00000100:00100000:1.0:1780997277.607798:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127009792 00000100:00100000:1.0:1780997277.607802:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127009792 00000100:00100000:1.0:1780997277.607823:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127010304 00000100:00100000:1.0:1780997277.607826:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127010304 00000100:00100000:1.0:1780997277.607836:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127010816 00000100:00100000:1.0:1780997277.607839:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127010816 00000100:00100000:1.0:1780997277.607852:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1780997277.607860:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507127009408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.607896:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507127009408:12345-0@lo:400:kworker.0 Request processed in 37us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997277.607903:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1780997277.607916:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:1.0:1780997277.607921:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507127009536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.607947:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507127009536:12345-0@lo:400:kworker.0 Request processed in 26us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997277.607952:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:1.0:1780997277.607975:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:1.0:1780997277.607981:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507127009792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.608021:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507127009792:12345-0@lo:400:kworker.0 Request processed in 40us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997277.608027:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:1.0:1780997277.608039:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:1.0:1780997277.608045:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507127010304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.608082:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507127010304:12345-0@lo:400:kworker.0 Request processed in 38us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997277.608088:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:1.0:1780997277.608101:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:1.0:1780997277.608106:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507127010816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.608129:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507127010816:12345-0@lo:400:kworker.0 Request processed in 23us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997277.608135:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:1.0:1780997277.608147:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780997277.608155:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127010944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780997277.608184:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997277.608329:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127010048 00000100:00100000:1.0:1780997277.608333:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127010048 00000100:00100000:1.0:1780997277.608361:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127010560 00000100:00100000:1.0:1780997277.608364:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127010560 00000100:00100000:1.0:1780997277.608381:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127010176 00000100:00100000:1.0:1780997277.608383:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127010176 00000100:00100000:1.0:1780997277.608399:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127010688 00000100:00100000:1.0:1780997277.608402:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127010688 00000100:00100000:1.0:1780997277.608420:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:1.0:1780997277.608426:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127010048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.608459:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127010048:12345-0@lo:400:kworker.0 Request processed in 34us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997277.608465:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00100000:1.0:1780997277.608476:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:1.0:1780997277.608482:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507127010560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.608508:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507127010560:12345-0@lo:400:kworker.0 Request processed in 27us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997277.608519:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:1.0:1780997277.608529:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:1.0:1780997277.608534:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127010176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.608561:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127010176:12345-0@lo:400:kworker.0 Request processed in 26us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997277.608566:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00100000:1.0:1780997277.608575:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:1.0:1780997277.608581:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507127010688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.608606:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3496:x1867507127010688:12345-0@lo:400:kworker.0 Request processed in 25us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997277.608611:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00100000:1.0:1780997277.608788:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127010944 00000100:00100000:1.0:1780997277.608793:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127010944 00000100:00100000:1.0:1780997277.608816:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4106 00000100:00100000:1.0:1780997277.608823:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507127010944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780997277.608849:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:1.0:1780997277.608883:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507127010944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997277.608890:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4106 00000100:00100000:1.0:1780997277.608922:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127011072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997277.608949:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997277.608990:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127010944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780997277.609031:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127011072 00000100:00100000:1.0:1780997277.609035:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127011072 00000100:00100000:1.0:1780997277.609051:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4107 00000100:00100000:1.0:1780997277.609064:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3499:x1867507127011072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780997277.609081:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:1.0:1780997277.609114:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3499:x1867507127011072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997277.609120:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4107 00000100:00100000:1.0:1780997277.609299:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127011072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997277.609357:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127009280 00000100:00100000:1.0:1780997277.609362:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127009280 00000100:00100000:1.0:1780997277.609390:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1780997277.609397:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507127009280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.609480:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507127009280:12345-0@lo:400:kworker.0 Request processed in 84us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997277.609488:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1780997277.609547:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997277.609553:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997277.609557:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997277.609559:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997277.609589:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127009280:0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.609603:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507127009792:0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.609617:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507127010304:0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.609630:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507127010816:0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.609642:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127010176:0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.609653:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968887e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127010688:0@lo:400:kworker.0 00000100:00100000:0.0:1780997277.609882:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1780997277.609893:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507127009664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997277.609940:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507127009664:12345-0@lo:400:kworker.0 Request processed in 51us (2623us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997277.609946:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1780997277.610396:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507127009536:0@lo:400:kworker.0 00000100:00100000:2.0:1780997277.610408:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127010048:0@lo:400:kworker.0 00000100:00100000:2.0:1780997277.610418:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127010560:0@lo:400:kworker.0 00000100:00100000:2.0:1780997277.610429:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507127009408:0@lo:400:kworker.0 00000100:00100000:2.0:1780997277.610449:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127009920:0@lo:400:kworker.0 00000100:00100000:1.0:1780997277.611037:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688874f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507127009664:0@lo:400:kworker.0 00000100:00100000:3.0:1780997277.612219:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127010432:12345-0@lo:400:kworker.0 Request processed in 4967us (5348us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997277.612232:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4105 00000100:00100000:0.0:1780997277.613124:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127010432:0@lo:400:kworker.0 00000100:00100000:2.0:1780997278.118012:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997278.118042:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba186680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127011200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780997278.118158:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997278.119337:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127011200 00000100:00100000:3.0:1780997278.119365:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127011200 00000100:00100000:3.0:1780997278.119449:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:3.0:1780997278.119462:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507127011200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780997278.119504:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997278.119596:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507127011200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997278.119626:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00100000:0.0:1780997278.119966:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba186680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127011200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780997278.122133:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127011328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780997278.122226:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997278.122382:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127011328 00000100:00100000:3.0:1780997278.122393:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127011328 00000100:00100000:3.0:1780997278.122458:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153 00000100:00100000:3.0:1780997278.122468:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507127011328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780997278.122505:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997278.122563:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3497:x1867507127011328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997278.122571:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153 00000100:00100000:0.0:1780997278.122669:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127011328:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1780997278.290888:0:90709:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:3.0:1780997278.441618:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997278.467923:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997278.467977:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997278.468021:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997278.468047:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997278.468074:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997278.468093:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110423296 00000100:00100000:1.0:1780997278.468104:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110423296 00000100:00100000:0.0:1780997278.468110:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110423808 00000100:00100000:0.0:1780997278.468116:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110423808 00000100:00100000:0.0:1780997278.468165:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110423680 00000100:00100000:0.0:1780997278.468169:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110423680 00000100:00100000:1.0:1780997278.468178:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:1.0:1780997278.468193:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2396:x1867507110423296:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997278.468194:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2678 00000100:00100000:0.0:1780997278.468207:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2396:x1867507110423808:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997278.468300:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2396:x1867507110423808:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 96us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997278.468308:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2678 00000100:00100000:0.0:1780997278.468327:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2679 00000100:00100000:0.0:1780997278.468333:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adeddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2396:x1867507110423680:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997278.469366:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110423552 00000100:00100000:3.0:1780997278.469376:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110423552 00000100:00100000:3.0:1780997278.469422:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110423424 00000100:00100000:3.0:1780997278.469425:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110423424 00000100:00100000:3.0:1780997278.469449:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1391 00000100:00100000:3.0:1780997278.469456:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2396:x1867507110423552:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997278.470356:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1392 00000100:00100000:2.0:1780997278.470370:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110423424:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997278.470860:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2396:x1867507110423552:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1398us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997278.470870:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1391 00000100:00100000:2.0:1780997278.471020:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110423424:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 652us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997278.471026:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1392 00000100:00100000:1.0:1780997278.471484:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2396:x1867507110423296:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3293us (3568us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997278.471495:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00080000:1.0:1780997278.471531:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780997278.471536:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997278.471539:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997278.471542:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997278.477144:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adeddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2396:x1867507110423680:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 8797us (9055us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997278.477561:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2679 00000001:00100000:1.0:1780997278.635855:0:9294:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000001:00080000:1.0:1780997278.635878:0:9294:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969458 is committed 00000001:00100000:2.0:1780997278.636639:0:8226:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00000001:00080000:2.0:1780997278.636658:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969456 is committed 00000100:00100000:0.0:1780997279.142399:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127011456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997279.142478:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997279.142601:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127011456 00000100:00100000:3.0:1780997279.142609:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127011456 00000100:00080000:2.0:1780997279.142676:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997279.142679:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154 00000100:00100000:3.0:1780997279.142689:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127011456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997279.142710:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997279.142767:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127011456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997279.142789:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154 00000100:00100000:2.0:1780997279.143292:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127011456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997279.143478:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997279.143489:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127011584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997279.143530:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997279.143618:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127011584 00000100:00100000:3.0:1780997279.143624:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127011584 00000100:00100000:3.0:1780997279.143675:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:3.0:1780997279.143683:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127011584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997279.143698:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997279.143733:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127011584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997279.143740:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00080000:2.0:1780997279.143865:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997279.143892:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127011584:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1780997279.464365:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1780997280.122929:0:90757:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1780997280.486086:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997281.509516:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997281.928345:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997281.928620:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110423936 00000100:00100000:2.0:1780997281.928632:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110423936 00000100:00100000:2.0:1780997281.928792:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1452 00000100:00100000:2.0:1780997281.928807:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:72120:x1867507110423936:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:2.0:1780997281.928856:0:63584:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:2.0:1780997281.928949:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:72120:x1867507110423936:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 145us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997281.928987:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1452 00000100:00080000:1.0:1780997281.930078:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997281.939948:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997281.943133:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110424064 00000100:00100000:3.0:1780997281.943155:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110424064 00000100:00100000:3.0:1780997281.943358:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1453 00000100:00100000:3.0:1780997281.943370:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:72120:x1867507110424064:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:3.0:1780997281.943412:0:80049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:3.0:1780997281.943490:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:72120:x1867507110424064:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 123us (3566us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997281.943499:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1453 00000100:00080000:1.0:1780997281.943863:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997281.946392:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997281.948321:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110424192 00000100:00100000:1.0:1780997281.948341:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110424192 00000100:00100000:1.0:1780997281.948443:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2156 00000100:00100000:1.0:1780997281.948454:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:72120:x1867507110424192:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:1.0:1780997281.948495:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780997281.948576:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:72120:x1867507110424192:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 124us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997281.948584:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2156 00000100:00080000:2.0:1780997281.948904:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780997281.956809:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997281.956958:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110424320 00000100:00100000:3.0:1780997281.956971:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110424320 00000100:00100000:3.0:1780997281.957077:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2157 00000100:00100000:3.0:1780997281.957090:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:72120:x1867507110424320:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:3.0:1780997281.957133:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1780997281.957439:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997281.957939:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:72120:x1867507110424320:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 849us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997281.957982:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2157 00000100:00100000:1.0:1780997281.992848:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997281.995262:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110424448 00000100:00100000:2.0:1780997281.995289:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110424448 00000100:00100000:1.0:1780997281.995760:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1454 00000100:00100000:1.0:1780997281.995776:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:71039:x1867507110424448:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1780997281.995798:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997281.995820:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8200/0x30fd811c0305b8a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e78 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996051:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8600/0x30fd811c0305b8a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996069:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8600/0x30fd811c0305b8a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996083:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8600/0x30fd811c0305b8a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996099:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b8b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996107:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996113:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996374:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8e00/0x30fd811c0305b8b7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996383:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8e00/0x30fd811c0305b8b7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996391:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8e00/0x30fd811c0305b8b7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997281.996441:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780997281.996446:0:63418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780997281.996484:0:63418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8e00/0x30fd811c0305b8b7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996497:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8600/0x30fd811c0305b8a9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996504:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8600/0x30fd811c0305b8a9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996510:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8600/0x30fd811c0305b8a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996516:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8600/0x30fd811c0305b8a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996522:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997281.996527:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8600/0x30fd811c0305b8a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996534:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8600/0x30fd811c0305b8a9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996546:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:1.0:1780997281.996549:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997281.996555:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8600/0x30fd811c0305b8a9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996561:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8600/0x30fd811c0305b8a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996588:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996594:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b8b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996599:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996604:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997281.996607:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996614:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b8b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996622:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9689ba1fe900) 00010000:00010000:1.0:1780997281.996624:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997281.996627:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b8b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996633:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b8b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996665:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8200/0x30fd811c0305b8a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e78 expref: 9 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996678:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8e00/0x30fd811c0305b8b7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e78 expref: 8 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997281.996850:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689ba1fef00) 00010000:00010000:1.0:1780997281.996853:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780997281.996856:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8e00, rc 0) 00000100:00100000:1.0:1780997281.996924:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:71039:x1867507110424448:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1153us (4087us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997281.996932:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1454 00000100:00100000:1.0:1780997282.007987:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997282.008192:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110424576 00000100:00100000:2.0:1780997282.008207:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110424576 00000100:00100000:2.0:1780997282.008487:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1455 00000100:00100000:2.0:1780997282.008504:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:71039:x1867507110424576:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1780997282.008534:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997282.008565:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b8be lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e7f expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.008659:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b8c5 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.008679:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b8c5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.008704:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b8c5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.008727:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b8cc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.008735:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b8cc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.008742:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b8cc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997282.011441:0:63584:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb524700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:63584:1867507127011712:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1780997282.011571:0:63584:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997282.011714:0:63584:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997282.013091:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127011712 00000100:00100000:1.0:1780997282.013464:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127011712 00000100:00100000:1.0:1780997282.013663:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4108 00000100:00100000:1.0:1780997282.013710:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63584:x1867507127011712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780997282.014107:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63584:x1867507127011712:12345-0@lo:1000:mdt00_003.0 Request processed in 421us (2524us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997282.014117:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4108 00000100:00100000:0.0:1780997282.014263:0:63584:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb524700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:63584:1867507127011712:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1780997282.014787:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffde00/0x30fd811c0305b8d3 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.014829:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffde00/0x30fd811c0305b8d3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.014879:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffde00/0x30fd811c0305b8d3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997282.015164:0:63584:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffde00/0x30fd811c0305b8d3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015195:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b8c5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015204:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b8c5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015211:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b8c5 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015458:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b8c5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015480:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997282.015485:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b8c5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015507:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b8c5 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015526:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689ba1fef00) 00010000:00010000:0.0:1780997282.015542:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997282.015549:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b8c5 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015571:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454600/0x30fd811c0305b8c5 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015617:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b8cc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015624:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b8cc lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015630:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b8cc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015635:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997282.015648:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b8cc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015667:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b8cc lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015699:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9689964dc500) 00010000:00010000:0.0:1780997282.015716:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997282.015721:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b8cc lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.015728:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454c00/0x30fd811c0305b8cc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.016130:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689ba454200/0x30fd811c0305b8be lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e7f expref: 10 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.016149:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffde00/0x30fd811c0305b8d3 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e7f expref: 9 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.016158:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff96898d864900) 00010000:00010000:0.0:1780997282.016160:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780997282.016163:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffde00, rc 0) 00000100:00100000:0.0:1780997282.016536:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71039:x1867507110424576:12345-192.168.206.51@tcp:101:bash.0 Request processed in 8034us (8630us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997282.016549:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1455 00000100:00100000:0.0:1780997282.021042:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997282.021196:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110424704 00000100:00100000:3.0:1780997282.021213:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110424704 00000100:00100000:3.0:1780997282.021391:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1456 00000100:00100000:3.0:1780997282.021404:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71039:x1867507110424704:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1780997282.021437:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997282.021466:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0a00/0x30fd811c0305b8da lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e86 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997282.021559:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1000/0x30fd811c0305b8e1 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997282.021577:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1000/0x30fd811c0305b8e1 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997282.021590:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1000/0x30fd811c0305b8e1 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997282.021656:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1780997282.021661:0:80049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1780997282.021746:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0a00/0x30fd811c0305b8da lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e86 expref: 11 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997282.022162:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1000/0x30fd811c0305b8e1 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e86 expref: 10 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997282.022174:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9689882bd900) 00010000:00010000:3.0:1780997282.022177:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1780997282.022199:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1000, rc 0) 00000100:00100000:3.0:1780997282.022470:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71039:x1867507110424704:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1066us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997282.022479:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1456 00000100:00100000:3.0:1780997282.028325:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997282.028377:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997282.028465:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110424960 00000100:00100000:0.0:1780997282.028481:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110424960 00000100:00100000:2.0:1780997282.028562:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110424832 00000100:00100000:2.0:1780997282.028574:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110424832 00000100:00100000:0.0:1780997282.028581:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 702 00000100:00100000:0.0:1780997282.028598:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b620a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2397:x1867507110424960:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780997282.028643:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1780997282.028654:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1457 00000100:00100000:2.0:1780997282.028667:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:71039:x1867507110424832:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1780997282.028679:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1000/0x30fd811c0305b8e1 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e86 expref: 11 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.028687:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997282.028709:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454200/0x30fd811c0305b8e8 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e8d expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.028719:0:6336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9689882bd900) 00010000:00010000:0.0:1780997282.028728:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997282.028780:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454c00/0x30fd811c0305b8ef lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.028797:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454c00/0x30fd811c0305b8ef lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.028809:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454c00/0x30fd811c0305b8ef lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997282.028820:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b620a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2397:x1867507110424960:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 223us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997282.028831:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 702 00010000:00010000:2.0:1780997282.028832:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454600/0x30fd811c0305b8f6 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.028843:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454600/0x30fd811c0305b8f6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.028853:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454600/0x30fd811c0305b8f6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.028986:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054800/0x30fd811c0305b8fd lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.028996:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054800/0x30fd811c0305b8fd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029004:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054800/0x30fd811c0305b8fd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997282.029053:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x4:0x0]: returning size 0 00000004:00200000:2.0:1780997282.029058:0:63419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780997282.029085:0:63419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054800/0x30fd811c0305b8fd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029097:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054800/0x30fd811c0305b8fd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029106:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454c00/0x30fd811c0305b8ef lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029113:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454c00/0x30fd811c0305b8ef lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029121:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454c00/0x30fd811c0305b8ef lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029128:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454c00/0x30fd811c0305b8ef lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029134:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997282.029139:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454c00/0x30fd811c0305b8ef lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029211:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454c00/0x30fd811c0305b8ef lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029225:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9689882bd900) 00010000:00010000:2.0:1780997282.029228:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997282.029233:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454c00/0x30fd811c0305b8ef lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029240:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454c00/0x30fd811c0305b8ef lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029254:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454600/0x30fd811c0305b8f6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029260:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454600/0x30fd811c0305b8f6 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029264:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454600/0x30fd811c0305b8f6 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029313:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997282.029316:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454600/0x30fd811c0305b8f6 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029323:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454600/0x30fd811c0305b8f6 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029331:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff9689964dcd00) 00010000:00010000:2.0:1780997282.029334:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997282.029337:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454600/0x30fd811c0305b8f6 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029353:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454600/0x30fd811c0305b8f6 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029388:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689ba454200/0x30fd811c0305b8e8 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e8d expref: 11 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029401:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054800/0x30fd811c0305b8fd lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e8d expref: 10 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.029408:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9689836c9c00) 00010000:00010000:2.0:1780997282.029410:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997282.029413:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689c2054800, rc 0) 00000100:00100000:2.0:1780997282.029475:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71039:x1867507110424832:12345-192.168.206.51@tcp:101:bash.0 Request processed in 811us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997282.029485:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1457 00000100:00100000:3.0:1780997282.034515:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997282.034590:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110425088 00000100:00100000:0.0:1780997282.034610:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110425088 00000100:00100000:0.0:1780997282.034699:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5980 00000100:00100000:0.0:1780997282.034713:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110425088:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1780997282.034737:0:25177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997282.034778:0:25177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee94f0f6/0x30fd811c0305b904 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e94 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997282.034811:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x623:0x0] initial LVB size: 0, mtime: 0x6a27dc74, atime: 0x6a27dc74, ctime: 0x6a27dc74, blocks: 0x0 00010000:00010000:0.0:1780997282.034837:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997282.034839:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997282.034852:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee94f0f6/0x30fd811c0305b904 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e94 expref: 6 pid: 25177 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.034877:0:25177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee94f0f6/0x30fd811c0305b904 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e94 expref: 6 pid: 25177 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.034918:0:25177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffca00, rc 0) 00000100:00100000:0.0:1780997282.035024:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2394:x1867507110425088:12345-192.168.206.51@tcp:101:bash.0 Request processed in 313us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997282.035034:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5980 00000100:00100000:2.0:1780997282.040763:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997282.040905:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110425216 00000100:00100000:0.0:1780997282.040927:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110425216 00000100:00100000:0.0:1780997282.041043:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1458 00000100:00100000:0.0:1780997282.041057:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:71039:x1867507110425216:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1780997282.041105:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997282.041140:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305b90b lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8e9b expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.041261:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968980030000/0x30fd811c0305b912 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.041706:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968980030000/0x30fd811c0305b912 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.041722:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968980030000/0x30fd811c0305b912 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.041745:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968980031a00/0x30fd811c0305b919 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.041753:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968980031a00/0x30fd811c0305b919 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.041923:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968980031a00/0x30fd811c0305b919 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997282.042196:0:63417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:63417:1867507127011840:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1780997282.042619:0:63417:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997282.042746:0:63417:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640240 going to sleep for 11 seconds 00000100:00100000:3.0:1780997282.043019:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127011840 00000100:00100000:3.0:1780997282.043031:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127011840 00000100:00100000:3.0:1780997282.043113:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4109 00000100:00100000:3.0:1780997282.043125:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63417:x1867507127011840:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1780997282.043423:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63417:x1867507127011840:12345-0@lo:1000:mdt00_000.0 Request processed in 299us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997282.043432:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4109 00000100:00100000:1.0:1780997282.045019:0:63417:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:63417:1867507127011840:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1780997282.045201:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b920 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.045941:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b920 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.045963:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b920 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997282.046010:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b920 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.046063:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968980030000/0x30fd811c0305b912 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.046070:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968980030000/0x30fd811c0305b912 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.046077:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968980030000/0x30fd811c0305b912 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049057:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968980030000/0x30fd811c0305b912 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049080:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980030000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997282.049087:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968980030000/0x30fd811c0305b912 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049101:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968980030000/0x30fd811c0305b912 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049235:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9689ba1fef00) 00010000:00010000:1.0:1780997282.049239:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997282.049246:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968980030000/0x30fd811c0305b912 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049256:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968980030000/0x30fd811c0305b912 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049309:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968980031a00/0x30fd811c0305b919 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049318:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968980031a00/0x30fd811c0305b919 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049358:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968980031a00/0x30fd811c0305b919 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049363:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997282.049366:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968980031a00/0x30fd811c0305b919 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049373:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968980031a00/0x30fd811c0305b919 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049383:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff96898d864c00) 00010000:00010000:1.0:1780997282.049386:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997282.049390:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968980031a00/0x30fd811c0305b919 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049397:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968980031a00/0x30fd811c0305b919 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049489:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305b90b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e9b expref: 11 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049510:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c9400/0x30fd811c0305b920 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e9b expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997282.049518:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689ba1fe900) 00010000:00010000:1.0:1780997282.049520:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780997282.049523:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9400, rc 0) 00000100:00100000:1.0:1780997282.049651:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71039:x1867507110425216:12345-192.168.206.51@tcp:101:bash.0 Request processed in 8594us (8898us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997282.049796:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1458 00000100:00100000:2.0:1780997282.055006:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997282.055148:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110425344 00000100:00100000:1.0:1780997282.055162:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110425344 00000100:00100000:3.0:1780997282.055422:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1459 00000100:00100000:3.0:1780997282.055448:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71039:x1867507110425344:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1780997282.055473:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997282.055494:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0a00/0x30fd811c0305b927 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ea2 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997282.055569:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0600/0x30fd811c0305b92e lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997282.055584:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0600/0x30fd811c0305b92e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997282.055597:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0600/0x30fd811c0305b92e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997282.055667:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1780997282.055671:0:80049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1780997282.055711:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0a00/0x30fd811c0305b927 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ea2 expref: 12 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997282.055731:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0600/0x30fd811c0305b92e lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ea2 expref: 11 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997282.055740:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689882bd300) 00010000:00010000:3.0:1780997282.055742:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1780997282.055746:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0600, rc 0) 00000100:00100000:3.0:1780997282.057368:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:71039:x1867507110425344:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1923us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997282.057380:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1459 00000100:00100000:1.0:1780997282.063879:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997282.064620:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997282.065092:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110425600 00000100:00100000:3.0:1780997282.065104:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110425600 00000100:00100000:3.0:1780997282.065312:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 703 00000100:00100000:3.0:1780997282.065324:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2397:x1867507110425600:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780997282.065342:0:18812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997282.065371:0:18812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0600/0x30fd811c0305b92e lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ea2 expref: 11 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997282.065392:0:18812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689882bd300) 00010000:00010000:3.0:1780997282.065397:0:18812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997282.065460:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2397:x1867507110425600:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 138us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997282.065483:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 703 00000100:00100000:2.0:1780997282.065540:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110425472 00000100:00100000:2.0:1780997282.065545:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110425472 00000100:00100000:2.0:1780997282.065575:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1460 00000100:00100000:2.0:1780997282.065582:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:71039:x1867507110425472:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1780997282.065599:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997282.065618:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b935 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ea9 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065683:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b93c lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065704:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b93c lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065713:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b93c lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065728:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b943 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065736:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b943 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065743:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b943 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065822:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b94a lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065836:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b94a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065843:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b94a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997282.065896:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x5:0x0]: returning size 0 00000004:00200000:2.0:1780997282.065907:0:63419:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780997282.065926:0:63419:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b94a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065938:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b94a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065958:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b93c lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065964:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b93c lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065979:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b93c lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065986:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b93c lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.065992:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997282.065996:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b93c lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.066003:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b93c lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.066012:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9689882bd300) 00010000:00010000:2.0:1780997282.066015:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997282.066019:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b93c lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.066025:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305b93c lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.066037:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b943 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.066043:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b943 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.066055:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b943 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.066060:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997282.066063:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b943 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.066068:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b943 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.066076:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff9689964dcd00) 00010000:00010000:2.0:1780997282.066079:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997282.066082:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b943 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.066087:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305b943 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.066116:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305b935 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ea9 expref: 12 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.066130:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2055e00/0x30fd811c0305b94a lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ea9 expref: 11 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997282.066138:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff96898a563d00) 00010000:00010000:2.0:1780997282.066140:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997282.066142:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689c2055e00, rc 0) 00000100:00100000:2.0:1780997282.066186:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:71039:x1867507110425472:12345-192.168.206.51@tcp:101:bash.0 Request processed in 603us (2322us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997282.066202:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1460 00000100:00100000:2.0:1780997282.072446:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997282.072724:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110425728 00000100:00100000:0.0:1780997282.072735:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110425728 00000100:00100000:0.0:1780997282.072799:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5981 00000100:00100000:0.0:1780997282.072809:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2394:x1867507110425728:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1780997282.072829:0:25181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997282.072850:0:25181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305b951 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8eb0 expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997282.072877:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x624:0x0] initial LVB size: 0, mtime: 0x6a27dc74, atime: 0x6a27dc74, ctime: 0x6a27dc74, blocks: 0x0 00010000:00010000:0.0:1780997282.072953:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997282.072956:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997282.072964:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305b951 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eb0 expref: 7 pid: 25181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.072998:0:25181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000faf0d599/0x30fd811c0305b951 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eb0 expref: 7 pid: 25181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997282.073012:0:25181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968980031600, rc 0) 00000100:00100000:0.0:1780997282.073070:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110425728:12345-192.168.206.51@tcp:101:bash.0 Request processed in 263us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997282.073077:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5981 00010000:00010000:3.0:1780997282.533531:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997282.725553:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127011968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997282.725651:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997282.725793:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127011968 00000100:00100000:1.0:1780997282.725801:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127011968 00000100:00100000:1.0:1780997282.725856:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4110 00000100:00100000:1.0:1780997282.725865:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127011968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780997282.725898:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:0.0:1780997282.727094:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127011968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997282.727119:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997282.727130:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127012096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997282.729689:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127012224:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.731004:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127011968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5132us (5345us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997282.731019:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4110 00000100:00100000:0.0:1780997282.731040:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997282.731060:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127012096 00000100:00100000:1.0:1780997282.731069:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127012096 00000100:00100000:0.0:1780997282.731094:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507127012480:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.731110:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4111 00000100:00100000:1.0:1780997282.731120:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127012096:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997282.731135:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1780997282.731155:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:1.0:1780997282.731951:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127012096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 830us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997282.731960:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4111 00000100:00100000:1.0:1780997282.732008:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507127012352:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.732041:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997282.732065:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127012864:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.732089:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997282.732105:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127013376:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.732774:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997282.733350:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127012864 00000100:00100000:1.0:1780997282.733360:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127012864 00000100:00100000:1.0:1780997282.733418:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127013376 00000100:00100000:1.0:1780997282.733421:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127013376 00000100:00100000:1.0:1780997282.733442:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680 00000100:00100000:1.0:1780997282.733449:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127012864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.734222:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127012992:0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.734263:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997282.734454:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127013504:0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.734485:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997282.734533:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127012096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997282.734558:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1780997282.734565:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507127012608:0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.734591:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997282.734611:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507127013120:0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.734634:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997282.734655:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507127013632:0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.734676:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997282.734722:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127012480 00000100:00100000:0.0:1780997282.734727:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127012480 00000100:00100000:1.0:1780997282.734984:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127012864:12345-0@lo:400:kworker.0 Request processed in 73us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997282.734988:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127012352 00000100:00100000:0.0:1780997282.734995:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127012352 00000100:00100000:1.0:1780997282.735001:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680 00000100:00100000:1.0:1780997282.735022:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127012992 00000100:00100000:1.0:1780997282.735026:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127012992 00000100:00100000:1.0:1780997282.735051:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127013504 00000100:00100000:1.0:1780997282.735055:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127013504 00000100:00100000:1.0:1780997282.735073:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:1.0:1780997282.735079:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127013376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.735124:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127013376:12345-0@lo:400:kworker.0 Request processed in 45us (2352us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997282.735130:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:1.0:1780997282.735141:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1780997282.735147:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127012992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.735166:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127012608 00000100:00100000:0.0:1780997282.735170:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127012608 00000100:00100000:0.0:1780997282.735201:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127013120 00000100:00100000:0.0:1780997282.735204:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127013120 00000100:00100000:0.0:1780997282.735214:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127013632 00000100:00100000:0.0:1780997282.735216:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127013632 00000100:00100000:0.0:1780997282.735229:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1780997282.735236:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507127012480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.735288:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507127012480:12345-0@lo:400:kworker.0 Request processed in 36us (4135us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997282.735295:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1780997282.735472:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:0.0:1780997282.735485:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507127012352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.735521:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507127012352:12345-0@lo:400:kworker.0 Request processed in 40us (3479us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997282.735527:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:0.0:1780997282.735541:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:0.0:1780997282.735546:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507127012608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.735574:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507127012608:12345-0@lo:400:kworker.0 Request processed in 28us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997282.735582:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:2.0:1780997282.735587:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997282.735597:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:0.0:1780997282.735604:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507127013120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.735637:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507127013120:12345-0@lo:400:kworker.0 Request processed in 33us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997282.735643:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:2.0:1780997282.735649:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127012736:0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.735659:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1780997282.735668:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507127013632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997282.735686:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997282.735703:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127013248:0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.735717:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507127013632:12345-0@lo:400:kworker.0 Request processed in 49us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997282.735724:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1780997282.735737:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997282.735740:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127012736 00000100:00100000:2.0:1780997282.735789:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127013248 00000100:00100000:2.0:1780997282.735794:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127013248 00000100:00100000:2.0:1780997282.735826:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4112 00000100:00100000:2.0:1780997282.735833:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127013248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997282.735871:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127013248:12345-0@lo:400:kworker.0 Request processed in 38us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997282.735878:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4112 00000100:00100000:2.0:1780997282.735926:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127013248:0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.735966:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127012736 00000100:00100000:2.0:1780997282.736002:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:2.0:1780997282.736013:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adeded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127013504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997282.736049:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adeded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127013504:12345-0@lo:400:kworker.0 Request processed in 39us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997282.736067:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00100000:0.0:1780997282.736079:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00080000:2.0:1780997282.736103:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997282.736108:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780997282.736111:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997282.736119:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780997282.736157:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127012736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.736197:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127012736:12345-0@lo:400:kworker.0 Request processed in 44us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997282.736248:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127012992:12345-0@lo:400:kworker.0 Request processed in 1098us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997282.736257:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1780997282.736304:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507127012352:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.736317:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127012864:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.736338:0:3499:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969456 gen 2 00000100:00100000:1.0:1780997282.736349:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127013376:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.736383:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127012224 00000100:00100000:1.0:1780997282.736388:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127012224 00000100:00100000:1.0:1780997282.736416:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1780997282.736421:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507127012224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.736457:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507127012224:12345-0@lo:400:kworker.0 Request processed in 36us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997282.736464:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1780997282.736505:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507127012608:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.736517:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507127013120:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.736528:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507127013632:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.736540:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507127012480:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.736551:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127012992:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.736560:0:3496:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969458 gen 2 00000100:00100000:1.0:1780997282.736568:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127013504:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.736626:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127012224:0@lo:400:kworker.0 00000100:00100000:1.0:1780997282.736636:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127012736:0@lo:400:kworker.0 00000100:00100000:0.0:1780997282.737193:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:2.0:1780997283.237704:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127013760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780997283.237778:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997283.237828:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997283.237835:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127013888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997283.237859:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997283.237938:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127013760 00000100:00100000:3.0:1780997283.237947:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127013760 00000100:00100000:3.0:1780997283.238017:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127013888 00000100:00100000:3.0:1780997283.238021:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127013888 00000100:00100000:3.0:1780997283.238049:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158 00000100:00100000:3.0:1780997283.238059:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127013760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780997283.238082:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997283.238142:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127013760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997283.238149:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158 00000100:00100000:3.0:1780997283.238166:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:3.0:1780997283.238172:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127013888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780997283.238185:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997283.238209:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127013888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997283.238214:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00100000:2.0:1780997283.241378:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127013888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997283.241404:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127013760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1780997283.557441:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997283.597000:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997283.597077:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997283.597097:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997283.597124:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997283.597144:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997283.597179:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110426368 00000100:00100000:1.0:1780997283.597192:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110426368 00000100:00100000:1.0:1780997283.597256:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110426240 00000100:00100000:1.0:1780997283.597259:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110426240 00000100:00100000:1.0:1780997283.597323:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2684 00000100:00100000:1.0:1780997283.597335:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110426368:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997283.597486:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110426368:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 152us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997283.597495:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2684 00000100:00100000:1.0:1780997283.597511:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2685 00000100:00100000:1.0:1780997283.597517:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110426240:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997283.597542:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2394:x1867507110426240:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997283.597548:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2685 00000100:00100000:1.0:1780997283.597567:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110426112 00000100:00100000:1.0:1780997283.597570:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110426112 00000100:00100000:1.0:1780997283.597597:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110425984 00000100:00100000:1.0:1780997283.597601:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110425984 00000100:00100000:0.0:1780997283.597778:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1399 00000100:00100000:0.0:1780997283.597788:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2394:x1867507110426112:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997283.597820:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2394:x1867507110426112:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997283.597826:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1399 00000100:00100000:0.0:1780997283.597842:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1400 00000100:00100000:0.0:1780997283.597847:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2394:x1867507110425984:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997283.597871:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2394:x1867507110425984:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997283.597877:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1400 00000100:00100000:2.0:1780997283.598899:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110425856 00000100:00100000:2.0:1780997283.598911:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110425856 00000100:00100000:2.0:1780997283.598973:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:2.0:1780997283.598983:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110425856:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997283.599029:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110425856:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 48us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997283.599036:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00080000:2.0:1780997283.599074:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780997283.599078:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997283.599081:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780997283.599083:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997284.261916:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127014016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997284.261998:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997284.262047:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780997284.262054:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127014144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997284.262091:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997284.262222:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127014016 00000100:00100000:0.0:1780997284.262231:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127014016 00000100:00100000:0.0:1780997284.262311:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127014144 00000100:00100000:0.0:1780997284.262315:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127014144 00000100:00100000:0.0:1780997284.262336:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160 00000100:00100000:0.0:1780997284.262346:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127014016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997284.262392:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997284.262438:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127014016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997284.262445:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160 00000100:00100000:0.0:1780997284.262463:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161 00000100:00100000:0.0:1780997284.262470:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127014144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997284.262485:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997284.262509:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127014144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997284.262515:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161 00000100:00080000:1.0:1780997284.262970:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997284.262976:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997284.263021:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127014144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780997284.263036:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127014016:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1780997284.584746:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997285.606590:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997286.629519:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997287.653617:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997287.846234:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127014272:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.846347:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.846387:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127014784:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.846414:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.846435:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507127015296:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.846455:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.846472:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507127015808:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.846492:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.846517:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1780997287.846523:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507127014400:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.846544:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.846560:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127014912:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.846583:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.846601:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127015424:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.846621:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.846650:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507127014528:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.846671:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.846687:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127015040:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.846709:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.846727:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127015552:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.846760:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.846780:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1780997287.846786:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507127014656:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.846808:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.846825:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127015168:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.846846:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.846863:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127015680:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.846884:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.846928:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127014272 00000100:00100000:1.0:1780997287.846937:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127014272 00000100:00100000:1.0:1780997287.847019:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1780997287.847029:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507127014272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.847083:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507127014272:12345-0@lo:400:kworker.0 Request processed in 56us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.847090:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1780997287.847130:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127014784 00000100:00100000:1.0:1780997287.847134:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127014784 00000100:00100000:1.0:1780997287.847162:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127015296 00000100:00100000:1.0:1780997287.847165:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127015296 00000100:00100000:1.0:1780997287.847177:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127015808 00000100:00100000:1.0:1780997287.847179:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127015808 00000100:00100000:1.0:1780997287.847189:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127014400 00000100:00100000:1.0:1780997287.847191:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127014400 00000100:00100000:1.0:1780997287.847202:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127014528 00000100:00100000:1.0:1780997287.847205:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127014528 00000100:00100000:1.0:1780997287.847216:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127014656 00000100:00100000:1.0:1780997287.847218:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127014656 00000100:00100000:1.0:1780997287.847230:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:1.0:1780997287.847236:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127014784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.847304:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127014784:12345-0@lo:400:kworker.0 Request processed in 68us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.847311:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:1.0:1780997287.847324:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:1.0:1780997287.847333:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507127015296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.847361:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507127015296:12345-0@lo:400:kworker.0 Request processed in 30us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.847366:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:1.0:1780997287.847376:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1780997287.847381:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507127015808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.847405:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507127015808:12345-0@lo:400:kworker.0 Request processed in 24us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.847410:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1780997287.847420:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:1.0:1780997287.847426:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507127014400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.847449:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507127014400:12345-0@lo:400:kworker.0 Request processed in 24us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.847454:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:1.0:1780997287.847463:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1780997287.847467:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507127014528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.847494:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507127014528:12345-0@lo:400:kworker.0 Request processed in 27us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.847499:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1780997287.847510:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1780997287.847515:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507127014656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.847547:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507127014656:12345-0@lo:400:kworker.0 Request processed in 33us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.847553:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1780997287.847580:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127014912 00000100:00100000:1.0:1780997287.847584:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127014912 00000100:00100000:1.0:1780997287.847607:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127015424 00000100:00100000:1.0:1780997287.847609:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127015424 00000100:00100000:1.0:1780997287.847625:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4113 00000100:00100000:1.0:1780997287.847630:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127014912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.847663:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127014912:12345-0@lo:400:kworker.0 Request processed in 33us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.847668:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4113 00000100:00100000:1.0:1780997287.847680:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4114 00000100:00100000:1.0:1780997287.847686:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127015424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.847713:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127015424:12345-0@lo:400:kworker.0 Request processed in 27us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.847719:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4114 00000100:00100000:1.0:1780997287.847744:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127015040 00000100:00100000:1.0:1780997287.847747:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127015040 00000100:00100000:1.0:1780997287.847775:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127015552 00000100:00100000:1.0:1780997287.847778:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127015552 00000100:00100000:1.0:1780997287.847794:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127015168 00000100:00100000:1.0:1780997287.847796:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127015168 00000100:00100000:1.0:1780997287.847812:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127015680 00000100:00100000:1.0:1780997287.847815:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127015680 00000100:00100000:1.0:1780997287.847831:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1780997287.847838:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127015040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.847869:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127015040:12345-0@lo:400:kworker.0 Request processed in 31us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.847881:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1780997287.847893:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1780997287.847899:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127015552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.847927:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127015552:12345-0@lo:400:kworker.0 Request processed in 29us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.847932:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1780997287.847959:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00100000:1.0:1780997287.847966:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127015168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.847996:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127015168:12345-0@lo:400:kworker.0 Request processed in 31us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.848001:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00100000:1.0:1780997287.848011:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:1.0:1780997287.848016:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127015680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.848039:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127015680:12345-0@lo:400:kworker.0 Request processed in 23us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.848043:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00100000:1.0:1780997287.848100:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507127014400:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.848113:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127014912:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.848124:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127015424:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.848134:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127014272:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.848143:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127014784:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.848153:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507127015296:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.848172:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507127015808:0@lo:400:kworker.0 00000100:00080000:1.0:1780997287.848217:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997287.848222:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997287.848224:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780997287.848226:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997287.848242:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507127014656:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.848253:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127015168:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.848262:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127015680:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.848294:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507127014528:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.848306:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127015040:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.848316:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127015552:0@lo:400:kworker.0 00000100:00100000:1.0:1780997287.851149:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127015936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780997287.852332:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.852390:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780997287.852400:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127016064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997287.852425:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997287.852452:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127015936 00000100:00100000:1.0:1780997287.852460:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127015936 00000100:00100000:1.0:1780997287.852495:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127016064 00000100:00100000:1.0:1780997287.852497:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127016064 00000100:00100000:1.0:1780997287.852513:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4115 00000100:00100000:1.0:1780997287.852520:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127015936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780997287.852554:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:1.0:1780997287.852590:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127015936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.852603:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4115 00000100:00100000:1.0:1780997287.852618:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4116 00000100:00100000:1.0:1780997287.852623:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3497:x1867507127016064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780997287.852636:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:1.0:1780997287.852661:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3497:x1867507127016064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 38us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997287.852667:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4116 00000100:00100000:1.0:1780997287.852704:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127016064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997287.852738:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127015936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997288.357461:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997288.357487:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127016192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997288.357559:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997288.357606:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127016192 00000100:00100000:2.0:1780997288.357612:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127016192 00000100:00100000:2.0:1780997288.357668:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162 00000100:00100000:2.0:1780997288.357676:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127016192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780997288.357713:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997288.357753:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127016192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997288.357761:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162 00000100:00100000:2.0:1780997288.357804:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127016192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780997288.358351:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127016320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780997288.358389:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997288.358521:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127016320 00000100:00100000:1.0:1780997288.358528:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127016320 00000100:00100000:1.0:1780997288.358566:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163 00000100:00100000:1.0:1780997288.358574:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127016320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780997288.358597:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780997288.358651:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127016320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997288.358658:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163 00000100:00100000:2.0:1780997288.358731:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127016320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1780997288.677652:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997288.707845:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997288.707914:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997288.707963:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997288.708000:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997288.708029:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997288.708060:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110426752 00000100:00100000:1.0:1780997288.708070:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110426752 00000100:00100000:2.0:1780997288.708135:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110426496 00000100:00100000:1.0:1780997288.708139:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110426624 00000100:00100000:2.0:1780997288.708141:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110426496 00000100:00100000:1.0:1780997288.708161:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110426624 00000100:00100000:2.0:1780997288.708184:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:2.0:1780997288.708196:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110426496:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997288.708202:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1407 00000100:00100000:1.0:1780997288.708213:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2395:x1867507110426752:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997288.708302:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110426496:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 108us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997288.708305:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2395:x1867507110426752:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 92us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997288.708318:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:1.0:1780997288.708319:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1407 00000100:00100000:1.0:1780997288.708342:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1408 00000100:00100000:1.0:1780997288.708351:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2395:x1867507110426624:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997288.708362:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110427008 00000100:00100000:2.0:1780997288.708366:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110427008 00000100:00100000:1.0:1780997288.708381:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2395:x1867507110426624:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997288.708388:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1408 00000100:00100000:2.0:1780997288.708397:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110426880 00000100:00100000:2.0:1780997288.708401:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110426880 00000100:00080000:1.0:1780997288.708412:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997288.708417:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997288.708421:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780997288.708423:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780997288.708429:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2690 00000100:00100000:2.0:1780997288.708437:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110427008:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997288.708464:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110427008:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997288.708471:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2690 00000100:00100000:2.0:1780997288.708483:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2691 00000100:00100000:2.0:1780997288.708489:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110426880:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997288.708522:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110426880:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997288.708529:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2691 00000100:00100000:1.0:1780997289.386342:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127016448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997289.386427:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997289.386622:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997289.386632:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127016576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997289.386662:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997289.392421:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127016448 00000100:00100000:2.0:1780997289.392440:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127016448 00000100:00100000:2.0:1780997289.394185:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127016576 00000100:00100000:2.0:1780997289.394195:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127016576 00000100:00100000:3.0:1780997289.394253:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164 00000100:00100000:3.0:1780997289.394286:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127016448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997289.394315:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997289.394404:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127016448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (7976us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997289.394421:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164 00000100:00100000:3.0:1780997289.394596:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127016448:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1780997289.394756:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997289.394761:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997289.394840:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165 00000100:00100000:2.0:1780997289.394849:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127016576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780997289.394863:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997289.394905:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127016576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (8242us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997289.394912:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165 00000100:00100000:2.0:1780997289.394964:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127016576:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1780997289.634947:0:91051:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffca7111cb0 20000000:00000080:0.0:1780997289.634966:0:91051:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff96899673b800 uarg=0000000000000000 00000040:00100000:0.0:1780997289.635783:0:91051:0:(llog.c:1067:llog_reverse_process()) index 57 : idx 49 20000000:01000000:0.0:1780997289.635793:0:91051:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:0.0:1780997289.635811:0:91051:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1780997289.636238:0:91052:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 55 marker 44 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1780997289.636530:0:91052:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 57 marker 44 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1780997289.636547:0:91052:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:0.0:1780997289.636777:0:91051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:0.0:1780997289.636791:0:91051:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1780997289.636807:0:91051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:0.0:1780997289.636823:0:91051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:0.0:1780997289.636836:0:91051:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1780997289.637134:0:91053:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 50 marker 45 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1780997289.637160:0:91053:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 52 marker 45 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1780997289.637171:0:91053:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:0.0:1780997289.637701:0:91051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:0.0:1780997289.637712:0:91051:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1780997289.637727:0:91051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:0.0:1780997289.637758:0:91051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:0.0:1780997289.637770:0:91051:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1780997289.639078:0:91054:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 50 marker 46 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:2.0:1780997289.639142:0:91054:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 52 marker 46 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1780997289.639157:0:91054:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:0.0:1780997289.639389:0:91051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:0.0:1780997289.639405:0:91051:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1780997289.639422:0:91051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:0.0:1780997289.639439:0:91051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:0.0:1780997289.639452:0:91051:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1780997289.639474:0:91051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639494:0:91051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b4ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b4a4 expref: 22 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639502:0:91051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968889ffd800/0x30fd811c0305b584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b57d expref: 22 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639513:0:91051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968889ffc600/0x30fd811c0305b5a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e5c expref: 8 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639521:0:91051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968889ffd600/0x30fd811c0305b5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e6a expref: 8 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639528:0:91051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689ba455800/0x30fd811c0305b5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b5ca expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639534:0:91051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968889ffc000/0x30fd811c0305b5ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b5e6 expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639551:0:91051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968889ffd400/0x30fd811c0305b617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b610 expref: 22 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639576:0:91051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bff03000/0x30fd811c0305b625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b61e expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639582:0:91051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b63a expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639589:0:91051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bff03c00/0x30fd811c0305b64f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b648 expref: 22 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639595:0:91051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b672 expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639603:0:91051:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639647:0:91051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b672 expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639663:0:91051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b679 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b672 expref: 22 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997289.639679:0:91051:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adedea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127016704:0@lo:104: 00000100:00100000:0.0:1780997289.639751:0:91051:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780997289.639808:0:91051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bff03c00/0x30fd811c0305b64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b648 expref: 22 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639818:0:91051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bff03c00/0x30fd811c0305b64f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b648 expref: 22 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997289.639833:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127016704 00000100:00100000:0.0:1780997289.639842:0:91051:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127016832:0@lo:104: 00000100:00100000:3.0:1780997289.639843:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127016704 00000100:00100000:0.0:1780997289.639872:0:91051:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780997289.639905:0:91051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b63a expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.639914:0:91051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b63a expref: 22 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997289.639923:0:91051:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba657b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127016960:0@lo:104: 00000100:00100000:0.0:1780997289.639962:0:91051:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997289.639972:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127016832 00000100:00100000:3.0:1780997289.639977:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127016832 00010000:00010000:0.0:1780997289.639987:0:91051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bff03000/0x30fd811c0305b625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b61e expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997289.639992:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127016960 00000100:00100000:3.0:1780997289.639996:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127016960 00010000:00010000:0.0:1780997289.639998:0:91051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bff03000/0x30fd811c0305b625 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b61e expref: 22 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997289.640010:0:91051:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017088:0@lo:104: 00000100:00100000:3.0:1780997289.640013:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1780997289.640035:0:91051:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780997289.640052:0:91051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968889ffd400/0x30fd811c0305b617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b610 expref: 22 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.640060:0:91051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968889ffd400/0x30fd811c0305b617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b610 expref: 22 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997289.640068:0:91051:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017216:0@lo:104: 00000100:00100000:3.0:1780997289.640086:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:91051:x1867507127016704:12345-0@lo:104: 00000100:00100000:0.0:1780997289.640093:0:91051:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1780997289.640100:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b679 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.640113:0:91051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968889ffc000/0x30fd811c0305b5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b5e6 expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.640134:0:91051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968889ffc000/0x30fd811c0305b5ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b5e6 expref: 22 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997289.640145:0:91051:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017344:0@lo:104: 00010000:00010000:3.0:1780997289.640159:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1780997289.640167:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:91051:x1867507127016704:12345-0@lo:104: Request processed in 85us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997289.640175:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00010000:0.0:1780997289.640180:0:91051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689ba455800/0x30fd811c0305b5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b5ca expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.640190:0:91051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689ba455800/0x30fd811c0305b5d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b5ca expref: 22 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997289.640200:0:6335:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1780997289.640200:0:91051:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017472:0@lo:104: 00000100:00100000:3.0:1780997289.640223:0:6335:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997289.640234:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127017088 00000100:00100000:0.0:1780997289.640238:0:91051:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997289.640240:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127017088 00000100:00100000:3.0:1780997289.640256:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127017216 00000100:00100000:3.0:1780997289.640259:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127017216 00010000:00010000:0.0:1780997289.640265:0:91051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968889ffd600/0x30fd811c0305b5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e6a expref: 8 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.640300:0:91051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968889ffd600/0x30fd811c0305b5b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e6a expref: 8 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997289.640310:0:91051:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017600:192.168.206.51@tcp:104: 00000100:00100000:2.0:1780997289.640385:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127017344 00000100:00100000:2.0:1780997289.640390:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127017344 00000100:00100000:2.0:1780997289.640408:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127017472 00000100:00100000:2.0:1780997289.640410:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127017472 00000100:00100000:2.0:1780997289.640424:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1780997289.640431:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:91051:x1867507127016832:12345-0@lo:104: 00010000:00010000:2.0:1780997289.640439:0:6334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b64f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.640484:0:6334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1780997289.640495:0:91051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968889ffc600/0x30fd811c0305b5a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e5c expref: 8 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.640505:0:91051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968889ffc600/0x30fd811c0305b5a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e5c expref: 8 pid: 90246 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997289.640515:0:91051:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017728:192.168.206.51@tcp:104: 00000100:00100000:2.0:1780997289.640525:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:91051:x1867507127016832:12345-0@lo:104: Request processed in 94us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997289.640532:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1780997289.640550:0:6334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00010000:00010000:0.0:1780997289.640557:0:91051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968889ffd800/0x30fd811c0305b584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b57d expref: 22 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997289.640559:0:6334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:91051:x1867507127016960:12345-0@lo:104: 00010000:00010000:2.0:1780997289.640567:0:6334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b641 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.640578:0:91051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968889ffd800/0x30fd811c0305b584 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b57d expref: 22 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997289.640589:0:91051:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017856:0@lo:104: 00010000:00010000:2.0:1780997289.640605:0:6334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1780997289.640612:0:6334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:91051:x1867507127016960:12345-0@lo:104: Request processed in 55us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997289.640621:0:91051:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997289.640622:0:6334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1780997289.640638:0:6334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127017856 00000100:00100000:2.0:1780997289.640641:0:6334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127017856 00010000:00010000:0.0:1780997289.640644:0:91051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b4a4 expref: 22 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.640655:0:91051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b4ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b4a4 expref: 22 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997289.640663:0:91051:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017984:0@lo:104: 00000100:00100000:0.0:1780997289.640681:0:91051:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997289.640691:0:91051:0:(client.c:2692:ptlrpc_set_wait()) set ffff968983699c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780997289.640711:0:91051:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adedea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127016704:0@lo:104: 00000100:00100000:0.0:1780997289.640720:0:91051:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127016832:0@lo:104: 00000100:00100000:0.0:1780997289.640727:0:91051:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba657b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127016960:0@lo:104: 00000100:00100000:1.0:1780997289.640887:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127017984 00000100:00100000:1.0:1780997289.640898:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127017984 00000100:00100000:1.0:1780997289.640922:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1780997289.640940:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:91051:x1867507127017088:12345-0@lo:104: 00010000:00010000:1.0:1780997289.640949:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b625 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.640991:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1780997289.640996:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:91051:x1867507127017088:12345-0@lo:104: Request processed in 69us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997289.641002:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1780997289.641016:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1780997289.641023:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888a067c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:91051:x1867507127017216:12345-0@lo:104: 00010000:00010000:1.0:1780997289.641030:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b617 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.641055:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1780997289.641060:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888a067c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+7:91051:x1867507127017216:12345-0@lo:104: Request processed in 39us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997289.641065:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1780997289.641094:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1780997289.641100:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:91051:x1867507127017344:12345-0@lo:104: 00010000:00010000:1.0:1780997289.641107:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b5ed expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.641132:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1780997289.641137:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:91051:x1867507127017344:12345-0@lo:104: Request processed in 38us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997289.641143:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1780997289.641163:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1780997289.641169:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:91051:x1867507127017472:12345-0@lo:104: 00010000:00010000:1.0:1780997289.641176:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b5d1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.641203:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1780997289.641207:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+5:91051:x1867507127017472:12345-0@lo:104: Request processed in 39us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997289.641213:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1780997289.641224:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1780997289.641230:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:91051:x1867507127017856:12345-0@lo:104: 00010000:00010000:1.0:1780997289.641236:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b584 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.641260:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1780997289.641265:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:91051:x1867507127017856:12345-0@lo:104: Request processed in 37us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997289.641359:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1780997289.641372:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1780997289.641378:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:91051:x1867507127017984:12345-0@lo:104: 00010000:00010000:1.0:1780997289.641385:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b4ab expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.641413:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1780997289.641418:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:91051:x1867507127017984:12345-0@lo:104: Request processed in 41us (737us total) trans 0 rc 0/0 00010000:00010000:3.0:1780997289.641425:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00000100:00100000:1.0:1780997289.641425:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00010000:00010000:3.0:1780997289.641433:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b679 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.641444:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02a00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997289.641448:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b679 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.641467:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b679 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997289.641475:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b679 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997289.641481:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997289.641511:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1780997289.641516:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b64f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.641523:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffda00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997289.641526:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b64f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.641533:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b64f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997289.641540:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b64f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997289.641545:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1780997289.641707:0:91051:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017088:0@lo:104: 00000100:00100000:0.0:1780997289.641716:0:91051:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017216:0@lo:104: 00000100:00100000:0.0:1780997289.641724:0:91051:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017344:0@lo:104: 00000100:00100000:0.0:1780997289.641732:0:91051:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017472:0@lo:104: 00000100:00100000:0.0:1780997289.641742:0:91051:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017856:0@lo:104: 00000100:00100000:0.0:1780997289.641750:0:91051:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017984:0@lo:104: 00010000:00010000:3.0:1780997289.644173:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b679 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.644188:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997289.644227:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b679 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.644236:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02a00/0x30fd811c0305b672 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b679 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.644252:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1780997289.644256:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b641 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.644262:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455400 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997289.644265:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b641 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.644288:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b641 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997289.644295:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b641 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997289.644315:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1780997289.644321:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997289.644343:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127018112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997289.644413:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997289.644583:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127018112 00000100:00100000:2.0:1780997289.644593:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127018112 00010000:00010000:2.0:1780997289.644629:0:8261:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b679 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b672 expref: 23 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997289.644669:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:2.0:1780997289.644678:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6797b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507127018112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997289.644691:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997289.644696:0:8261:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b679 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b672 expref: 23 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.644707:0:8261:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b672 expref: 23 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.644722:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba454e00/0x30fd811c0305b679 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b672 expref: 23 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.644843:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997289.644889:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6797b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3496:x1867507127018112:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997289.644896:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:0.0:1780997289.645043:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127018112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780997289.645182:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b64f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.645191:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1780997289.645232:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127018240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997289.645455:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997289.645520:0:6337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127018240 00000100:00100000:0.0:1780997289.645526:0:6337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127018240 00010000:00010000:0.0:1780997289.645553:0:6337:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bff03c00/0x30fd811c0305b64f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b648 expref: 22 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997289.645577:0:6337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:0.0:1780997289.645584:0:6337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3498:x1867507127018240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997289.645593:0:6337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997289.645597:0:6337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bff03c00/0x30fd811c0305b64f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b648 expref: 22 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.645608:0:6337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bff03c00/0x30fd811c0305b64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b648 expref: 22 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.645620:0:6337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03c00/0x30fd811c0305b64f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b648 expref: 22 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.645631:0:6337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780997289.645694:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b64f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.645701:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968889ffda00/0x30fd811c0305b648 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b64f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.645712:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1780997289.645716:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b625 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.645722:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455200 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997289.645725:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b625 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.645742:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b625 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997289.645748:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b625 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997289.645753:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997289.645768:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b625 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.645772:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997289.645996:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b641 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.646004:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997289.646137:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b641 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.646146:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305b63a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b641 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.646158:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780997289.646161:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b617 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.646166:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03400 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997289.646169:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b617 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.646175:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b617 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997289.646181:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b617 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997289.646187:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997289.646202:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b617 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.646208:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997289.646223:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b617 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.646230:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03400/0x30fd811c0305b610 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b617 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.646240:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780997289.646243:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b5ed expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.646248:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3600 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997289.646251:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b5ed expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.646257:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b5ed expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997289.646263:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b5ed expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997289.646458:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997289.646474:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b5ed expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.646480:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1780997289.648493:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127018752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997289.648564:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997289.648705:0:6337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3498:x1867507127018240:12345-0@lo:103:ldlm_bl.0 Request processed in 3119us (3247us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997289.648716:0:6337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:0.0:1780997289.648753:0:6337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127018752 00000100:00100000:0.0:1780997289.648760:0:6337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127018752 00010000:00010000:0.0:1780997289.648789:0:6337:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968889ffc000/0x30fd811c0305b5ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b5e6 expref: 21 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997289.648819:0:6337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:0.0:1780997289.648848:0:6337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3498:x1867507127018752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997289.648863:0:6337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997289.648868:0:6337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968889ffc000/0x30fd811c0305b5ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b5e6 expref: 21 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.648879:0:6337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968889ffc000/0x30fd811c0305b5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b5e6 expref: 21 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.648896:0:6337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffc000/0x30fd811c0305b5ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b5e6 expref: 21 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.648912:0:6337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997289.648955:0:6337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3498:x1867507127018752:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997289.648962:0:6337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1780997289.649043:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127018240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997289.649068:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127018752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997289.649078:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780997289.649084:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127018368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997289.649108:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997289.649446:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127018368 00000100:00100000:0.0:1780997289.649451:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127018368 00010000:00010000:0.0:1780997289.649469:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bff03000/0x30fd811c0305b625 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b61e expref: 20 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649574:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b625 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649585:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba455200/0x30fd811c0305b61e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b625 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649600:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780997289.649605:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b5d1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649611:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03200 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997289.649615:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b5d1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649623:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b5d1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997289.649630:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b5d1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997289.649643:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997289.649670:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b5d1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649677:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997289.649687:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b5d1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649694:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff03200/0x30fd811c0305b5ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b5d1 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649704:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780997289.649708:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b584 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649713:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02800 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997289.649716:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b584 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649722:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b584 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997289.649728:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b584 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997289.649733:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997289.649745:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b584 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649751:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997289.649763:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b584 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649769:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02800/0x30fd811c0305b57d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b584 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649777:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780997289.649780:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b4ab expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649786:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02200 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:1.0:1780997289.649788:0:6340:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b4ab expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649795:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b4ab expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780997289.649801:0:6340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b4ab expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997289.649806:0:6340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780997289.649819:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b4ab expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649825:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780997289.649830:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b4ab expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649835:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02200/0x30fd811c0305b4a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b4ab expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997289.649854:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997289.649855:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997289.649857:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997289.649941:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:0.0:1780997289.649949:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3498:x1867507127018368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997289.649962:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997289.649966:0:6336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bff03000/0x30fd811c0305b625 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b61e expref: 20 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.649974:0:6336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bff03000/0x30fd811c0305b625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b61e expref: 20 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.649985:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bff03000/0x30fd811c0305b625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b61e expref: 20 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.650000:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997289.650034:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3498:x1867507127018368:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997289.650041:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00010000:00010000:3.0:1780997289.650162:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b5ed expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.650171:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb3600/0x30fd811c0305b5e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b5ed expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.650185:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997289.650193:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997289.650195:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997289.650204:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997289.650211:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997289.650236:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127018880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997289.650480:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997289.650671:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127018368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997289.650736:0:91051:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017600:192.168.206.51@tcp:104: 00000100:00100000:1.0:1780997289.651829:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997289.670058:0:6337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127018880 00000100:00100000:2.0:1780997289.670073:0:6337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127018880 00010000:00010000:2.0:1780997289.670123:0:6337:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689ba455800/0x30fd811c0305b5d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b5ca expref: 19 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997289.670211:0:6337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110427136 00000100:00100000:2.0:1780997289.670215:0:6337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110427136 00010000:00010000:2.0:1780997289.670231:0:6337:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968889ffd600/0x30fd811c0305b5b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e6a expref: 9 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997289.672989:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:0.0:1780997289.673022:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3499:x1867507127018880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997289.673045:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997289.673057:0:6338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689ba455800/0x30fd811c0305b5d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b5ca expref: 19 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.673072:0:6338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689ba455800/0x30fd811c0305b5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b5ca expref: 19 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.673093:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455800/0x30fd811c0305b5d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b5ca expref: 19 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.673112:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997289.673204:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3499:x1867507127018880:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (22934us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997289.673213:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:0.0:1780997289.673236:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2598 00000100:00100000:0.0:1780997289.673244:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b620b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110427136:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780997289.673338:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997289.673345:0:6338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968889ffd600/0x30fd811c0305b5b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e6a expref: 9 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.673375:0:6338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968889ffd600/0x30fd811c0305b5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e6a expref: 9 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.673386:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffd600/0x30fd811c0305b5b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e6a expref: 9 pid: 90247 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.673395:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997289.673454:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b620b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:2394:x1867507110427136:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 211us (21628us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997289.673461:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2598 00000100:00100000:2.0:1780997289.676019:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127018624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997289.676081:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997289.676137:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127019136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997289.676159:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997289.676183:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1780997289.676190:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127018496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997289.676209:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997289.676236:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127019008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997289.676256:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997289.676422:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127018624 00000100:00100000:2.0:1780997289.676431:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127018624 00010000:00010000:2.0:1780997289.676466:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968889ffd400/0x30fd811c0305b617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b610 expref: 18 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997289.676489:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127019136 00000100:00100000:2.0:1780997289.676492:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127019136 00010000:00010000:2.0:1780997289.676502:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b4ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b4a4 expref: 19 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997289.676513:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127018496 00000100:00100000:2.0:1780997289.676516:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127018496 00010000:00010000:2.0:1780997289.676525:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b63a expref: 20 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997289.676535:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127019008 00000100:00100000:2.0:1780997289.676538:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127019008 00010000:00010000:2.0:1780997289.676547:0:25183:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968889ffd800/0x30fd811c0305b584 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b57d expref: 21 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997289.676560:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:2.0:1780997289.676568:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3497:x1867507127018624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997289.676580:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997289.676591:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968889ffd400/0x30fd811c0305b617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b610 expref: 21 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.676602:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968889ffd400/0x30fd811c0305b617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b610 expref: 21 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.676621:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffd400/0x30fd811c0305b617 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b610 expref: 21 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.676636:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997289.676673:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3497:x1867507127018624:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997289.676681:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:2.0:1780997289.676698:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:2.0:1780997289.676705:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:3497:x1867507127019136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997289.676713:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997289.676717:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b4ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b4a4 expref: 19 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.676725:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b4a4 expref: 19 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.676734:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bcbb2800/0x30fd811c0305b4ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b4a4 expref: 19 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.676743:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997289.676764:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3497:x1867507127019136:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997289.676770:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:2.0:1780997289.676780:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1780997289.676793:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:3497:x1867507127018496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997289.676801:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997289.676805:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b63a expref: 17 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.676813:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b63a expref: 17 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.676823:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffcc00/0x30fd811c0305b641 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b63a expref: 17 pid: 90250 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.676832:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997289.676922:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:3497:x1867507127018496:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997289.676939:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1780997289.676956:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1780997289.676962:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:3497:x1867507127019008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997289.676970:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997289.676974:0:25183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968889ffd800/0x30fd811c0305b584 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b57d expref: 15 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.676983:0:25183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968889ffd800/0x30fd811c0305b584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b57d expref: 15 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997289.677332:0:91051:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91051:1867507127017728:192.168.206.51@tcp:104: 00000100:00100000:3.0:1780997289.677799:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997289.677834:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127018880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997289.677855:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110427264 00000100:00100000:3.0:1780997289.677860:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110427264 00010000:00010000:3.0:1780997289.677879:0:6338:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968889ffc600/0x30fd811c0305b5a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e5c expref: 8 pid: 90246 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997289.677906:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2603 00000100:00100000:3.0:1780997289.677913:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:2395:x1867507110427264:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780997289.677922:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997289.677927:0:8261:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968889ffc600/0x30fd811c0305b5a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e5c expref: 8 pid: 90246 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.677948:0:8261:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968889ffc600/0x30fd811c0305b5a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e5c expref: 8 pid: 90246 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.677960:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffc600/0x30fd811c0305b5a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e5c expref: 8 pid: 90246 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.677972:0:8261:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.677981:0:8261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.678334:0:91051:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.678443:0:8261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.678452:0:8261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.678458:0:8261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.678465:0:8261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.678471:0:8261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031c00 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:3.0:1780997289.678475:0:8261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.678484:0:8261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.678677:0:91051:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997289.678685:0:91051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.678744:0:8261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.678753:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968980031c00/0x30fd811c0305b958 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997289.678765:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997289.678816:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:2395:x1867507110427264:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 903us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997289.678823:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2603 00010000:00010000:2.0:1780997289.679012:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffd800/0x30fd811c0305b584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b57d expref: 15 pid: 90245 timeout: 3917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997289.679030:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997289.679067:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:3497:x1867507127019008:12345-0@lo:103:ldlm_bl.0 Request processed in 2105us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997289.679082:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1780997289.679124:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127018496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997289.679133:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127019008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997289.679142:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127018624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997289.679149:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127019136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997289.703406:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997290.727967:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1780997291.238975:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1780997291.238985:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689a5877000 from 58 10000000:01000000:3.0:1780997291.238991:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780997291.239059:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997291.239076:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997291.239089:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997291.239128:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127019264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.239218:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.239322:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.239499:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127019264 00000100:00100000:1.0:1780997291.239513:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127019264 00000100:00100000:1.0:1780997291.239586:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1780997291.239597:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507127019264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997291.239622:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997291.239642:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c9600/0x30fd811c0305b966 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b95f expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.239669:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c9600/0x30fd811c0305b966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b95f expref: 15 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.239680:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c9600/0x30fd811c0305b966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b95f expref: 15 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.239690:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9600, rc 0) 00000100:00100000:1.0:1780997291.239744:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127019264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997291.239752:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1780997291.239985:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127019264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997291.240000:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b966 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997291.240009:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b966 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997291.240075:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127019392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.240106:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.240134:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997291.240187:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127019392 00000100:00100000:2.0:1780997291.240194:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127019392 00000100:00100000:2.0:1780997291.240237:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1780997291.240246:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127019392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.240700:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127019392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 454us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997291.240710:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1780997291.242805:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127019392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.242869:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127019520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.242955:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.243010:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997291.243122:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127019520 00000100:00100000:2.0:1780997291.243131:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127019520 00000100:00100000:2.0:1780997291.243234:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1780997291.243243:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127019520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.243380:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127019520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997291.243387:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1780997291.243466:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127019520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.244252:0:91056:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91056:1867507127019648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997291.244327:0:91056:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.251401:0:91056:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f480 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.252049:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127019648 00000100:00100000:1.0:1780997291.252060:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127019648 00000100:00100000:2.0:1780997291.252747:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1780997291.252766:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:91056:x1867507127019648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997291.252963:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:91056:x1867507127019648:12345-0@lo:502:llog_process_th.0 Request processed in 204us (8635us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997291.252978:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1780997291.253362:0:91056:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91056:1867507127019648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997291.253511:0:91056:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91056:1867507127019776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997291.253559:0:91056:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.255386:0:91056:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f480 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.256591:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127019776 00000100:00100000:0.0:1780997291.256604:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127019776 00000100:00100000:0.0:1780997291.256683:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1780997291.256694:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:91056:x1867507127019776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997291.256986:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:91056:x1867507127019776:12345-0@lo:502:llog_process_th.0 Request processed in 293us (3426us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.256994:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1780997291.257311:0:91056:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91056:1867507127019776:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780997291.257365:0:91056:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:0.0:1780997291.257765:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:0.0:1780997291.257798:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780997291.257910:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b966 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.257933:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b966 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997291.257943:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1780997291.257946:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:0.0:1780997291.257949:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1780997291.257986:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.258000:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.258011:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997291.258039:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127019904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997291.258088:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997291.259853:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968984a726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.260082:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127019904 00000100:00100000:1.0:1780997291.260091:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127019904 00000100:00100000:1.0:1780997291.260701:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1780997291.260711:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127019904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997291.260727:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997291.260744:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c8a00/0x30fd811c0305b974 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b96d expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.260771:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c8a00/0x30fd811c0305b974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b96d expref: 16 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.260782:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c8a00/0x30fd811c0305b974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b96d expref: 16 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.260791:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8a00, rc 0) 00000100:00100000:1.0:1780997291.260862:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127019904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (2773us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997291.260868:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1780997291.260951:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127019904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997291.260969:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b974 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997291.260978:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b974 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997291.261055:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127020032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.261091:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.261470:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f480 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.261602:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127020032 00000100:00100000:0.0:1780997291.261608:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127020032 00000100:00100000:0.0:1780997291.261649:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1780997291.261657:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127020032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997291.261772:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127020032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.261779:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1780997291.261882:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127020032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.261915:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127020160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.261968:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.261997:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f480 going to sleep for 11 seconds 00000100:00100000:3.0:1780997291.262011:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127020160 00000100:00100000:3.0:1780997291.262015:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127020160 00000100:00100000:3.0:1780997291.262034:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1780997291.262041:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127020160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.262139:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127020160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997291.262147:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1780997291.262186:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127020160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.262858:0:91057:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91057:1867507127020288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997291.262903:0:91057:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.262944:0:91057:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f840 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.262991:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127020288 00000100:00100000:0.0:1780997291.262996:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127020288 00000100:00100000:0.0:1780997291.263032:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1780997291.263040:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:91057:x1867507127020288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997291.263144:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:91057:x1867507127020288:12345-0@lo:502:llog_process_th.0 Request processed in 105us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.263151:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1780997291.263481:0:91057:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91057:1867507127020288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780997291.263508:0:91057:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997291.263520:0:91057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997291.263523:0:91057:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1780997291.263527:0:91057:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1780997291.263546:0:91057:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:0.0:1780997291.271643:0:91057:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6797b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91057:1867507127020416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997291.271731:0:91057:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997291.271917:0:91057:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b6214e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.272215:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127020416 00000100:00100000:1.0:1780997291.272223:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127020416 00000100:00100000:1.0:1780997291.272429:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1780997291.272440:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:91057:x1867507127020416:12345-0@lo:502:llog_process_th.0 00000020:01000004:3.0:1780997291.272574:0:91058:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9689a5877000 from lustre-MDT0000, refs=4 00000100:00100000:1.0:1780997291.272576:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:91057:x1867507127020416:12345-0@lo:502:llog_process_th.0 Request processed in 137us (843us total) trans 0 rc 0/0 00000020:01000004:3.0:1780997291.272581:0:91058:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9689a5877000 4 00000100:00100000:1.0:1780997291.272588:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1780997291.272788:0:91057:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6797b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91057:1867507127020416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780997291.272817:0:91057:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997291.272824:0:91057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997291.272826:0:91057:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1780997291.272830:0:91057:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:0.0:1780997291.272949:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:0.0:1780997291.272974:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1780997291.272984:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b974 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.272994:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b974 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997291.273003:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780997291.273005:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968886f5e000 from 58 10000000:01000000:0.0:1780997291.273008:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780997291.273034:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.273042:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.273051:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997291.273077:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6797b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127020544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997291.273169:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997291.273198:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b6214cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.273482:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127020544 00000100:00100000:1.0:1780997291.273488:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127020544 00000100:00100000:1.0:1780997291.273526:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1780997291.273534:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127020544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997291.273545:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997291.273563:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c9800/0x30fd811c0305b982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b97b expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.273585:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c9800/0x30fd811c0305b982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b97b expref: 17 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.273595:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c9800/0x30fd811c0305b982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b97b expref: 17 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.273603:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9800, rc 0) 00000100:00100000:1.0:1780997291.273636:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127020544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997291.273643:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1780997291.274055:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6797b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127020544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997291.274070:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b982 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.274078:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b982 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997291.274303:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6797b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127020672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997291.274336:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997291.274362:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b6214cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.274481:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127020672 00000100:00100000:1.0:1780997291.274486:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127020672 00000100:00100000:1.0:1780997291.274513:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1780997291.274522:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127020672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997291.274650:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127020672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997291.274658:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1780997291.274687:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6797b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127020672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.274721:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127020800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.274767:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997291.274870:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a1840 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.274984:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127020800 00000100:00100000:1.0:1780997291.274989:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127020800 00000100:00100000:1.0:1780997291.275058:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1780997291.275066:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127020800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997291.275158:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127020800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997291.275165:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1780997291.275241:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127020800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.275650:0:91059:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91059:1867507127020928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997291.275686:0:91059:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997291.275714:0:91059:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a1840 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.275765:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127020928 00000100:00100000:1.0:1780997291.275776:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127020928 00000100:00100000:1.0:1780997291.275813:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1780997291.275820:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:91059:x1867507127020928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997291.275913:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:91059:x1867507127020928:12345-0@lo:502:llog_process_th.0 Request processed in 93us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997291.275939:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1780997291.276082:0:91059:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91059:1867507127020928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997291.276121:0:91059:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91059:1867507127021056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997291.276154:0:91059:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997291.276175:0:91059:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a1840 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.276353:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127021056 00000100:00100000:1.0:1780997291.276358:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127021056 00000100:00100000:1.0:1780997291.276382:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1780997291.276389:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:91059:x1867507127021056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997291.276529:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:91059:x1867507127021056:12345-0@lo:502:llog_process_th.0 Request processed in 139us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997291.276536:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1780997291.276650:0:91059:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91059:1867507127021056:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1780997291.276671:0:91059:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:1.0:1780997291.277112:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1780997291.277137:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780997291.277148:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b982 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.277161:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b982 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997291.277172:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1780997291.277175:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:1.0:1780997291.277178:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1780997291.277215:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.277223:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.277240:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997291.277374:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127021184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997291.277409:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997291.277558:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.278928:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127021184 00000100:00100000:0.0:1780997291.278938:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127021184 00000100:00100000:0.0:1780997291.278992:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1780997291.279002:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127021184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997291.279018:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997291.279036:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff968980031a00/0x30fd811c0305b990 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b989 expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.279060:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff968980031a00/0x30fd811c0305b990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b989 expref: 18 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.279071:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff968980031a00/0x30fd811c0305b990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b989 expref: 18 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.279101:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968980031a00, rc 0) 00000100:00100000:0.0:1780997291.279178:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127021184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.279185:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1780997291.279739:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127021184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997291.279758:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b990 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.279768:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b990 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997291.279843:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127021312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997291.279879:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997291.279927:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.279982:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127021312 00000100:00100000:0.0:1780997291.279988:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127021312 00000100:00100000:0.0:1780997291.280026:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1780997291.280033:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127021312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997291.280171:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127021312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.280179:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1780997291.280378:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127021312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997291.280411:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127021440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997291.280464:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997291.280488:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.280588:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127021440 00000100:00100000:0.0:1780997291.280593:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127021440 00000100:00100000:0.0:1780997291.280623:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1780997291.280630:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127021440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997291.280716:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127021440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.280723:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1780997291.280896:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127021440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.281771:0:91060:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91060:1867507127021568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997291.281821:0:91060:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.281857:0:91060:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.281930:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127021568 00000100:00100000:0.0:1780997291.281936:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127021568 00000100:00100000:0.0:1780997291.281975:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1780997291.281985:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:91060:x1867507127021568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997291.282104:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:91060:x1867507127021568:12345-0@lo:502:llog_process_th.0 Request processed in 118us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.282111:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1780997291.282377:0:91060:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91060:1867507127021568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780997291.282401:0:91060:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997291.282423:0:91060:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997291.282433:0:91060:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1780997291.282439:0:91060:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1780997291.282459:0:91060:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:3.0:1780997291.282481:0:91060:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91060:1867507127021696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997291.282515:0:91060:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.282545:0:91060:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1780997291.282642:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127021696 00000100:00100000:2.0:1780997291.282647:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127021696 00000100:00100000:2.0:1780997291.282681:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1780997291.282696:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:91060:x1867507127021696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997291.282769:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:91060:x1867507127021696:12345-0@lo:502:llog_process_th.0 Request processed in 74us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997291.282776:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1780997291.283010:0:91060:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91060:1867507127021696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780997291.283031:0:91060:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780997291.283036:0:91060:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780997291.283038:0:91060:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1780997291.283042:0:91060:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:1.0:1780997291.283308:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:1.0:1780997291.283335:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1780997291.283346:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b990 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.283364:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b990 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997291.283375:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780997291.283377:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689bfa99000 from 58 10000000:01000000:1.0:1780997291.283381:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780997291.283406:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.283414:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.283516:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997291.283535:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127021824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997291.283584:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997291.283603:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.283903:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127021824 00000100:00100000:0.0:1780997291.283909:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127021824 00000100:00100000:0.0:1780997291.283953:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1780997291.283960:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127021824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997291.283970:0:90245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997291.283982:0:90245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bb4efe00/0x30fd811c0305b99e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b997 expref: -99 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.284004:0:90245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bb4efe00/0x30fd811c0305b99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b997 expref: 19 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.284014:0:90245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bb4efe00/0x30fd811c0305b99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b997 expref: 19 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.284024:0:90245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4efe00, rc 0) 00000100:00100000:0.0:1780997291.284056:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127021824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.284062:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1780997291.284602:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127021824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997291.284618:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b99e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.284627:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b99e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997291.284689:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127021952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997291.284721:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997291.284755:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.284946:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127021952 00000100:00100000:0.0:1780997291.284952:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127021952 00000100:00100000:0.0:1780997291.284984:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1780997291.284993:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127021952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997291.285111:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127021952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.285125:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1780997291.285261:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127021952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997291.285319:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127022080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997291.285357:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997291.285372:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993e40 going to sleep for 11 seconds 00000100:00100000:3.0:1780997291.285450:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127022080 00000100:00100000:3.0:1780997291.285455:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127022080 00000100:00100000:3.0:1780997291.285480:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1780997291.285488:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127022080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.285575:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127022080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997291.285581:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1780997291.285708:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127022080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997291.286295:0:91061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91061:1867507127022208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997291.286342:0:91061:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997291.286378:0:91061:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b6304840 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.286436:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127022208 00000100:00100000:1.0:1780997291.286441:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127022208 00000100:00100000:1.0:1780997291.286468:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1780997291.286476:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:91061:x1867507127022208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997291.286574:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:91061:x1867507127022208:12345-0@lo:502:llog_process_th.0 Request processed in 98us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997291.286585:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1780997291.286770:0:91061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91061:1867507127022208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997291.286815:0:91061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91061:1867507127022336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997291.286849:0:91061:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997291.286877:0:91061:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688883183c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.287257:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127022336 00000100:00100000:1.0:1780997291.287262:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127022336 00000100:00100000:1.0:1780997291.287325:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1780997291.287333:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:91061:x1867507127022336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997291.287413:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:91061:x1867507127022336:12345-0@lo:502:llog_process_th.0 Request processed in 80us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.287524:0:91061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91061:1867507127022336:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1780997291.287546:0:91061:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000100:00100000:1.0:1780997291.287687:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000020:01000000:1.0:1780997291.287724:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1780997291.287749:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780997291.287758:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b99e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.287770:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b99e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997291.287788:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1780997291.287791:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1780997291.287793:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1780997291.287818:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.287825:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.287834:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997291.287847:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127022464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780997291.287877:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997291.288432:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993780 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.290201:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127022464 00000100:00100000:0.0:1780997291.290215:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127022464 00000100:00100000:0.0:1780997291.290563:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1780997291.290573:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127022464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997291.290589:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997291.290607:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305b9ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b9a5 expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.290635:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305b9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b9a5 expref: 20 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.290645:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305b9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b9a5 expref: 20 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.290654:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4eec00, rc 0) 00000100:00100000:0.0:1780997291.290739:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127022464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (2859us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.290759:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1780997291.290852:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127022464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997291.290872:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9ac expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997291.290892:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b9ac expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997291.290992:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127022592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.291030:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997291.291068:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1780997291.291258:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127022592 00000100:00100000:3.0:1780997291.291265:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127022592 00000100:00100000:2.0:1780997291.291528:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1780997291.291535:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127022592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.291660:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127022592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997291.291667:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1780997291.291791:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127022592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.291826:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127022720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.291873:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997291.291982:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127022720 00000100:00100000:0.0:1780997291.291987:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127022720 00000100:00100000:0.0:1780997291.292013:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1780997291.292020:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127022720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.292203:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a4a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.292635:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127022720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 614us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.292642:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1780997291.292715:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127022720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997291.296701:0:91062:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1780997291.296899:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1780997291.296935:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1780997291.296948:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9ac expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997291.296960:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9ac expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997291.296969:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780997291.296972:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968990f90000 from 58 10000000:01000000:2.0:1780997291.296975:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780997291.297017:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997291.297025:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997291.297035:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997291.297060:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127022848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.297202:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997291.297491:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986958900 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.297599:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127022848 00000100:00100000:0.0:1780997291.297609:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127022848 00000100:00100000:0.0:1780997291.297699:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1780997291.297709:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127022848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997291.297724:0:90246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997291.297738:0:90246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bb4ee800/0x30fd811c0305b9ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b9b3 expref: -99 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.297762:0:90246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bb4ee800/0x30fd811c0305b9ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b9b3 expref: 21 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.297771:0:90246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bb4ee800/0x30fd811c0305b9ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b9b3 expref: 21 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.297780:0:90246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ee800, rc 0) 00000100:00100000:0.0:1780997291.297829:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127022848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.297836:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1780997291.297931:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127022848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997291.297946:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9ba expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997291.297956:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b9ba expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997291.298039:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127022976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.298067:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997291.298148:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986958900 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.298508:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127022976 00000100:00100000:1.0:1780997291.298514:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127022976 00000100:00100000:1.0:1780997291.298550:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1780997291.298558:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127022976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997291.298681:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127022976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997291.298688:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1780997291.298793:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127022976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.298825:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127023104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.298869:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997291.298888:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986958900 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.301211:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127023104 00000100:00100000:1.0:1780997291.301226:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127023104 00000100:00100000:1.0:1780997291.301982:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1780997291.301995:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127023104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997291.302174:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127023104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (3304us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997291.302188:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1780997291.302267:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127023104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997291.304935:0:91063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91063:1867507127023232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997291.305016:0:91063:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997291.305064:0:91063:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318780 going to sleep for 11 seconds 00000100:00100000:1.0:1780997291.305177:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127023232 00000100:00100000:1.0:1780997291.305183:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127023232 00000100:00100000:1.0:1780997291.305227:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1780997291.305236:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:91063:x1867507127023232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997291.305387:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:91063:x1867507127023232:12345-0@lo:502:llog_process_th.0 Request processed in 152us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997291.305396:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1780997291.306215:0:91063:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6796d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91063:1867507127023232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997291.306299:0:91063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91063:1867507127023360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997291.306343:0:91063:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.311488:0:91063:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f600 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.311721:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127023360 00000100:00100000:0.0:1780997291.311731:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127023360 00000100:00100000:0.0:1780997291.311782:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1780997291.311791:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:91063:x1867507127023360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997291.311951:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:91063:x1867507127023360:12345-0@lo:502:llog_process_th.0 Request processed in 161us (5607us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.311958:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1780997291.312325:0:91063:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91063:1867507127023360:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780997291.312363:0:91063:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1780997291.312876:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1780997291.312911:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780997291.312932:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9ba expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997291.312943:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9ba expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997291.312953:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1780997291.312956:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1780997291.312959:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1780997291.312997:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997291.313005:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997291.313016:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997291.313055:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127023488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.313103:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997291.313137:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986958900 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.313214:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127023488 00000100:00100000:0.0:1780997291.313221:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127023488 00000100:00100000:0.0:1780997291.313259:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1780997291.313267:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127023488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997291.313300:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997291.313314:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bb4ef800/0x30fd811c0305b9c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b9c1 expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.313337:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bb4ef800/0x30fd811c0305b9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b9c1 expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.313348:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bb4ef800/0x30fd811c0305b9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b9c1 expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.313356:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ef800, rc 0) 00000100:00100000:0.0:1780997291.313396:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127023488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.313403:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1780997291.315048:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127023488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997291.315072:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9c8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997291.315084:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b9c8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997291.315185:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127023616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.315240:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.315302:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f600 going to sleep for 11 seconds 00000100:00100000:2.0:1780997291.315413:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127023616 00000100:00100000:2.0:1780997291.315428:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127023616 00000100:00100000:2.0:1780997291.315473:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1780997291.315483:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127023616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.315639:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127023616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997291.315647:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1780997291.315868:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127023616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.315899:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127023744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.315955:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.315977:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f600 going to sleep for 11 seconds 00000100:00100000:2.0:1780997291.316140:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127023744 00000100:00100000:2.0:1780997291.316145:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127023744 00000100:00100000:2.0:1780997291.316208:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1780997291.316216:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127023744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.316329:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127023744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997291.316335:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1780997291.316407:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127023744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780997291.321665:0:91064:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1780997291.322196:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1780997291.322223:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1780997291.322235:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9c8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997291.322260:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9c8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997291.322288:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1780997291.322291:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9689b6283380 from 1 10000000:01000000:3.0:1780997291.322295:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1780997291.322338:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997291.322346:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997291.322357:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997291.322406:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127023872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.322630:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.322677:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f480 going to sleep for 11 seconds 00000100:00100000:0.0:1780997291.322830:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127023872 00000100:00100000:0.0:1780997291.322839:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127023872 00000100:00100000:0.0:1780997291.322891:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1780997291.322901:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127023872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997291.322915:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997291.322939:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bb4ef000/0x30fd811c0305b9d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b9cf expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.322962:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bb4ef000/0x30fd811c0305b9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b9cf expref: 23 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.322972:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bb4ef000/0x30fd811c0305b9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b9cf expref: 23 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997291.322981:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ef000, rc 0) 00000100:00100000:0.0:1780997291.323021:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507127023872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.323029:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1780997291.323103:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127023872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997291.323116:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9d6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997291.323125:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b9d6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997291.323179:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127024000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.323205:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997291.323264:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47f480 going to sleep for 11 seconds 00000100:00100000:3.0:1780997291.323298:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127024000 00000100:00100000:3.0:1780997291.323302:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127024000 00000100:00100000:3.0:1780997291.323323:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1780997291.323329:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507127024000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997291.323406:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507127024000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (200us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780997291.323414:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1780997291.324591:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127024000:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1780997291.324627:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1780997291.324638:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9d6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997291.324666:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9d6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997291.589359:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997291.590102:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110427392 00000100:00100000:2.0:1780997291.590113:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110427392 00000100:00100000:2.0:1780997291.590177:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:2.0:1780997291.590188:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70253:x1867507110427392:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997291.590206:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997291.590224:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689c2054e00/0x30fd811c0305b9dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8eb7 expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997291.590299:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689c2054e00/0x30fd811c0305b9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eb7 expref: 8 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997291.590311:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689c2054e00/0x30fd811c0305b9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eb7 expref: 8 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997291.590320:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689c2054e00, rc 0) 00000100:00100000:2.0:1780997291.590383:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110427392:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 198us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997291.590391:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:1.0:1780997291.593590:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997291.593784:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110427520 00000100:00100000:0.0:1780997291.593799:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110427520 00000100:00100000:0.0:1780997291.593870:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:0.0:1780997291.593891:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110427520:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997291.594074:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110427520:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 195us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.594083:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:3.0:1780997291.595944:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997291.596022:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110427648 00000100:00100000:2.0:1780997291.596032:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110427648 00000100:00100000:2.0:1780997291.596127:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:2.0:1780997291.596136:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110427648:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.596265:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110427648:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 130us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997291.596297:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:3.0:1780997291.602222:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997291.615141:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110427776 00000100:00100000:0.0:1780997291.615160:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110427776 00000100:00100000:0.0:1780997291.615231:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:0.0:1780997291.615241:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:72603:x1867507110427776:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1780997291.615421:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:72603:x1867507110427776:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 180us (13216us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997291.615429:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:1.0:1780997291.625562:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997291.626014:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110427904 00000100:00100000:2.0:1780997291.626026:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110427904 00000100:00100000:2.0:1780997291.626092:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:2.0:1780997291.626104:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:72603:x1867507110427904:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1780997291.626311:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:72603:x1867507110427904:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 165us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997291.626322:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:3.0:1780997291.630539:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997291.630711:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110428032 00000100:00100000:1.0:1780997291.630722:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110428032 00000100:00100000:1.0:1780997291.630780:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:1.0:1780997291.630793:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110428032:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997291.630812:0:90246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997291.630829:0:90246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c9c00/0x30fd811c0305b9e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ebe expref: -99 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.630871:0:90246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c9c00/0x30fd811c0305b9e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ebe expref: 9 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.630890:0:90246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c9c00/0x30fd811c0305b9e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ebe expref: 9 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997291.630899:0:90246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9c00, rc 0) 00000100:00100000:1.0:1780997291.630986:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110428032:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 196us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997291.630993:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:3.0:1780997291.636152:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997291.636356:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110428160 00000100:00100000:2.0:1780997291.636382:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110428160 00000100:00100000:2.0:1780997291.636451:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:2.0:1780997291.636461:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110428160:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997291.636617:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110428160:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 157us (476us total) trans 0 rc -2/-2 00000100:00100000:2.0:1780997291.636626:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00010000:00010000:2.0:1780997291.757749:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997292.775452:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997292.965530:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127024128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997292.965609:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997292.965767:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997292.965776:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127024256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997292.965801:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997292.965868:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127024128 00000100:00100000:2.0:1780997292.965875:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127024128 00000100:00100000:2.0:1780997292.965930:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127024256 00000100:00100000:2.0:1780997292.965934:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127024256 00000100:00100000:2.0:1780997292.965958:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4117 00000100:00100000:2.0:1780997292.965967:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127024128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780997292.966001:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:2.0:1780997292.966047:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127024128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997292.966060:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4117 00000100:00100000:2.0:1780997292.966076:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4118 00000100:00100000:2.0:1780997292.966083:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127024256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780997292.966098:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:2.0:1780997292.966123:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127024256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997292.966128:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4118 00000100:00100000:0.0:1780997292.966209:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127024256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997292.966223:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127024128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997292.966406:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507127024768:0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.966437:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997292.966457:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507127025280:0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.966475:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997292.966491:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1780997292.966496:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507127024640:0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.966517:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997292.966532:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127025152:0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.966553:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997292.966569:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507127025664:0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.966593:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997292.966619:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127024768 00000100:00100000:3.0:1780997292.966623:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127024768 00000100:00100000:3.0:1780997292.966661:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127025280 00000100:00100000:3.0:1780997292.966664:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127025280 00000100:00100000:3.0:1780997292.966683:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127024640 00000100:00100000:3.0:1780997292.966685:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127024640 00000100:00100000:3.0:1780997292.966697:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127025664 00000100:00100000:3.0:1780997292.966712:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127025664 00000100:00100000:3.0:1780997292.966727:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1780997292.966734:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507127024768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.966771:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507127024768:12345-0@lo:400:kworker.0 Request processed in 38us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997292.966778:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1780997292.966790:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1780997292.966797:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507127025280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.966823:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507127025280:12345-0@lo:400:kworker.0 Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997292.966829:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1780997292.966839:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1780997292.966845:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507127024640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.966870:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507127024640:12345-0@lo:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997292.966875:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1780997292.966885:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1780997292.966891:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507127025664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.966924:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507127025664:12345-0@lo:400:kworker.0 Request processed in 34us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997292.966930:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1780997292.966955:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127025152 00000100:00100000:3.0:1780997292.966958:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127025152 00000100:00100000:3.0:1780997292.966987:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00100000:3.0:1780997292.966993:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127025152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.967021:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127025152:12345-0@lo:400:kworker.0 Request processed in 29us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997292.967033:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00080000:3.0:1780997292.967053:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997292.967057:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997292.967059:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780997292.967086:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507127024640:0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.967102:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127025152:0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.967112:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507127025664:0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.967119:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507127024768:0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.967127:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507127025280:0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.967234:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127024384:0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.967293:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997292.967322:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507127024896:0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.967344:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997292.967362:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127025408:0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.967384:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997292.967403:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1780997292.967408:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507127024512:0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.967429:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997292.967444:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127025024:0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.967473:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997292.967491:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127025536:0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.967510:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997292.967536:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127025408 00000100:00100000:0.0:1780997292.967540:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127025408 00000100:00100000:0.0:1780997292.967571:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127025024 00000100:00100000:0.0:1780997292.967573:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127025024 00000100:00100000:0.0:1780997292.967743:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127025536 00000100:00100000:0.0:1780997292.967746:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127025536 00000100:00100000:0.0:1780997292.967768:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693 00000100:00100000:0.0:1780997292.967775:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127025408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.967811:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127025408:12345-0@lo:400:kworker.0 Request processed in 37us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997292.967817:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693 00000100:00100000:0.0:1780997292.967832:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:0.0:1780997292.967838:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127025024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.967863:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127025024:12345-0@lo:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997292.967869:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00100000:0.0:1780997292.967879:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:0.0:1780997292.967885:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127025536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.967920:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127025536:12345-0@lo:400:kworker.0 Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997292.967926:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00000100:00100000:0.0:1780997292.967974:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127024896 00000100:00100000:0.0:1780997292.967977:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127024896 00000100:00100000:0.0:1780997292.968000:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127024512 00000100:00100000:0.0:1780997292.968010:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127024512 00000100:00100000:0.0:1780997292.968033:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:0.0:1780997292.968039:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507127024896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.968068:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507127024896:12345-0@lo:400:kworker.0 Request processed in 29us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997292.968073:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:0.0:1780997292.968083:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1780997292.968089:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507127024512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.968112:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507127024512:12345-0@lo:400:kworker.0 Request processed in 23us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997292.968117:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00080000:0.0:1780997292.968135:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780997292.968138:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780997292.968141:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997292.968142:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780997292.968166:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507127024512:0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.968175:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127025024:0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.968184:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127025536:0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.968193:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507127024896:0@lo:400:kworker.0 00000100:00100000:0.0:1780997292.968202:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127025408:0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.971798:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127024384 00000100:00100000:3.0:1780997292.971812:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127024384 00000100:00100000:3.0:1780997292.971882:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1780997292.971893:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507127024384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997292.971986:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507127024384:12345-0@lo:400:kworker.0 Request processed in 95us (4715us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997292.971993:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1780997292.972120:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127024384:0@lo:400:kworker.0 00000020:00000080:3.0:1780997293.431870:0:91162:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff9b5d9d60 20000000:00000080:3.0:1780997293.431886:0:91162:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9689ba827c00 uarg=0000000000000000 00000040:00100000:3.0:1780997293.434353:0:91162:0:(llog.c:1067:llog_reverse_process()) index 60 : idx 49 20000000:01000000:3.0:1780997293.434362:0:91162:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:3.0:1780997293.434376:0:91162:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:3.0:1780997293.435663:0:91163:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 52 marker 41 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:3.0:1780997293.435714:0:91163:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 54 marker 41 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:3.0:1780997293.435735:0:91163:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:1.0:1780997293.435944:0:91162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:1.0:1780997293.435960:0:91162:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:1.0:1780997293.435991:0:91162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:1.0:1780997293.436011:0:91162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:1.0:1780997293.436026:0:91162:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:3.0:1780997293.438389:0:91164:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 46 marker 42 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:3.0:1780997293.438630:0:91164:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 49 marker 42 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:3.0:1780997293.438647:0:91164:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:1.0:1780997293.439037:0:91162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:1.0:1780997293.439054:0:91162:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:1.0:1780997293.439071:0:91162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:1.0:1780997293.439088:0:91162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:1.0:1780997293.439103:0:91162:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:3.0:1780997293.440027:0:91165:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 46 marker 43 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:3.0:1780997293.440070:0:91165:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 49 marker 43 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:3.0:1780997293.440087:0:91165:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:1.0:1780997293.440219:0:91162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:1.0:1780997293.440230:0:91162:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:1.0:1780997293.440246:0:91162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:1.0:1780997293.440262:0:91162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:1.0:1780997293.440299:0:91162:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1780997293.440319:0:91162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440337:0:91162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689a56c9600/0x30fd811c0305b966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b95f expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440345:0:91162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689a56c8a00/0x30fd811c0305b974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b96d expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440352:0:91162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689a56c9800/0x30fd811c0305b982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b97b expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440374:0:91162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff968980031a00/0x30fd811c0305b990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b989 expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440382:0:91162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bb4efe00/0x30fd811c0305b99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b997 expref: 22 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440389:0:91162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305b9ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b9a5 expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440395:0:91162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bb4ee800/0x30fd811c0305b9ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b9b3 expref: 22 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440402:0:91162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bb4ef800/0x30fd811c0305b9c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b9c1 expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440409:0:91162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689bb4ef000/0x30fd811c0305b9d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b9cf expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440419:0:91162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689c2054e00/0x30fd811c0305b9dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eb7 expref: 8 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440425:0:91162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689a56c9c00/0x30fd811c0305b9e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ebe expref: 8 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440433:0:91162:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440476:0:91162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689a56c9c00/0x30fd811c0305b9e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ebe expref: 8 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440591:0:91162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689a56c9c00/0x30fd811c0305b9e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ebe expref: 8 pid: 90246 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997293.440608:0:91162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127025792:192.168.206.51@tcp:104: 00010000:00010000:1.0:1780997293.440747:0:91162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689c2054e00/0x30fd811c0305b9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eb7 expref: 8 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440756:0:91162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689c2054e00/0x30fd811c0305b9dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eb7 expref: 8 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997293.440764:0:91162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127025920:192.168.206.51@tcp:104: 00010000:00010000:1.0:1780997293.440794:0:91162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bb4ef000/0x30fd811c0305b9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b9cf expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440802:0:91162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bb4ef000/0x30fd811c0305b9d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b9cf expref: 22 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997293.440810:0:91162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986957b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026048:0@lo:104: 00000100:00100000:1.0:1780997293.440846:0:91162:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780997293.440884:0:91162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bb4ef800/0x30fd811c0305b9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b9c1 expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440893:0:91162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bb4ef800/0x30fd811c0305b9c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b9c1 expref: 22 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997293.440901:0:91162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba657b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026176:0@lo:104: 00000100:00100000:1.0:1780997293.440933:0:91162:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780997293.440988:0:91162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bb4ee800/0x30fd811c0305b9ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b9b3 expref: 22 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.440996:0:91162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bb4ee800/0x30fd811c0305b9ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b9b3 expref: 22 pid: 90246 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997293.441005:0:91162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb524700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026304:0@lo:104: 00000100:00100000:1.0:1780997293.441029:0:91162:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780997293.441054:0:91162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305b9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b9a5 expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.441062:0:91162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305b9ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b9a5 expref: 22 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997293.441070:0:91162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026432:0@lo:104: 00010000:00010000:1.0:1780997293.441091:0:91162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689bb4efe00/0x30fd811c0305b99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b997 expref: 22 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.441097:0:91162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689bb4efe00/0x30fd811c0305b99e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b997 expref: 22 pid: 90245 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997293.441104:0:91162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026560:0@lo:104: 00010000:00010000:1.0:1780997293.441125:0:91162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff968980031a00/0x30fd811c0305b990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b989 expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.441133:0:91162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff968980031a00/0x30fd811c0305b990 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b989 expref: 22 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997293.441140:0:91162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026688:0@lo:104: 00010000:00010000:1.0:1780997293.441160:0:91162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689a56c9800/0x30fd811c0305b982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b97b expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.441176:0:91162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689a56c9800/0x30fd811c0305b982 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b97b expref: 22 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997293.441184:0:91162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026816:0@lo:104: 00010000:00010000:1.0:1780997293.441210:0:91162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689a56c8a00/0x30fd811c0305b974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b96d expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.441218:0:91162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689a56c8a00/0x30fd811c0305b974 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b96d expref: 22 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997293.441225:0:91162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026944:0@lo:104: 00010000:00010000:1.0:1780997293.441245:0:91162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689a56c9600/0x30fd811c0305b966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b95f expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.441253:0:91162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689a56c9600/0x30fd811c0305b966 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b95f expref: 22 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997293.441260:0:91162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127027072:0@lo:104: 00000100:00100000:1.0:1780997293.441311:0:91162:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997293.441619:0:9303:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1780997293.441639:0:9303:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997293.441654:0:9303:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997293.441662:0:9303:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997293.441680:0:9303:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997293.441688:0:9303:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997293.441696:0:9303:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997293.441703:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127026048 00000100:00100000:0.0:1780997293.441709:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127026048 00000100:00100000:0.0:1780997293.441741:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127026176 00000100:00100000:0.0:1780997293.441743:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127026176 00000100:00100000:0.0:1780997293.441752:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127026304 00000100:00100000:0.0:1780997293.441754:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127026304 00000100:00100000:0.0:1780997293.441761:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127026432 00000100:00100000:0.0:1780997293.441763:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127026432 00000100:00100000:0.0:1780997293.441772:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127026560 00000100:00100000:0.0:1780997293.441774:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127026560 00000100:00100000:0.0:1780997293.441783:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127026688 00000100:00100000:0.0:1780997293.441785:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127026688 00000100:00100000:0.0:1780997293.441793:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127026816 00000100:00100000:0.0:1780997293.441795:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127026816 00000100:00100000:0.0:1780997293.441805:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127026944 00000100:00100000:0.0:1780997293.441807:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127026944 00000100:00100000:0.0:1780997293.441815:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127027072 00000100:00100000:0.0:1780997293.441817:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127027072 00000100:00100000:0.0:1780997293.441829:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1780997293.441838:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:91162:x1867507127026048:12345-0@lo:104: 00010000:00010000:0.0:1780997293.441851:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b9d6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.441927:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1780997293.441933:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+11:91162:x1867507127026048:12345-0@lo:104: Request processed in 96us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997293.441940:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1780997293.441958:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1780997293.441979:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:91162:x1867507127026176:12345-0@lo:104: 00010000:00010000:0.0:1780997293.442002:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b9c8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.442037:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1780997293.442042:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+10:91162:x1867507127026176:12345-0@lo:104: Request processed in 79us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997293.442049:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1780997293.442063:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1780997293.442069:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba827050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:91162:x1867507127026304:12345-0@lo:104: 00010000:00010000:0.0:1780997293.442075:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b9ba expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.442107:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1780997293.442112:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba827050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+9:91162:x1867507127026304:12345-0@lo:104: Request processed in 44us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997293.442117:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1780997293.442150:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1780997293.442156:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:91162:x1867507127026432:12345-0@lo:104: 00000100:00100000:3.0:1780997293.442160:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00010000:00010000:0.0:1780997293.442163:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b9ac expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997293.442169:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:91162:x1867507127026560:12345-0@lo:104: 00010000:00010000:3.0:1780997293.442175:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b99e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.442194:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1780997293.442199:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:91162:x1867507127026432:12345-0@lo:104: Request processed in 44us (559us total) trans 0 rc 0/0 00010000:00010000:3.0:1780997293.442202:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1780997293.442205:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1780997293.442206:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+8:91162:x1867507127026560:12345-0@lo:104: Request processed in 40us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997293.442211:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1780997293.442216:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1780997293.442221:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1780997293.442222:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:91162:x1867507127026688:12345-0@lo:104: 00000100:00100000:3.0:1780997293.442226:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:91162:x1867507127026816:12345-0@lo:104: 00010000:00010000:3.0:1780997293.442233:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b982 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.442234:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b990 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.442258:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00010000:00010000:0.0:1780997293.442258:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1780997293.442263:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:91162:x1867507127026816:12345-0@lo:104: Request processed in 36us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997293.442263:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+6:91162:x1867507127026688:12345-0@lo:104: Request processed in 42us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997293.442293:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1780997293.442600:0:91162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986957b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026048:0@lo:104: 00000100:00100000:1.0:1780997293.442611:0:91162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba657b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026176:0@lo:104: 00000100:00100000:1.0:1780997293.442619:0:91162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb524700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026304:0@lo:104: 00000100:00100000:1.0:1780997293.442624:0:91162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026432:0@lo:104: 00000100:00100000:1.0:1780997293.442631:0:91162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026560:0@lo:104: 00000100:00100000:1.0:1780997293.442638:0:91162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026688:0@lo:104: 00000100:00100000:1.0:1780997293.442645:0:91162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026816:0@lo:104: 00000100:00100000:3.0:1780997293.446187:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1780997293.446237:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1780997293.446256:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:91162:x1867507127026944:12345-0@lo:104: 00010000:00010000:3.0:1780997293.446299:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b974 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.446616:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1780997293.446624:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:91162:x1867507127026944:12345-0@lo:104: Request processed in 378us (4933us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997293.446631:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1780997293.446646:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1780997293.446654:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:91162:x1867507127027072:12345-0@lo:104: 00010000:00010000:3.0:1780997293.446663:0:6335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b966 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.446694:0:6335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1780997293.446698:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:91162:x1867507127027072:12345-0@lo:104: Request processed in 46us (5002us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997293.446704:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00010000:00010000:3.0:1780997293.446732:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1780997293.446738:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b9d6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.446746:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0600 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997293.446751:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b9d6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.446760:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b9d6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997293.446768:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b9d6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997293.446774:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997293.446826:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b9d6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.446833:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997293.446859:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b9d6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.446867:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0600/0x30fd811c0305b9cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b9d6 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.446881:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780997293.446884:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b9c8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.446890:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054a00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997293.446893:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b9c8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.446899:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b9c8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997293.446906:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b9c8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997293.446924:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997293.446938:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b9c8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.446944:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997293.446962:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b9c8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.446978:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689c2054a00/0x30fd811c0305b9c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b9c8 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.446988:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1780997293.447105:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b9ba expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447114:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054400 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997293.447117:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b9ba expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447125:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b9ba expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997293.447131:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b9ba expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997293.447137:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997293.447155:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b9ba expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447161:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997293.447167:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b9ba expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447174:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689c2054400/0x30fd811c0305b9b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b9ba expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447184:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1780997293.447193:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b9ac expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447200:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9e00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997293.447203:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b9ac expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447210:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b9ac expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997293.447216:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b9ac expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997293.447221:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997293.447237:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b9ac expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447243:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997293.447250:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b9ac expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447256:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689a56c9e00/0x30fd811c0305b9a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b9ac expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447546:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780997293.447552:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b99e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447559:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8c00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997293.447561:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b99e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447580:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b99e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997293.447586:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b99e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997293.447591:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997293.447607:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b99e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447613:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997293.447619:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b99e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447625:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689a56c8c00/0x30fd811c0305b997 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b99e expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447636:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780997293.447639:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b990 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447644:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9000 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997293.447646:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b990 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447652:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b990 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997293.447657:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b990 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997293.447667:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997293.447679:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b990 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447684:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997293.447688:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b990 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447694:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689a56c9000/0x30fd811c0305b989 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b990 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447702:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780997293.447706:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b982 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447711:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031c00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997293.447714:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b982 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447720:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b982 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997293.447726:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b982 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997293.447731:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997293.447743:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b982 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447748:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997293.447760:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b982 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447767:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968980031c00/0x30fd811c0305b97b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b982 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447780:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780997293.447783:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b974 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447788:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980030000 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997293.447790:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b974 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447796:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b974 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997293.447802:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b974 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997293.447807:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997293.447819:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b974 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447824:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997293.447829:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b974 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447834:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968980030000/0x30fd811c0305b96d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b974 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447843:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997293.447851:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b966 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447856:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0c00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997293.447859:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b966 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447866:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b966 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997293.447871:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b966 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997293.447876:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780997293.447889:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b966 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447895:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997293.447899:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b966 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447905:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bc4c0c00/0x30fd811c0305b95f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b966 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.447934:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997293.447935:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997293.447937:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997293.447970:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127027200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997293.448476:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997293.448532:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127027712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997293.448575:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997293.448593:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127028224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997293.448611:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997293.448630:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1780997293.448636:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127027584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997293.448652:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997293.448666:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127028096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997293.448683:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997293.448713:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127027328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997293.448734:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997293.448750:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127027840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997293.448768:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997293.448778:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1780997293.448783:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127027456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997293.448800:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997293.448808:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127027968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997293.448825:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997293.448851:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127027200 00000100:00100000:3.0:1780997293.448858:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127027200 00010000:00010000:3.0:1780997293.448888:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bb4ef000/0x30fd811c0305b9d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b9cf expref: 23 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997293.448921:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127027712 00000100:00100000:3.0:1780997293.448924:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127027712 00010000:00010000:3.0:1780997293.448935:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bb4efe00/0x30fd811c0305b99e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b997 expref: 24 pid: 90245 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997293.448959:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127028224 00000100:00100000:3.0:1780997293.448962:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127028224 00010000:00010000:3.0:1780997293.448973:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689a56c9600/0x30fd811c0305b966 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b95f expref: 25 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997293.448981:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127027584 00000100:00100000:3.0:1780997293.448984:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127027584 00000100:00100000:2.0:1780997293.449187:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127028096 00000100:00100000:2.0:1780997293.449192:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127028096 00010000:00010000:2.0:1780997293.449208:0:8261:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689a56c8a00/0x30fd811c0305b974 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b96d expref: 27 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997293.449235:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127027328 00000100:00100000:2.0:1780997293.449238:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127027328 00010000:00010000:2.0:1780997293.449248:0:8261:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bb4ef800/0x30fd811c0305b9c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b9c1 expref: 28 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997293.449257:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127027840 00000100:00100000:2.0:1780997293.449259:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127027840 00010000:00010000:2.0:1780997293.449267:0:8261:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff968980031a00/0x30fd811c0305b990 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b989 expref: 29 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997293.449292:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127027456 00000100:00100000:2.0:1780997293.449295:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127027456 00010000:00010000:2.0:1780997293.449305:0:8261:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bb4ee800/0x30fd811c0305b9ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b9b3 expref: 30 pid: 90246 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997293.449315:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127027968 00000100:00100000:2.0:1780997293.449317:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127027968 00010000:00010000:2.0:1780997293.449327:0:8261:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689a56c9800/0x30fd811c0305b982 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b97b expref: 31 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997293.449340:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1780997293.449348:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+31:3499:x1867507127027200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997293.449362:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997293.449367:0:8261:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bb4ef000/0x30fd811c0305b9d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b9cf expref: 31 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997293.449383:0:8261:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bb4ef000/0x30fd811c0305b9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b9cf expref: 31 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997293.449399:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bb4ef000/0x30fd811c0305b9d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b9cf expref: 31 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997293.449422:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997293.449488:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305b9ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b9a5 expref: 30 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997293.449505:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:3.0:1780997293.449513:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b620b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+30:3499:x1867507127027712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997293.449522:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997293.449525:0:6336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bb4efe00/0x30fd811c0305b99e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b997 expref: 30 pid: 90245 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.449533:0:6336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bb4efe00/0x30fd811c0305b99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b997 expref: 30 pid: 90245 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.449541:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bb4efe00/0x30fd811c0305b99e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b997 expref: 30 pid: 90245 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997293.449544:0:91162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127026944:0@lo:104: 00010000:00010000:3.0:1780997293.449550:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780997293.449553:0:91162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127027072:0@lo:104: 00000100:00100000:2.0:1780997293.449824:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+29:3499:x1867507127027200:12345-0@lo:103:ldlm_bl.0 Request processed in 476us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997293.449832:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1780997293.449851:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00000100:00100000:3.0:1780997293.449852:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b620b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+28:3499:x1867507127027712:12345-0@lo:103:ldlm_bl.0 Request processed in 341us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997293.449858:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+28:3499:x1867507127028224:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997293.449859:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00010000:00010000:2.0:1780997293.449866:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997293.449869:0:8261:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689a56c9600/0x30fd811c0305b966 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b95f expref: 27 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997293.449878:0:8261:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689a56c9600/0x30fd811c0305b966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b95f expref: 27 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997293.449887:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c9600/0x30fd811c0305b966 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b95f expref: 27 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997293.449892:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00010000:00010000:2.0:1780997293.449897:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997293.449898:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+26:3499:x1867507127028096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997293.449925:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997293.449930:0:6336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689a56c8a00/0x30fd811c0305b974 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b96d expref: 26 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997293.449931:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+26:3499:x1867507127028224:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997293.449937:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00010000:00010000:3.0:1780997293.449939:0:6336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689a56c8a00/0x30fd811c0305b974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b96d expref: 26 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.449948:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c8a00/0x30fd811c0305b974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b96d expref: 25 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997293.449949:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:2.0:1780997293.449954:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+24:3496:x1867507127027328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997293.449958:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997293.449961:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997293.449976:0:8261:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bb4ef800/0x30fd811c0305b9c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b9c1 expref: 24 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997293.449979:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+24:3499:x1867507127028096:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (1295us total) trans 0 rc 0/0 00010000:00010000:2.0:1780997293.449984:0:8261:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bb4ef800/0x30fd811c0305b9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b9c1 expref: 24 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997293.449985:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00010000:00010000:2.0:1780997293.449999:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bb4ef800/0x30fd811c0305b9c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b9c1 expref: 23 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997293.450008:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997293.450014:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:3.0:1780997293.450020:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3496:x1867507127027840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997293.450028:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997293.450031:0:6336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff968980031a00/0x30fd811c0305b990 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b989 expref: 22 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997293.450039:0:6336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff968980031a00/0x30fd811c0305b990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b989 expref: 22 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997293.450046:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3496:x1867507127027328:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1311us total) trans 0 rc 0/0 00010000:00010000:3.0:1780997293.450049:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968980031a00/0x30fd811c0305b990 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b989 expref: 22 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997293.450052:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00010000:00010000:3.0:1780997293.450059:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997293.450064:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:2.0:1780997293.450070:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3496:x1867507127027456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997293.450077:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1780997293.450079:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3496:x1867507127027840:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (1310us total) trans 0 rc 0/0 00010000:00010000:2.0:1780997293.450081:0:8261:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bb4ee800/0x30fd811c0305b9ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b9b3 expref: 20 pid: 90246 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997293.450089:0:8261:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bb4ee800/0x30fd811c0305b9ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b9b3 expref: 20 pid: 90246 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997293.450093:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00010000:00010000:2.0:1780997293.450098:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bb4ee800/0x30fd811c0305b9ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b9b3 expref: 20 pid: 90246 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997293.450104:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00010000:00010000:2.0:1780997293.450106:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997293.450109:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b620ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3496:x1867507127027968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997293.450116:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997293.450120:0:6336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689a56c9800/0x30fd811c0305b982 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b97b expref: 18 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997293.450124:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:3496:x1867507127027456:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (1323us total) trans 0 rc 0/0 00010000:00010000:3.0:1780997293.450128:0:6336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689a56c9800/0x30fd811c0305b982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b97b expref: 18 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997293.450129:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00010000:00010000:3.0:1780997293.450137:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c9800/0x30fd811c0305b982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b97b expref: 17 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997293.450140:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:2.0:1780997293.450145:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:3499:x1867507127027584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997293.450146:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997293.450151:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997293.450155:0:8261:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305b9ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b9a5 expref: 16 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997293.450164:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b620ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:3496:x1867507127027968:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (1338us total) trans 0 rc 0/0 00010000:00010000:2.0:1780997293.450168:0:8261:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305b9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b9a5 expref: 16 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997293.450170:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00010000:00010000:2.0:1780997293.450177:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689bb4eec00/0x30fd811c0305b9ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b9a5 expref: 15 pid: 90247 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997293.450185:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997293.450206:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:3499:x1867507127027584:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997293.450209:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127027584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997293.450212:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:3.0:1780997293.450217:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127028096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997293.450224:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127027200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997293.450231:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127027712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997293.450238:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127028224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997293.451006:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127027456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997293.451019:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127027968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997293.451026:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127027328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780997293.451033:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127027840:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997293.451367:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997293.451374:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997293.451518:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997293.456591:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997293.456678:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997293.457130:0:91162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127025792:192.168.206.51@tcp:104: 00000100:00100000:1.0:1780997293.457143:0:91162:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91162:1867507127025920:192.168.206.51@tcp:104: 00010000:00010000:1.0:1780997293.457192:0:91162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997293.457321:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110428288 00000100:00100000:0.0:1780997293.457330:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110428288 00010000:00010000:0.0:1780997293.457367:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689a56c9c00/0x30fd811c0305b9e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ebe expref: 9 pid: 90246 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997293.457397:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110428416 00000100:00100000:0.0:1780997293.457400:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110428416 00010000:00010000:0.0:1780997293.457412:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689c2054e00/0x30fd811c0305b9dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eb7 expref: 10 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997293.457443:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2613 00000100:00100000:0.0:1780997293.457452:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf5d474c-5b3a-4e23-b534-5ea64925b132+10:2394:x1867507110428288:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780997293.457467:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997293.457472:0:6336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9689a56c9c00/0x30fd811c0305b9e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ebe expref: 10 pid: 90246 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457483:0:6336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689a56c9c00/0x30fd811c0305b9e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ebe expref: 10 pid: 90246 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457501:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c9c00/0x30fd811c0305b9e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ebe expref: 10 pid: 90246 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457531:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997293.457580:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110428288:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 129us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997293.457588:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2613 00000100:00100000:0.0:1780997293.457606:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2614 00000100:00100000:0.0:1780997293.457612:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:2394:x1867507110428416:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780997293.457621:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997293.457625:0:6336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9689c2054e00/0x30fd811c0305b9dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eb7 expref: 8 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457634:0:6336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689c2054e00/0x30fd811c0305b9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eb7 expref: 8 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457643:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689c2054e00/0x30fd811c0305b9dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eb7 expref: 8 pid: 90250 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457654:0:6336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457662:0:6336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457676:0:6336:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457682:0:6336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457698:0:6336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457704:0:6336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457711:0:6336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997293.457714:0:6336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457723:0:6336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457734:0:6336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997293.457743:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997293.457764:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:2394:x1867507110428416:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 153us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997293.457772:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2614 00010000:00010000:1.0:1780997293.457842:0:91162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.457850:0:91162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997293.457856:0:91162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c9200/0x30fd811c0305b9eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997293.478682:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127028480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997293.478755:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997293.478802:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127028352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997293.478824:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997293.478923:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127028480 00000100:00100000:0.0:1780997293.478931:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127028480 00000100:00100000:0.0:1780997293.479000:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127028352 00000100:00100000:0.0:1780997293.479004:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127028352 00000100:00100000:0.0:1780997293.479027:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:0.0:1780997293.479036:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127028480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780997293.479067:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997293.479146:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:3.0:1780997293.479158:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127028352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780997293.479177:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997293.489390:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127028480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10342us (10621us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997293.489427:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00100000:3.0:1780997293.489708:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127028352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10552us (10880us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997293.489716:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:1.0:1780997293.491192:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127028480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997293.491215:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127028352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1780997293.797626:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997293.830680:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997293.830785:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997293.830825:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997293.830869:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997293.830959:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997293.831926:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110429056 00000100:00100000:0.0:1780997293.831939:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110429056 00000100:00100000:0.0:1780997293.832002:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110428928 00000100:00100000:0.0:1780997293.832006:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110428928 00000100:00100000:0.0:1780997293.832036:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2696 00000100:00100000:2.0:1780997293.832037:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110428800 00000100:00100000:2.0:1780997293.832044:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110428800 00000100:00100000:0.0:1780997293.832050:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2397:x1867507110429056:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997293.832085:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110428672 00000100:00100000:2.0:1780997293.832090:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110428672 00000100:00100000:2.0:1780997293.832119:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1415 00000100:00100000:2.0:1780997293.832128:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2397:x1867507110428800:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997293.832138:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2397:x1867507110429056:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 90us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997293.832147:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2696 00000100:00100000:2.0:1780997293.832166:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2397:x1867507110428800:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 37us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997293.832169:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2697 00000100:00100000:2.0:1780997293.832184:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1415 00000100:00100000:0.0:1780997293.832185:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2396:x1867507110428928:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997293.832205:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1416 00000100:00100000:0.0:1780997293.832219:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2396:x1867507110428928:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 39us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997293.832229:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2697 00000100:00100000:2.0:1780997293.832234:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2396:x1867507110428672:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:0.0:1780997293.832250:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780997293.832255:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780997293.832258:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780997293.832260:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997293.832286:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2396:x1867507110428672:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 38us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997293.832294:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1416 00000100:00100000:3.0:1780997293.833371:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110428544 00000100:00100000:3.0:1780997293.833380:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110428544 00000100:00100000:3.0:1780997293.833432:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:3.0:1780997293.833440:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:2397:x1867507110428544:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997293.833496:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:2397:x1867507110428544:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 56us (2828us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997293.833502:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:2.0:1780997294.501938:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997294.501961:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127028608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997294.502029:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997294.502136:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127028608 00000100:00100000:0.0:1780997294.502144:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127028608 00000100:00100000:0.0:1780997294.502209:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168 00000100:00100000:0.0:1780997294.502219:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127028608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997294.502241:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780997294.502306:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127028608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997294.502328:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168 00000100:00080000:2.0:1780997294.502391:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997294.502430:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127028608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780997294.508499:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127028736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780997294.508572:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997294.508664:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127028736 00000100:00100000:1.0:1780997294.508672:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127028736 00000100:00100000:1.0:1780997294.508724:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169 00000100:00100000:1.0:1780997294.508733:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127028736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997294.508752:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997294.508795:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127028736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997294.508801:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169 00000100:00080000:3.0:1780997294.508852:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997294.508883:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127028736:0@lo:13:osp-pre-1-1.0 10000000:01000000:3.0:1780997294.565449:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1780997294.565459:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689a5877000 from 61 10000000:01000000:3.0:1780997294.565465:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780997294.565519:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1600/0x30fd811c0305b9f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.565530:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1600/0x30fd811c0305b9f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.565558:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1600/0x30fd811c0305b9f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997294.565585:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127028864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780997294.565656:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997294.565709:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898a58ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.565773:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127028864 00000100:00100000:2.0:1780997294.565782:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127028864 00000100:00100000:2.0:1780997294.565839:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1780997294.565847:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+14:6348:x1867507127028864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997294.565860:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997294.565875:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba454200/0x30fd811c0305b9f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305b9f2 expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.565898:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454200/0x30fd811c0305b9f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305b9f2 expref: 15 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.565919:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba454200/0x30fd811c0305b9f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b9f2 expref: 15 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.565928:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454200, rc 0) 00000100:00100000:2.0:1780997294.565973:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127028864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.565980:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1780997294.566171:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127028864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997294.566186:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1600/0x30fd811c0305b9f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9f9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.566195:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1600/0x30fd811c0305b9f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b9f9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997294.566257:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127028992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997294.566378:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997294.566402:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898a58ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.566483:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127028992 00000100:00100000:2.0:1780997294.566487:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127028992 00000100:00100000:2.0:1780997294.566515:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1780997294.566521:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127028992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.566622:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127028992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.566628:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1780997294.566721:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127028992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997294.566748:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127029120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997294.566782:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997294.566800:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96898a58ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.566839:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127029120 00000100:00100000:2.0:1780997294.566843:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127029120 00000100:00100000:2.0:1780997294.566867:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1780997294.566873:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127029120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.566959:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127029120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.566966:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1780997294.567041:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127029120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997294.567539:0:91166:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91166:1867507127029248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997294.567575:0:91166:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997294.567605:0:91166:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688887566c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997294.567664:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127029248 00000100:00100000:1.0:1780997294.567668:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127029248 00000100:00100000:1.0:1780997294.567698:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1780997294.567704:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a67c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:91166:x1867507127029248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997294.567795:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a67c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:91166:x1867507127029248:12345-0@lo:502:llog_process_th.0 Request processed in 91us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997294.567802:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1780997294.567899:0:91166:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91166:1867507127029248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997294.567943:0:91166:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91166:1867507127029376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997294.567969:0:91166:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997294.567992:0:91166:0:(client.c:2692:ptlrpc_set_wait()) set ffff9688887566c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997294.568035:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127029376 00000100:00100000:0.0:1780997294.568039:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127029376 00000100:00100000:0.0:1780997294.568071:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1780997294.568077:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:91166:x1867507127029376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997294.568145:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:91166:x1867507127029376:12345-0@lo:502:llog_process_th.0 Request processed in 67us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997294.568151:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1780997294.568217:0:91166:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91166:1867507127029376:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780997294.568233:0:91166:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1780997294.568446:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1780997294.568469:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780997294.568478:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1600/0x30fd811c0305b9f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9f9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.568488:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1600/0x30fd811c0305b9f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b9f9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997294.568497:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1780997294.568499:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:0.0:1780997294.568502:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1780997294.568523:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef400/0x30fd811c0305ba00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.568532:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef400/0x30fd811c0305ba00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.568541:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef400/0x30fd811c0305ba00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997294.568553:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127029504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.568583:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997294.568610:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997294.568865:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127029504 00000100:00100000:3.0:1780997294.568869:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127029504 00000100:00100000:3.0:1780997294.568908:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1780997294.568915:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a67c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+15:6348:x1867507127029504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997294.568923:0:90245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997294.568934:0:90245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c0c00/0x30fd811c0305ba07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ba00 expref: -99 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.568954:0:90245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c0c00/0x30fd811c0305ba07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ba00 expref: 16 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.568963:0:90245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c0c00/0x30fd811c0305ba07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba00 expref: 16 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.568972:0:90245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0c00, rc 0) 00000100:00100000:3.0:1780997294.568997:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a67c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127029504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997294.569003:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1780997294.569077:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127029504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997294.569088:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef400/0x30fd811c0305ba00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba07 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.569096:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef400/0x30fd811c0305ba00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba07 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997294.569140:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127029632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.569164:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997294.569182:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72900 going to sleep for 11 seconds 00000100:00100000:1.0:1780997294.569357:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127029632 00000100:00100000:1.0:1780997294.569361:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127029632 00000100:00100000:1.0:1780997294.569386:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1780997294.569393:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a67c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127029632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997294.569479:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a67c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127029632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997294.569485:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1780997294.569549:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127029632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.569576:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127029760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.569608:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997294.569633:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997294.569709:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127029760 00000100:00100000:3.0:1780997294.569712:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127029760 00000100:00100000:3.0:1780997294.569731:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1780997294.569737:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127029760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997294.569801:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127029760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997294.569807:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1780997294.569883:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127029760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997294.570373:0:91167:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91167:1867507127029888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997294.570412:0:91167:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997294.570429:0:91167:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640300 going to sleep for 11 seconds 00000100:00100000:3.0:1780997294.570572:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127029888 00000100:00100000:3.0:1780997294.570577:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127029888 00000100:00100000:3.0:1780997294.570596:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1780997294.570601:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d2cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:91167:x1867507127029888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997294.570675:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d2cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:91167:x1867507127029888:12345-0@lo:502:llog_process_th.0 Request processed in 73us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997294.570682:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1780997294.570775:0:91167:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91167:1867507127029888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780997294.570797:0:91167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780997294.570810:0:91167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780997294.570812:0:91167:0:(obd_config.c:1561:class_process_config()) marker 49 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:1.0:1780997294.570818:0:91167:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1780997294.571715:0:91167:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91167:1867507127030016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997294.571761:0:91167:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997294.571841:0:91167:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640f00 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.578533:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127030016 00000100:00100000:2.0:1780997294.578549:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127030016 00000100:00100000:2.0:1780997294.578608:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1780997294.578617:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:91167:x1867507127030016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997294.578788:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:91167:x1867507127030016:12345-0@lo:502:llog_process_th.0 Request processed in 172us (7025us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.578796:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1780997294.578938:0:91167:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91167:1867507127030016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780997294.578970:0:91167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780997294.578977:0:91167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997294.578979:0:91167:0:(obd_config.c:1561:class_process_config()) marker 49 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:3.0:1780997294.578983:0:91167:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:0.0:1780997294.579194:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:0.0:1780997294.579220:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1780997294.579230:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef400/0x30fd811c0305ba00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba07 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.579241:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef400/0x30fd811c0305ba00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba07 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997294.579252:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780997294.579261:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968886f5e000 from 61 10000000:01000000:0.0:1780997294.579264:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780997294.579398:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee400/0x30fd811c0305ba0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.579407:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee400/0x30fd811c0305ba0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.579415:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee400/0x30fd811c0305ba0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997294.579433:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127030144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.579467:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997294.579495:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bbc72900 going to sleep for 11 seconds 00000100:00100000:3.0:1780997294.579553:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127030144 00000100:00100000:3.0:1780997294.579557:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127030144 00000100:00100000:3.0:1780997294.579587:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1780997294.579593:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+16:6348:x1867507127030144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997294.579603:0:90245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997294.579614:0:90245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c0600/0x30fd811c0305ba15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ba0e expref: -99 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.579635:0:90245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c0600/0x30fd811c0305ba15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ba0e expref: 17 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.579645:0:90245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c0600/0x30fd811c0305ba15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba0e expref: 17 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.579660:0:90245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0600, rc 0) 00000100:00100000:3.0:1780997294.579698:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127030144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997294.579704:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1780997294.579765:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127030144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997294.579777:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee400/0x30fd811c0305ba0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba15 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997294.579786:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee400/0x30fd811c0305ba0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba15 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997294.579833:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127030272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997294.579854:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997294.579868:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a6409c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997294.579913:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127030272 00000100:00100000:0.0:1780997294.579916:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127030272 00000100:00100000:0.0:1780997294.579942:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1780997294.579948:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127030272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.580040:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127030272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997294.580047:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1780997294.580166:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127030272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997294.580191:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127030400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997294.580222:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997294.580240:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986925180 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.580380:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127030400 00000100:00100000:2.0:1780997294.580384:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127030400 00000100:00100000:2.0:1780997294.580406:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1780997294.580412:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127030400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.580482:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127030400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.580494:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1780997294.580559:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127030400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997294.583928:0:91168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91168:1867507127030528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997294.584003:0:91168:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997294.584045:0:91168:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640d80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997294.584099:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127030528 00000100:00100000:0.0:1780997294.584105:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127030528 00000100:00100000:0.0:1780997294.584143:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1780997294.584151:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:91168:x1867507127030528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997294.584295:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:91168:x1867507127030528:12345-0@lo:502:llog_process_th.0 Request processed in 144us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997294.584303:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1780997294.584454:0:91168:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91168:1867507127030528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997294.584500:0:91168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91168:1867507127030656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997294.584530:0:91168:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997294.584550:0:91168:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.586171:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127030656 00000100:00100000:2.0:1780997294.586182:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127030656 00000100:00100000:2.0:1780997294.586240:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1780997294.586249:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:91168:x1867507127030656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997294.586406:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:91168:x1867507127030656:12345-0@lo:502:llog_process_th.0 Request processed in 158us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.586414:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1780997294.586574:0:91168:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91168:1867507127030656:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1780997294.586605:0:91168:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1780997294.588580:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1780997294.588617:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780997294.588629:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee400/0x30fd811c0305ba0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba15 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.588641:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee400/0x30fd811c0305ba0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba15 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997294.588651:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1780997294.588654:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:2.0:1780997294.588657:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1780997294.588691:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305ba1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.588698:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305ba1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.588708:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305ba1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997294.588733:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127030784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.588801:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997294.588846:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b6304840 going to sleep for 11 seconds 00000100:00100000:0.0:1780997294.588926:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127030784 00000100:00100000:0.0:1780997294.588933:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127030784 00000100:00100000:0.0:1780997294.588976:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1780997294.588984:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+17:6348:x1867507127030784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997294.588998:0:90246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997294.589009:0:90246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bb4efa00/0x30fd811c0305ba23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ba1c expref: -99 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.589034:0:90246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bb4efa00/0x30fd811c0305ba23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ba1c expref: 18 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.589044:0:90246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bb4efa00/0x30fd811c0305ba23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba1c expref: 18 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.589053:0:90246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4efa00, rc 0) 00000100:00100000:0.0:1780997294.589107:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127030784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997294.589113:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1780997294.589198:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127030784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997294.589212:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305ba1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba23 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997294.589220:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305ba1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba23 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997294.589306:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127030912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997294.589331:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997294.589342:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640d80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997294.589443:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127030912 00000100:00100000:0.0:1780997294.589447:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127030912 00000100:00100000:0.0:1780997294.589475:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1780997294.589481:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127030912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.589575:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127030912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997294.589581:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1780997294.589751:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127030912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997294.589776:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127031040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780997294.589811:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997294.589835:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640d80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997294.589875:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127031040 00000100:00100000:0.0:1780997294.589879:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127031040 00000100:00100000:0.0:1780997294.589911:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1780997294.589917:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127031040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.589999:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127031040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997294.590005:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1780997294.590085:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127031040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.592538:0:91169:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91169:1867507127031168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997294.592610:0:91169:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997294.592653:0:91169:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb5600 going to sleep for 11 seconds 00000100:00100000:0.0:1780997294.592705:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127031168 00000100:00100000:0.0:1780997294.592712:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127031168 00000100:00100000:0.0:1780997294.592746:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1780997294.592752:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:91169:x1867507127031168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997294.592865:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:91169:x1867507127031168:12345-0@lo:502:llog_process_th.0 Request processed in 112us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997294.592872:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1780997294.594566:0:91169:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91169:1867507127031168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780997294.594606:0:91169:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780997294.594619:0:91169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997294.594621:0:91169:0:(obd_config.c:1561:class_process_config()) marker 50 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:2.0:1780997294.594625:0:91169:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1780997294.594762:0:91169:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91169:1867507127031296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997294.594816:0:91169:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997294.594842:0:91169:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bccb56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997294.594930:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127031296 00000100:00100000:0.0:1780997294.594936:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127031296 00000100:00100000:0.0:1780997294.594976:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1780997294.594983:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:91169:x1867507127031296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997294.595087:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:91169:x1867507127031296:12345-0@lo:502:llog_process_th.0 Request processed in 103us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997294.595093:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1780997294.595460:0:91169:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91169:1867507127031296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780997294.595479:0:91169:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780997294.595483:0:91169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780997294.595485:0:91169:0:(obd_config.c:1561:class_process_config()) marker 50 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:2.0:1780997294.595488:0:91169:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:0.0:1780997294.595947:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:0.0:1780997294.595971:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1780997294.595981:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305ba1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba23 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.595994:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305ba1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba23 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997294.596004:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780997294.596006:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9689bfa99000 from 61 10000000:01000000:0.0:1780997294.596018:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780997294.596046:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4efc00/0x30fd811c0305ba2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.596054:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bb4efc00/0x30fd811c0305ba2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.596074:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bb4efc00/0x30fd811c0305ba2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997294.596089:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127031424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.596126:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997294.596159:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318900 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.596507:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127031424 00000100:00100000:2.0:1780997294.596513:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127031424 00000100:00100000:2.0:1780997294.596552:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1780997294.596559:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+18:6348:x1867507127031424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997294.596569:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997294.596581:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba455200/0x30fd811c0305ba31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ba2a expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.596611:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba455200/0x30fd811c0305ba31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ba2a expref: 19 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.596621:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba455200/0x30fd811c0305ba31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba2a expref: 19 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.596630:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba455200, rc 0) 00000100:00100000:2.0:1780997294.596671:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127031424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.596677:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1780997294.596838:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127031424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997294.596850:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bb4efc00/0x30fd811c0305ba2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba31 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.596859:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bb4efc00/0x30fd811c0305ba2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba31 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997294.596923:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127031552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.596948:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997294.597002:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968888318900 going to sleep for 11 seconds 00000100:00100000:1.0:1780997294.602507:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127031552 00000100:00100000:1.0:1780997294.602524:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127031552 00000100:00100000:1.0:1780997294.602571:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1780997294.602580:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127031552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997294.602751:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127031552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (5801us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997294.602770:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1780997294.602862:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127031552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997294.602924:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127031680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997294.602966:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997294.603001:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986925cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997294.603067:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127031680 00000100:00100000:0.0:1780997294.603071:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127031680 00000100:00100000:0.0:1780997294.603100:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1780997294.603106:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127031680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.603179:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127031680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997294.603194:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1780997294.603311:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127031680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780997294.603800:0:91170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91170:1867507127031808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997294.603836:0:91170:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997294.603864:0:91170:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986925600 going to sleep for 11 seconds 00000100:00100000:0.0:1780997294.603916:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127031808 00000100:00100000:0.0:1780997294.603920:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127031808 00000100:00100000:0.0:1780997294.603948:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1780997294.603954:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:91170:x1867507127031808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780997294.604026:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:91170:x1867507127031808:12345-0@lo:502:llog_process_th.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997294.604032:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1780997294.605158:0:91170:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91170:1867507127031808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997294.605220:0:91170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91170:1867507127031936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780997294.605267:0:91170:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997294.605392:0:91170:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986925600 going to sleep for 11 seconds 00000100:00100000:1.0:1780997294.605442:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127031936 00000100:00100000:1.0:1780997294.605447:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127031936 00000100:00100000:1.0:1780997294.605474:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1780997294.605481:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:91170:x1867507127031936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780997294.605582:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:91170:x1867507127031936:12345-0@lo:502:llog_process_th.0 Request processed in 101us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997294.605589:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1780997294.605962:0:91170:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91170:1867507127031936:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780997294.605990:0:91170:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1780997294.606203:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1780997294.606231:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780997294.606242:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4efc00/0x30fd811c0305ba2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba31 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.606253:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bb4efc00/0x30fd811c0305ba2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba31 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997294.606262:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1780997294.606265:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1780997294.606382:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1780997294.606421:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305ba38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.606429:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305ba38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.606438:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305ba38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997294.606453:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127032064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.606494:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997294.606512:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968983699c00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997294.606573:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127032064 00000100:00100000:1.0:1780997294.606578:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127032064 00000100:00100000:1.0:1780997294.606608:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1780997294.606615:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+19:6348:x1867507127032064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997294.606626:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997294.606638:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c8200/0x30fd811c0305ba3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ba38 expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997294.606662:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c8200/0x30fd811c0305ba3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ba38 expref: 20 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997294.606673:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c8200/0x30fd811c0305ba3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba38 expref: 20 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997294.606683:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8200, rc 0) 00000100:00100000:1.0:1780997294.606717:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127032064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997294.606722:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1780997294.606792:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127032064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780997294.606804:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305ba38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba3f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997294.606813:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305ba38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba3f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997294.606861:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127032192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.606882:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997294.606916:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968983699c00 going to sleep for 11 seconds 00000100:00100000:3.0:1780997294.607555:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127032192 00000100:00100000:3.0:1780997294.607562:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127032192 00000100:00100000:3.0:1780997294.607592:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1780997294.607599:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127032192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997294.607849:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127032192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997294.607856:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1780997294.612086:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127032192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.614406:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127032320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.614489:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997294.614534:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968983699c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.614728:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127032320 00000100:00100000:2.0:1780997294.614736:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127032320 00000100:00100000:2.0:1780997294.614786:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1780997294.614794:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127032320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.614892:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127032320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.614910:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1780997294.615016:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127032320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780997294.623558:0:91171:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1780997294.623860:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1780997294.623887:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1780997294.623898:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305ba38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba3f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.623922:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305ba38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba3f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997294.623943:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780997294.623945:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff968990f90000 from 61 10000000:01000000:2.0:1780997294.623948:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780997294.623982:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.623988:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.623998:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997294.624021:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127032448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.624095:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997294.624135:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997294.624469:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127032448 00000100:00100000:1.0:1780997294.624477:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127032448 00000100:00100000:1.0:1780997294.624551:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1780997294.624560:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:6348:x1867507127032448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997294.624575:0:90246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997294.624590:0:90246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c8600/0x30fd811c0305ba4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ba46 expref: -99 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997294.624613:0:90246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c8600/0x30fd811c0305ba4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ba46 expref: 21 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997294.624624:0:90246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c8600/0x30fd811c0305ba4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba46 expref: 21 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997294.624633:0:90246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8600, rc 0) 00000100:00100000:1.0:1780997294.624671:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127032448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997294.624677:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1780997294.624749:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127032448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997294.624762:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.624770:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997294.624824:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127032576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.624846:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997294.625037:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997294.625107:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127032576 00000100:00100000:3.0:1780997294.625111:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127032576 00000100:00100000:3.0:1780997294.625173:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1780997294.625181:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127032576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997294.625497:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127032576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 316us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997294.625504:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1780997294.625641:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127032576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.625672:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127032704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.625722:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997294.625743:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127032704 00000100:00100000:2.0:1780997294.625746:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127032704 00000100:00100000:2.0:1780997294.625767:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1780997294.625774:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127032704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.625843:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127032704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.625849:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1780997294.625882:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.625894:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127032704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.626141:0:91172:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91172:1867507127032832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997294.626173:0:91172:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997294.626189:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127032832 00000100:00100000:2.0:1780997294.626192:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127032832 00000100:00100000:2.0:1780997294.626207:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1780997294.626212:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:91172:x1867507127032832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997294.626309:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:91172:x1867507127032832:12345-0@lo:502:llog_process_th.0 Request processed in 96us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.626315:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1780997294.626338:0:91172:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.626347:0:91172:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91172:1867507127032832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997294.626380:0:91172:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91172:1867507127032960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997294.626407:0:91172:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997294.626423:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127032960 00000100:00100000:2.0:1780997294.626429:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127032960 00000100:00100000:2.0:1780997294.626443:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1780997294.626448:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:91172:x1867507127032960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780997294.626492:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:91172:x1867507127032960:12345-0@lo:502:llog_process_th.0 Request processed in 44us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.626499:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1780997294.626521:0:91172:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.626531:0:91172:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:91172:1867507127032960:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1780997294.626546:0:91172:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1780997294.626596:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1780997294.626617:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780997294.626628:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.626639:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997294.626648:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1780997294.626650:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1780997294.626653:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1780997294.626672:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.626679:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.626688:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997294.626708:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127033088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.626730:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997294.626742:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.626752:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127033088 00000100:00100000:2.0:1780997294.626755:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127033088 00000100:00100000:2.0:1780997294.626769:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1780997294.626774:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127033088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997294.626782:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997294.626792:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689ba454600/0x30fd811c0305ba5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ba54 expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.626811:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689ba454600/0x30fd811c0305ba5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ba54 expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.626820:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689ba454600/0x30fd811c0305ba5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba54 expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.626828:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689ba454600, rc 0) 00000100:00100000:2.0:1780997294.626850:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127033088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.626855:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1780997294.626879:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127033088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997294.626888:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.626897:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997294.626957:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127033216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.626978:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997294.626991:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.627003:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127033216 00000100:00100000:2.0:1780997294.627007:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127033216 00000100:00100000:2.0:1780997294.627022:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1780997294.627027:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127033216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.627106:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127033216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.627113:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1780997294.627140:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127033216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.627163:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127033344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.627197:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997294.627209:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997294.627219:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127033344 00000100:00100000:2.0:1780997294.627222:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127033344 00000100:00100000:2.0:1780997294.627237:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1780997294.627242:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127033344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.627324:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127033344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.627330:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1780997294.627359:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127033344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780997294.628850:0:91173:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1780997294.628991:0:6348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1780997294.629024:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1780997294.629032:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.629042:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997294.629052:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1780997294.629054:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9689b6283380 from 1 10000000:01000000:2.0:1780997294.629057:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1780997294.629096:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c0305ba62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.629103:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c0305ba62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.629113:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c0305ba62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997294.629131:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127033472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.629180:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997294.629216:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99000 going to sleep for 11 seconds 00000100:00100000:3.0:1780997294.629424:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127033472 00000100:00100000:3.0:1780997294.629430:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127033472 00000100:00100000:3.0:1780997294.629465:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1780997294.629472:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127033472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997294.629484:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997294.629496:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c0a00/0x30fd811c0305ba69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ba62 expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.629518:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c0a00/0x30fd811c0305ba69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ba62 expref: 23 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.629540:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c0a00/0x30fd811c0305ba69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba62 expref: 23 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.629548:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0a00, rc 0) 00000100:00100000:3.0:1780997294.629622:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507127033472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997294.629628:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1780997294.629804:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127033472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997294.629817:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c0305ba62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba69 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997294.629826:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c0305ba62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba69 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997294.629878:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127033600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780997294.629912:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997294.629968:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a640f00 going to sleep for 11 seconds 00000100:00100000:0.0:1780997294.630001:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127033600 00000100:00100000:0.0:1780997294.630005:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127033600 00000100:00100000:0.0:1780997294.630066:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1780997294.630074:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507127033600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780997294.630151:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507127033600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (248us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780997294.630157:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1780997294.630205:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127033600:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1780997294.630228:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1780997294.630233:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c0305ba62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba69 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997294.630240:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c0305ba62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba69 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997294.821550:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997294.982910:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997294.983052:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110429184 00000100:00100000:3.0:1780997294.983063:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110429184 00000100:00100000:3.0:1780997294.983119:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:3.0:1780997294.983128:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+7:70253:x1867507110429184:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997294.983144:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997294.983160:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bc4c1e00/0x30fd811c0305ba70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ec5 expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.983189:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bc4c1e00/0x30fd811c0305ba70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ec5 expref: 8 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.983200:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bc4c1e00/0x30fd811c0305ba70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ec5 expref: 8 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997294.983209:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1e00, rc 0) 00000100:00100000:3.0:1780997294.983552:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110429184:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 423us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997294.983560:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:1.0:1780997294.988020:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997294.990469:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110429312 00000100:00100000:2.0:1780997294.990490:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110429312 00000100:00100000:2.0:1780997294.990584:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:2.0:1780997294.990595:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110429312:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.990797:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110429312:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 204us (2786us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.990820:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:0.0:1780997294.992752:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997294.992847:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110429440 00000100:00100000:2.0:1780997294.992857:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110429440 00000100:00100000:2.0:1780997294.992913:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:2.0:1780997294.992922:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110429440:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780997294.993170:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110429440:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 249us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997294.993178:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:1.0:1780997294.998614:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997295.001263:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110429568 00000100:00100000:2.0:1780997295.001360:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110429568 00000100:00100000:2.0:1780997295.001430:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:2.0:1780997295.001441:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:72622:x1867507110429568:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1780997295.001765:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:72622:x1867507110429568:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 325us (3158us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997295.001774:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:1.0:1780997295.010660:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997295.012508:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110429696 00000100:00100000:3.0:1780997295.012531:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110429696 00000100:00100000:3.0:1780997295.012618:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 170 00000100:00100000:3.0:1780997295.012628:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:72622:x1867507110429696:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1780997295.012783:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:72622:x1867507110429696:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 156us (2134us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997295.012793:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 170 00000100:00100000:0.0:1780997295.017313:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997295.017852:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110429824 00000100:00100000:1.0:1780997295.017864:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110429824 00000100:00100000:1.0:1780997295.017931:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:1.0:1780997295.017942:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110429824:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780997295.017961:0:90246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997295.017980:0:90246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a56c8400/0x30fd811c0305ba77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ecc expref: -99 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997295.018010:0:90246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a56c8400/0x30fd811c0305ba77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ecc expref: 9 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997295.018022:0:90246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a56c8400/0x30fd811c0305ba77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ecc expref: 9 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997295.018031:0:90246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8400, rc 0) 00000100:00100000:1.0:1780997295.018092:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110429824:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 152us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997295.018118:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:1.0:1780997295.025177:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997295.025678:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110429952 00000100:00100000:3.0:1780997295.025688:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110429952 00000100:00100000:3.0:1780997295.025751:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 172 00000100:00100000:3.0:1780997295.025761:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110429952:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780997295.026009:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110429952:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 249us (841us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780997295.026017:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 172 00010000:00010000:2.0:1780997295.845511:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997296.869901:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997297.897488:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997298.086869:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127033728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997298.086982:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997298.087056:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127033856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997298.087086:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997298.087132:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127033728 00000100:00100000:0.0:1780997298.087143:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127033728 00000100:00100000:0.0:1780997298.087200:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127033856 00000100:00100000:0.0:1780997298.087203:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127033856 00000100:00100000:0.0:1780997298.087229:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4119 00000100:00100000:0.0:1780997298.087239:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127033728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780997298.087304:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445474304 avail 1299234816 00000100:00100000:0.0:1780997298.087356:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127033728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.087365:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4119 00000100:00100000:0.0:1780997298.087384:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4120 00000100:00100000:0.0:1780997298.087390:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127033856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780997298.087408:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445232640 avail 1298993152 00000100:00100000:0.0:1780997298.087441:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127033856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.087448:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4120 00000100:00100000:0.0:1780997298.087503:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127033856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997298.094676:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127033984:0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.094797:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997298.094860:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507127034496:0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.094911:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997298.094940:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127035008:0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.094973:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997298.095004:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1780997298.095012:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507127034368:0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.095037:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997298.095057:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507127034880:0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.095081:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997298.095121:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127033984 00000100:00100000:1.0:1780997298.095132:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127033984 00000100:00100000:1.0:1780997298.095193:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1780997298.095204:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507127033984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.095305:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3497:x1867507127033984:12345-0@lo:400:kworker.0 Request processed in 68us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997298.095313:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1780997298.095354:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127034496 00000100:00100000:1.0:1780997298.095358:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127034496 00000100:00100000:1.0:1780997298.095398:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127034368 00000100:00100000:1.0:1780997298.095401:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127034368 00000100:00100000:1.0:1780997298.095420:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127034880 00000100:00100000:1.0:1780997298.095438:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127034880 00000100:00100000:1.0:1780997298.095462:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1780997298.095469:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507127034496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.095506:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507127034496:12345-0@lo:400:kworker.0 Request processed in 38us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997298.095513:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1780997298.095525:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1780997298.095531:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507127034368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.095560:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507127034368:12345-0@lo:400:kworker.0 Request processed in 29us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997298.095566:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1780997298.095578:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:1.0:1780997298.095583:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3497:x1867507127034880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.095612:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3497:x1867507127034880:12345-0@lo:400:kworker.0 Request processed in 29us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997298.095618:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:1.0:1780997298.095639:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127035008 00000100:00100000:1.0:1780997298.095643:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127035008 00000100:00100000:1.0:1780997298.095675:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698 00000100:00100000:1.0:1780997298.095682:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127035008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.095717:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127035008:12345-0@lo:400:kworker.0 Request processed in 35us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997298.095723:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698 00000100:00100000:1.0:1780997298.095789:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507127034368:0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.095802:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507127034880:0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.095824:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127033984:0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.095834:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507127034496:0@lo:400:kworker.0 00000100:00100000:1.0:1780997298.095843:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127035008:0@lo:400:kworker.0 00000100:00080000:3.0:1780997298.098145:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780997298.098166:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780997298.098172:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997298.098210:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507127034112:0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.098334:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997298.098394:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127034624:0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.098426:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997298.098451:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127035136:0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.098477:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997298.098506:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1780997298.098514:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507127034240:0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.098551:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997298.098593:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127034752:0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.098618:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997298.098639:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507127035264:0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.098664:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997298.098711:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127034624 00000100:00100000:3.0:1780997298.098722:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127034624 00000100:00100000:3.0:1780997298.098789:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127035136 00000100:00100000:3.0:1780997298.098792:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127035136 00000100:00100000:3.0:1780997298.098816:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127034752 00000100:00100000:3.0:1780997298.098819:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127034752 00000100:00100000:3.0:1780997298.098844:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699 00000100:00100000:3.0:1780997298.098853:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127034624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.098934:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127034624:12345-0@lo:400:kworker.0 Request processed in 81us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.098942:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699 00000100:00100000:3.0:1780997298.098961:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00100000:3.0:1780997298.098967:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127035136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.098995:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127035136:12345-0@lo:400:kworker.0 Request processed in 29us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.099001:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00100000:3.0:1780997298.099010:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:3.0:1780997298.099016:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127034752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.099041:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127034752:12345-0@lo:400:kworker.0 Request processed in 26us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.099047:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00100000:3.0:1780997298.099088:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127034112 00000100:00100000:3.0:1780997298.099092:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127034112 00000100:00100000:3.0:1780997298.099133:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127034240 00000100:00100000:3.0:1780997298.099137:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127034240 00000100:00100000:3.0:1780997298.099157:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127035264 00000100:00100000:3.0:1780997298.099160:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127035264 00000100:00100000:3.0:1780997298.099172:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1780997298.099178:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507127034112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.099215:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3498:x1867507127034112:12345-0@lo:400:kworker.0 Request processed in 36us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.099221:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1780997298.099232:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1780997298.099238:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507127034240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.099267:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507127034240:12345-0@lo:400:kworker.0 Request processed in 29us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.099297:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1780997298.099308:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1780997298.099314:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507127035264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.099343:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507127035264:12345-0@lo:400:kworker.0 Request processed in 30us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.099348:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00080000:3.0:1780997298.099375:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997298.099379:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780997298.099382:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997298.099384:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997298.099424:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507127034240:0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.099438:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127034752:0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.099448:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507127035264:0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.099469:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3498:1867507127034112:0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.099480:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127034624:0@lo:400:kworker.0 00000100:00100000:3.0:1780997298.099489:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127035136:0@lo:400:kworker.0 00000100:00100000:0.0:1780997298.102107:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127033728:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1780997298.291969:0:91271:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 05:28:16 (1780997296) 00000100:00100000:0.0:1780997298.442058:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.442319:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110430208 00000100:00100000:3.0:1780997298.442344:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110430208 00000100:00100000:3.0:1780997298.442450:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1461 00000100:00100000:3.0:1780997298.442464:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:72793:x1867507110430208:12345-192.168.206.51@tcp:36:mkdir.0 00000100:00100000:3.0:1780997298.442646:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127035392:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1780997298.442725:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997298.442764:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb600 going to sleep for 11 seconds 00000100:00100000:3.0:1780997298.442799:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127035392 00000100:00100000:3.0:1780997298.443409:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127035392 00000100:00100000:3.0:1780997298.443474:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4121 00000100:00100000:3.0:1780997298.443484:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63418:x1867507127035392:12345-0@lo:1000:mdt00_001.0 00000100:00080000:0.0:1780997298.443560:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997298.443624:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63418:x1867507127035392:12345-0@lo:1000:mdt00_001.0 Request processed in 142us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.443633:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4121 00000100:00100000:0.0:1780997298.443656:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127035392:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780997298.443726:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127035520:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780997298.443769:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997298.443797:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff968991d236c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997298.446450:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127035520 00000100:00100000:3.0:1780997298.446471:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127035520 00000100:00100000:3.0:1780997298.446568:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4122 00000100:00100000:3.0:1780997298.446579:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63418:x1867507127035520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1780997298.446788:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63418:x1867507127035520:12345-0@lo:1000:mdt00_001.0 Request processed in 211us (3018us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780997298.446796:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4122 00000100:00100000:3.0:1780997298.446913:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a6795880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127035520:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1780997298.447008:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.447020:0:63418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.447032:0:63418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997298.447054:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127035648:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1780997298.447093:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997298.447118:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb180 going to sleep for 11 seconds 00000100:00100000:3.0:1780997298.447134:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127035648 00000100:00100000:3.0:1780997298.447138:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127035648 00000100:00100000:3.0:1780997298.447165:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4123 00000100:00100000:3.0:1780997298.447172:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63418:x1867507127035648:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1780997298.447185:0:80061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997298.447205:0:80061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c0305ba85 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ba7e expref: -99 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.447236:0:80061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305b88d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e71 expref: 9 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.447248:0:80061:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c0305ba85 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ba7e expref: 8 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.447343:0:80061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305b88d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e71 expref: 9 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.447373:0:80061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305b88d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e71 expref: 9 pid: 63417 timeout: 3925 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997298.447386:0:80061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:80061:1867507127035776:192.168.206.51@tcp:104: 00000100:00100000:3.0:1780997298.447472:0:80061:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997298.458749:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.458865:0:80061:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:80061:1867507127035776:192.168.206.51@tcp:104: 00010000:00010000:1.0:1780997298.458933:0:80061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c0305ba85 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba7e expref: 8 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.458952:0:80061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:1.0:1780997298.458956:0:80061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997298.458960:0:80061:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c0305ba85 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba7e expref: 8 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.458974:0:80061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1400, rc 0) 00000100:00100000:1.0:1780997298.459076:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63418:x1867507127035648:12345-0@lo:101:mdt00_001.0 Request processed in 11903us (11982us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997298.459087:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4123 00000100:00100000:3.0:1780997298.459145:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127035648:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1780997298.459145:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110430336 00000100:00100000:0.0:1780997298.459158:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110430336 00010000:00010000:3.0:1780997298.459181:0:63418:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.459198:0:63418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.459249:0:8261:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305b88d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e71 expref: 10 pid: 63417 timeout: 3925 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1780997298.459349:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780997298.459513:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2615 00000100:00100000:0.0:1780997298.459524:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2394:x1867507110430336:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780997298.459540:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997298.459547:0:8261:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305b88d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e71 expref: 10 pid: 63417 timeout: 3925 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.459559:0:8261:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305b88d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e71 expref: 10 pid: 63417 timeout: 3925 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.459587:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689a56c8800/0x30fd811c0305b88d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e71 expref: 10 pid: 63417 timeout: 3925 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.459604:0:8261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:0.0:1780997298.459609:0:8261:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c0305ba85 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba7e expref: 7 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.459622:0:8261:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c0305ba85 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x30fd811c0305ba7e expref: 7 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.459649:0:8261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c0305ba85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x30fd811c0305ba7e expref: 7 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.459694:0:8261:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c0305ba85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba7e expref: 7 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997298.459713:0:8261:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce81c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8261:1867507127035904:0@lo:105: 00000100:00100000:0.0:1780997298.459781:0:8261:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997298.459827:0:8261:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18ba180 going to sleep for 11 seconds 00000100:00100000:3.0:1780997298.460127:0:6335:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1780997298.460140:0:6335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127035904 00000100:00100000:3.0:1780997298.460146:0:6335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127035904 00000100:00100000:3.0:1780997298.460201:0:6335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1780997298.460213:0:6335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b0e76050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8261:x1867507127035904:12345-0@lo:105: 00010000:00010000:3.0:1780997298.460225:0:6335:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.460235:0:6335:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.460244:0:6335:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.460301:0:6335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.460309:0:6335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.460319:0:6335:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.460339:0:6335:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9689bc4c1a00) 00000100:00100000:3.0:1780997298.460377:0:6335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b0e76050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8261:x1867507127035904:12345-0@lo:105: Request processed in 168us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.460385:0:6335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00010000:00010000:3.0:1780997298.460427:0:63418:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.460436:0:63418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780997298.460457:0:63418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1780997298.460497:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.460505:0:63418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.460515:0:63418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997298.460545:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036032:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1780997298.460580:0:8261:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce81c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8261:1867507127035904:0@lo:105: 00000100:00100000:3.0:1780997298.460602:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780997298.460608:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997298.460660:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2394:x1867507110430336:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 1136us (1917us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.460671:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2615 00000100:00100000:3.0:1780997298.460733:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb000 going to sleep for 11 seconds 00000100:00100000:3.0:1780997298.460756:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127036032 00000100:00100000:3.0:1780997298.460760:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127036032 00000100:00100000:3.0:1780997298.460791:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4124 00000100:00100000:3.0:1780997298.460798:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63418:x1867507127036032:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1780997298.460815:0:23042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997298.460829:0:23042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305ba93 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30fd811c0305ba8c expref: -99 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.460848:0:23042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305ba93 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305ba8c expref: 9 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.460860:0:23042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305ba93 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba8c expref: 9 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.460867:0:23042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff96898712d700) 00010000:00010000:3.0:1780997298.460870:0:23042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997298.460872:0:23042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0000, rc 0) 00000100:00100000:3.0:1780997298.461472:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507127036032:12345-0@lo:101:mdt00_001.0 Request processed in 672us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.461480:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4124 00000100:00100000:2.0:1780997298.461545:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036032:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1780997298.461570:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba93 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.461581:0:63418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba93 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780997298.461721:0:63418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1780997298.461789:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036160:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1780997298.461832:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997298.461860:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99540 going to sleep for 11 seconds 00000100:00100000:0.0:1780997298.462112:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127036160 00000100:00100000:0.0:1780997298.462119:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127036160 00000100:00100000:0.0:1780997298.462169:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4125 00000100:00100000:0.0:1780997298.462179:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507127036160:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780997298.462316:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507127036160:12345-0@lo:1000:mdt00_001.0 Request processed in 139us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.462324:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4125 00000100:00100000:3.0:1780997298.462369:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036160:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1780997298.462426:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036288:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1780997298.462473:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997298.462504:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780997298.462590:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127036288 00000100:00100000:0.0:1780997298.462595:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127036288 00000100:00100000:0.0:1780997298.462635:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4126 00000100:00100000:0.0:1780997298.462644:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507127036288:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780997298.462783:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507127036288:12345-0@lo:1000:mdt00_001.0 Request processed in 140us (307us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780997298.462790:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4126 00000100:00100000:3.0:1780997298.462830:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036288:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1780997298.462927:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036416:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1780997298.462949:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997298.462969:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997298.464022:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127036416 00000100:00100000:2.0:1780997298.464036:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127036416 00000100:00100000:0.0:1780997298.464127:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4127 00000100:00100000:0.0:1780997298.464137:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507127036416:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780997298.464243:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507127036416:12345-0@lo:1000:mdt00_001.0 Request processed in 107us (1291us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780997298.464250:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4127 00000100:00100000:3.0:1780997298.464334:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036416:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1780997298.464410:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9688895f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036544:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1780997298.464445:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997298.464467:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997298.464523:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127036544 00000100:00100000:2.0:1780997298.464527:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127036544 00000100:00100000:2.0:1780997298.464562:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4128 00000100:00100000:2.0:1780997298.464570:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507127036544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1780997298.464631:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507127036544:12345-0@lo:1000:mdt00_001.0 Request processed in 62us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997298.464638:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4128 00000100:00100000:2.0:1780997298.464665:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9688895f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036544:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1780997298.464706:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036672:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1780997298.464734:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997298.464751:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997298.464762:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127036672 00000100:00100000:2.0:1780997298.464765:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127036672 00000100:00100000:2.0:1780997298.464785:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4129 00000100:00100000:2.0:1780997298.464793:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507127036672:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1780997298.464853:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507127036672:12345-0@lo:1000:mdt00_001.0 Request processed in 61us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997298.464860:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4129 00000100:00100000:2.0:1780997298.464912:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba185c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036672:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1780997298.464955:0:63418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f12300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036800:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1780997298.464979:0:63418:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997298.465001:0:63418:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780997298.465012:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127036800 00000100:00100000:2.0:1780997298.465015:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127036800 00000100:00100000:2.0:1780997298.465035:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4130 00000100:00100000:2.0:1780997298.465041:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507127036800:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1780997298.465083:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63418:x1867507127036800:12345-0@lo:1000:mdt00_001.0 Request processed in 41us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997298.465089:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4130 00000100:00100000:2.0:1780997298.465114:0:63418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f12300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63418:1867507127036800:0@lo:1000:mdt00_001.0 00000040:00080000:2.0:1780997298.465685:0:63418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].7, 1000 off41440 00000040:00080000:2.0:1780997298.465754:0:63418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].6, 1152 off40176 00000004:00080000:2.0:1780997298.465761:0:63418:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9689bcc99cc0 with version 20 00000004:00080000:2.0:1780997298.465779:0:72369:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff968889e33300 version 20 rpc_version 20 00000020:00100000:2.0:1780997298.465799:0:72369:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1780997298.465808:0:72369:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9689b7f12300 x1867507127037056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780997298.465825:0:72369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f12300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507127037056:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1780997298.465861:0:72369:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997298.465891:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689bcc99900 going to sleep for 11 seconds 00000100:00100000:2.0:1780997298.465905:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127037056 00000100:00100000:2.0:1780997298.465909:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127037056 00000100:00100000:2.0:1780997298.465933:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4131 00000100:00100000:2.0:1780997298.465939:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:72369:x1867507127037056:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1780997298.466302:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:72369:x1867507127037056:12345-0@lo:1000:osp_up0-1.0 Request processed in 361us (438us total) trans 120259084289 rc 0/0 00000100:00100000:2.0:1780997298.466310:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4131 00000100:00100000:2.0:1780997298.466360:0:72369:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f12300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507127037056:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1780997298.466438:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3600/0x30fd811c0305ba9a lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466455:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3600/0x30fd811c0305ba9a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466470:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3600/0x30fd811c0305ba9a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.466487:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000201a076d reply state 0000000031c11846 transno 81604378768 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3600/0x30fd811c0305ba9a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466498:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3600/0x30fd811c0305ba9a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466505:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:2.0:1780997298.466508:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.466512:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1780997298.466517:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x6:0x0]: returning size 4096 00000004:00080000:2.0:1780997298.466524:0:63418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1780997298.466531:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466539:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466547:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466564:0:63418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1780997298.466568:0:63418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1780997298.466580:0:37626:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997298.466587:0:37626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466594:0:37626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1a00 already unused, calling callback (ffffffffc1b42ee0) 00010000:00010000:2.0:1780997298.466600:0:37626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.466609:0:37626:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466634:0:37626:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466641:0:37626:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997298.466664:0:37626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466672:0:37626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c1a00/0x30fd811c0305ba7e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x30fd811c0305ba85 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466686:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997298.466688:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997298.466690:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997298.466699:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127037184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997298.466734:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997298.466776:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127037184 00000100:00100000:2.0:1780997298.466781:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127037184 00000100:00100000:2.0:1780997298.466818:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1780997298.466826:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3496:x1867507127037184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997298.466847:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997298.466865:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1400/0x30fd811c0305ba85 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305ba7e expref: 10 pid: 80061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466877:0:6336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:2.0:1780997298.466893:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997298.466922:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3496:x1867507127037184:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997298.466929:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1780997298.466962:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127037184:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997298.466982:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba93 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.466990:0:63418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba93 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997298.467062:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:72793:x1867507110430208:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 24600us (25019us total) trans 81604378768 rc 0/0 00000100:00100000:2.0:1780997298.467069:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1461 00000100:00100000:3.0:1780997298.504741:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.504853:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110430464 00000100:00100000:0.0:1780997298.504864:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110430464 00000100:00100000:0.0:1780997298.504937:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1462 00000100:00100000:0.0:1780997298.504947:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:72795:x1867507110430464:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1780997298.504967:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997298.504988:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee000/0x30fd811c0305baa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ed3 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.505052:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305baa8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.505066:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305baa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.505078:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305baa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997298.505124:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780997298.505128:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997298.505151:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305baa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.505186:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee000/0x30fd811c0305baa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ed3 expref: 11 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.505203:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305baa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ed3 expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.505211:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:0.0:1780997298.505214:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780997298.505217:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ee600, rc 0) 00000100:00100000:0.0:1780997298.505314:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:72795:x1867507110430464:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 368us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.505321:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1462 00000100:00100000:0.0:1780997298.513076:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.513817:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110430720 00000100:00100000:2.0:1780997298.513829:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110430720 00000100:00100000:2.0:1780997298.513913:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1463 00000100:00100000:2.0:1780997298.513925:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:72795:x1867507110430720:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780997298.513947:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997298.513950:0:63419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1780997298.513978:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4ee600/0x30fd811c0305baa8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ed3 expref: 10 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.514015:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:2.0:1780997298.514021:0:63419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997298.514035:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305baaf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8eda expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.514158:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bab6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.514183:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.514204:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.514217:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.514228:0:63419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305ba93 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba8c expref: 8 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.514237:0:63419:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.514298:0:63419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305ba93 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305ba8c expref: 8 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997298.514314:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63419:1867507127037312:0@lo:104: 00000100:00100000:2.0:1780997298.514366:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997298.514409:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997298.514767:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127037312 00000100:00100000:0.0:1780997298.514773:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127037312 00000100:00100000:0.0:1780997298.514825:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1780997298.514833:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:63419:x1867507127037312:12345-0@lo:104: 00010000:00010000:0.0:1780997298.514847:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ba93 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.514922:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1780997298.514928:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:63419:x1867507127037312:12345-0@lo:104: Request processed in 97us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.514935:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00010000:00010000:0.0:1780997298.514958:0:6340:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997298.514965:0:6340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x30fd811c0305ba93 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.514986:0:6340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0400 already unused, calling callback (ffffffffc1b42ee0) 00010000:00010000:0.0:1780997298.514992:0:6340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x30fd811c0305ba93 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997298.515001:0:6340:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x30fd811c0305ba93 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.515028:0:6340:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ba93 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.515035:0:6340:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780997298.515056:0:6340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ba93 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.515062:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9689bc4c0400/0x30fd811c0305ba8c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305ba93 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.515091:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997298.515093:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997298.515095:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997298.515106:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127037440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780997298.515140:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997298.515178:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127037440 00000100:00100000:0.0:1780997298.515183:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127037440 00010000:00010000:0.0:1780997298.515370:0:6338:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305ba93 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x30fd811c0305ba8c expref: 9 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997298.515410:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:0.0:1780997298.515416:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3497:x1867507127037440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997298.515427:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1780997298.515678:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63419:1867507127037312:0@lo:104: 00010000:00010000:0.0:1780997298.515696:0:63419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780997298.521489:0:90240:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084289 is committed 00010000:00010000:0.0:1780997298.521615:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305ba93 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305ba8c expref: 8 pid: 23042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.521634:0:6338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff96898712d700) 00010000:00010000:0.0:1780997298.521639:0:6338:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.521649:0:6338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.521657:0:6338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.521704:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997298.521814:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3497:x1867507127037440:12345-0@lo:103:ldlm_bl.0 Request processed in 6384us (6659us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.521824:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00100000:0.0:1780997298.521891:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bce83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127037440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997298.522056:0:63419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.522065:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997298.522169:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:63419:1867507127037568:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1780997298.522321:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997298.522352:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888851c240 going to sleep for 11 seconds 00000100:00100000:0.0:1780997298.522415:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127037568 00000100:00100000:0.0:1780997298.522439:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127037568 00000100:00100000:0.0:1780997298.522486:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4132 00000100:00100000:0.0:1780997298.522494:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63419:x1867507127037568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1780997298.522576:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63419:x1867507127037568:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.522583:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4132 00000100:00100000:0.0:1780997298.522612:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:63419:1867507127037568:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1780997298.522656:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4efe00/0x30fd811c0305bac4 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522668:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4efe00/0x30fd811c0305bac4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522675:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4efe00/0x30fd811c0305bac4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522687:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bab6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522692:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bab6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522698:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bab6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522704:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bab6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522709:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997298.522713:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bab6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522731:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bab6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522742:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:0.0:1780997298.522744:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997298.522748:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bab6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522755:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522766:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522772:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522777:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522782:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997298.522785:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522790:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.522796:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff96898712d700) 00010000:00010000:0.0:1780997298.522799:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997298.522801:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.524189:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3c00/0x30fd811c0305babd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.524469:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3000/0x30fd811c0305baaf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eda expref: 11 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.524483:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bb4efe00/0x30fd811c0305bac4 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eda expref: 10 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.524490:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898d864a00) 00010000:00010000:0.0:1780997298.524493:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780997298.524496:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4efe00, rc 0) 00000100:00100000:0.0:1780997298.524566:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:72795:x1867507110430720:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 10643us (11498us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.524575:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1463 00000100:00100000:0.0:1780997298.537526:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.537734:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110430976 00000100:00100000:1.0:1780997298.537745:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110430976 00000100:00100000:1.0:1780997298.537805:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1464 00000100:00100000:1.0:1780997298.537817:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:72795:x1867507110430976:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1780997298.537843:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997298.537864:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bacb lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ee1 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997298.538788:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x6:0x0]: returning size 4096 00010000:00010000:1.0:1780997298.538822:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bacb lrc: 1/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ee1 expref: 14 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.538838:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:1.0:1780997298.538841:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997298.538847:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bacb lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ee1 expref: 14 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.538862:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8c00, rc 0) 00000100:00100000:1.0:1780997298.538946:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:72795:x1867507110430976:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1132us (1432us total) trans 0 rc 301/301 00000100:00100000:1.0:1780997298.538954:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1464 00000100:00100000:2.0:1780997298.550427:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.550632:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110431104 00000100:00100000:3.0:1780997298.550644:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110431104 00000100:00100000:3.0:1780997298.550709:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1465 00000100:00100000:3.0:1780997298.550722:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:72795:x1867507110431104:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1780997298.550744:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997298.550774:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c0305bad2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ee8 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.550845:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c0305bad9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.550862:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c0305bad9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.550875:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c0305bad9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997298.551448:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1780997298.551453:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780997298.551476:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c0305bad9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.551505:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0800/0x30fd811c0305bad2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ee8 expref: 12 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.551525:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c0305bad9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ee8 expref: 11 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.551534:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:3.0:1780997298.551538:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780997298.551541:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0e00, rc 0) 00000100:00100000:3.0:1780997298.551626:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:72795:x1867507110431104:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 905us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.551634:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1465 00000100:00100000:1.0:1780997298.555067:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.558100:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110431360 00000100:00100000:2.0:1780997298.558118:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110431360 00000100:00100000:2.0:1780997298.558405:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1466 00000100:00100000:2.0:1780997298.558430:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:72795:x1867507110431360:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1780997298.558452:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997298.558472:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3800/0x30fd811c0305bae0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8eef expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558543:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c0305bae7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558558:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c0305bae7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558568:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c0305bae7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558582:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c0305baee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558597:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c0305baee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558604:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c0305baee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558654:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c0305baf5 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558663:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c0305baf5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558669:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c0305baf5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558685:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c0305bae7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558694:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c0305bae7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558702:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c0305bae7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558710:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c0305bae7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558717:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997298.558722:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c0305bae7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558731:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c0305bae7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558759:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:2.0:1780997298.558764:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997298.558768:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c0305bae7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558774:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2000/0x30fd811c0305bae7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558786:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c0305baee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558792:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c0305baee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558797:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c0305baee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558801:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997298.558804:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c0305baee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558808:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c0305baee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558815:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff968983653a00) 00010000:00010000:2.0:1780997298.558816:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997298.558819:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c0305baee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558824:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb2e00/0x30fd811c0305baee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558865:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3800/0x30fd811c0305bae0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eef expref: 13 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558888:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c0305baf5 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eef expref: 12 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.558896:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898d864a00) 00010000:00010000:2.0:1780997298.560132:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780997298.560140:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3400, rc 0) 00000100:00100000:2.0:1780997298.560686:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:72795:x1867507110431360:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2266us (5622us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997298.560696:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1466 00000100:00100000:2.0:1780997298.573221:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.573288:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.573303:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110431744 00000100:00100000:3.0:1780997298.573315:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110431744 00000100:00100000:2.0:1780997298.573318:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110431616 00000100:00100000:2.0:1780997298.573325:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110431616 00000100:00100000:2.0:1780997298.573380:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1467 00000100:00100000:3.0:1780997298.573383:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 705 00000100:00100000:2.0:1780997298.573393:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:72795:x1867507110431616:12345-192.168.206.51@tcp:101:lfs.0 00000100:00100000:3.0:1780997298.573398:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:2396:x1867507110431744:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780997298.573413:0:18812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997298.573414:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997298.573435:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bafc lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ef6 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.573437:0:18812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bcbb3400/0x30fd811c0305baf5 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8eef expref: 12 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.573465:0:18812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898d864a00) 00010000:00010000:3.0:1780997298.573480:0:18812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997298.573536:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2396:x1867507110431744:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 142us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.573544:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 705 00000004:00200000:2.0:1780997298.573554:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x6:0x0]: returning size 4096 00010000:00010000:2.0:1780997298.573665:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bafc lrc: 1/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ef6 expref: 15 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.573687:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:2.0:1780997298.573689:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780997298.573693:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bafc lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ef6 expref: 15 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.573703:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2200, rc 0) 00000100:00100000:2.0:1780997298.573744:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:72795:x1867507110431616:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 355us (474us total) trans 81604378769 rc 301/301 00000100:00100000:2.0:1780997298.573751:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1467 00000100:00100000:2.0:1780997298.580547:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.580619:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110432000 00000100:00100000:3.0:1780997298.580630:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110432000 00000100:00100000:3.0:1780997298.580689:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1468 00000100:00100000:3.0:1780997298.580699:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:72795:x1867507110432000:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:3.0:1780997298.580788:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bb0a lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.580805:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bb0a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.580816:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bb0a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997298.580980:0:80049:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045335469 reply state 00000000f362301f transno 81604378770 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bb0a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.580992:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bb0a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.580999:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:3.0:1780997298.581001:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1780997298.581005:0:80049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1780997298.581012:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x6:0x0]: returning size 4096 00000100:00100000:3.0:1780997298.581088:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+16:72795:x1867507110432000:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 390us (548us total) trans 81604378770 rc 0/0 00000100:00100000:3.0:1780997298.581095:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1468 00000100:00100000:3.0:1780997298.584174:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.584352:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110432256 00000100:00100000:1.0:1780997298.584364:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110432256 00000100:00100000:1.0:1780997298.584412:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 243 00000100:00100000:1.0:1780997298.584423:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+16:72795:x1867507110432256:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1780997298.584651:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+17:72795:x1867507110432256:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 229us (485us total) trans 81604378771 rc 0/0 00000100:00100000:1.0:1780997298.584659:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 243 00000100:00100000:1.0:1780997298.600130:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780997298.600157:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127037696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997298.600237:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997298.600338:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127037696 00000100:00100000:2.0:1780997298.600348:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127037696 00000100:00100000:2.0:1780997298.600409:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170 00000100:00100000:2.0:1780997298.600420:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127037696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780997298.600451:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997298.600500:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127037696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997298.600508:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170 00000100:00100000:2.0:1780997298.600554:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b7f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127037696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780997298.601143:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780997298.601155:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127037824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780997298.601204:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997298.601412:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127037824 00000100:00100000:3.0:1780997298.601418:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127037824 00000100:00100000:3.0:1780997298.601457:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171 00000100:00100000:3.0:1780997298.601465:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127037824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780997298.601483:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997298.601528:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127037824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.601535:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171 00000100:00100000:0.0:1780997298.601599:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127037824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780997298.618414:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.618534:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110432512 00000100:00100000:3.0:1780997298.618546:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110432512 00000100:00100000:3.0:1780997298.618609:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1469 00000100:00100000:3.0:1780997298.618619:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+17:72804:x1867507110432512:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:3.0:1780997298.618646:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997298.618667:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bb11 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8efd expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.618786:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bb18 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.618802:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bb18 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.618814:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bb18 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.618829:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305bb1f lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.618837:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305bb1f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.618859:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305bb1f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997298.619021:0:63419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507127037952:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1780997298.619073:0:63419:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997298.619101:0:63419:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689b18bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1780997298.619188:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127037952 00000100:00100000:0.0:1780997298.619205:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127037952 00000100:00100000:0.0:1780997298.619247:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4133 00000100:00100000:0.0:1780997298.619254:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63419:x1867507127037952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1780997298.619564:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63419:x1867507127037952:12345-0@lo:1000:mdt00_002.0 Request processed in 310us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.619583:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4133 00000100:00100000:3.0:1780997298.619727:0:63419:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084289 gen 3 00000004:00080000:3.0:1780997298.619733:0:63419:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 120259084289 committed transno 120259084289 00000100:00100000:3.0:1780997298.619758:0:63419:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968988613b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63419:1867507127037952:0@lo:1000:mdt00_002.0 00000004:00080000:3.0:1780997298.620078:0:63419:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x491:0x0], count =401 00000004:00080000:3.0:1780997298.620087:0:63419:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000401:0x491:0x0]+401 in llog 00000004:00080000:3.0:1780997298.620097:0:63419:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x622:0x0], index 0: 0 00010000:00010000:2.0:1780997298.620696:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb26 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620711:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb26 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620734:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb26 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620774:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bb18 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620781:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bb18 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620788:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bb18 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620795:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bb18 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620801:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997298.620805:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bb18 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620813:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bb18 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620827:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:2.0:1780997298.620830:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997298.620834:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bb18 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620840:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bb18 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.620852:0:63419:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021bee712 reply state 00000000f672f785 transno 81604378772 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305bb1f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620870:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305bb1f lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620876:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x9beb5ca3 (ffff96898712d400) 00010000:00010000:2.0:1780997298.620889:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.620891:0:63419:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780997298.620928:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bb11 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8efd expref: 20 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620942:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb26 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8efd expref: 19 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.620948:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff968983653a00) 00010000:00010000:2.0:1780997298.620950:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997298.620952:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2200, rc 0) 00000100:00100000:2.0:1780997298.621021:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+20:72804:x1867507110432512:12345-192.168.206.51@tcp:101:touch.0 Request processed in 2404us (2620us total) trans 81604378772 rc 0/0 00000100:00100000:2.0:1780997298.621029:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1469 00000100:00100000:0.0:1780997298.628428:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.628893:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110432768 00000100:00100000:2.0:1780997298.628904:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110432768 00000100:00100000:2.0:1780997298.628974:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1470 00000100:00100000:2.0:1780997298.628987:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+20:72804:x1867507110432768:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:2.0:1780997298.629047:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997298.629074:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb26 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8efd expref: 20 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.629092:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff968983653a00) 00010000:00010000:2.0:1780997298.629116:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997298.629167:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3800/0x30fd811c0305bb34 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.629181:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3800/0x30fd811c0305bb34 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.629200:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3800/0x30fd811c0305bb34 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.629609:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a9bbca52 reply state 0000000009ddbabd transno 81604378773 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3800/0x30fd811c0305bb34 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.629623:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3800/0x30fd811c0305bb34 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.629630:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff968983653b00) 00010000:00010000:2.0:1780997298.629633:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.629635:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997298.629738:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+21:72804:x1867507110432768:12345-192.168.206.51@tcp:36:touch.0 Request processed in 753us (1316us total) trans 81604378773 rc 0/0 00000100:00100000:2.0:1780997298.629746:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1470 00000100:00100000:3.0:1780997298.632645:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.632875:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110432896 00000100:00100000:0.0:1780997298.632903:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110432896 00000100:00100000:0.0:1780997298.632969:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1471 00000100:00100000:0.0:1780997298.632980:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+21:72804:x1867507110432896:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997298.633012:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997298.633043:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef800/0x30fd811c0305bb3b lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f04 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.633114:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef800/0x30fd811c0305bb3b lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f04 expref: 22 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.633128:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef800/0x30fd811c0305bb3b lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f04 expref: 22 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.633146:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff968983653b00) 00010000:00010000:0.0:1780997298.633150:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780997298.633154:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ef800, rc 0) 00000100:00100000:0.0:1780997298.633461:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:72804:x1867507110432896:12345-192.168.206.51@tcp:101:touch.0 Request processed in 481us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.633471:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1471 00000100:00100000:3.0:1780997298.635486:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.635804:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110433024 00000100:00100000:1.0:1780997298.635834:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110433024 00000100:00100000:1.0:1780997298.635912:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5982 00000100:00100000:1.0:1780997298.635923:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2395:x1867507110433024:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:1.0:1780997298.636142:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2395:x1867507110433024:12345-192.168.206.51@tcp:2:touch.0 Request processed in 220us (663us total) trans 4294969457 rc 0/0 00000100:00100000:1.0:1780997298.636150:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5982 00000100:00080000:0.0:1780997298.636216:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780997298.640149:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.640309:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110433280 00000100:00100000:1.0:1780997298.640319:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110433280 00000100:00100000:1.0:1780997298.640406:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 244 00000100:00100000:1.0:1780997298.640417:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:72804:x1867507110433280:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:1.0:1780997298.640729:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+23:72804:x1867507110433280:12345-192.168.206.51@tcp:35:touch.0 Request processed in 313us (588us total) trans 81604378774 rc 0/0 00000100:00100000:1.0:1780997298.640736:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 244 00000100:00100000:3.0:1780997298.649509:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.649926:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110433536 00000100:00100000:2.0:1780997298.649937:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110433536 00000100:00100000:2.0:1780997298.650009:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1472 00000100:00100000:2.0:1780997298.650020:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+23:72804:x1867507110433536:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:2.0:1780997298.650045:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997298.650066:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb42 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f0b expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.650551:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bb49 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.650567:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bb49 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.650578:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bb49 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.650592:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2000/0x30fd811c0305bb50 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.650599:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2000/0x30fd811c0305bb50 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.650605:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2000/0x30fd811c0305bb50 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780997298.652605:0:65272:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x623:0x0], index 0: 0 00010000:00010000:2.0:1780997298.652796:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bb57 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.654992:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bb57 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.655023:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bb57 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.655098:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bb49 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.655126:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bb49 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.655133:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bb49 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.655139:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bb49 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.655145:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997298.655149:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bb49 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.655157:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bb49 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.655171:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:2.0:1780997298.655175:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997298.655179:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bb49 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.655186:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bb49 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.655208:0:65272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000022e27ae4 reply state 000000001c128611 transno 81604378775 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2000/0x30fd811c0305bb50 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.655219:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2000/0x30fd811c0305bb50 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.655225:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xe44515a3 (ffff968983653a00) 00010000:00010000:2.0:1780997298.655233:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.655237:0:65272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780997298.655328:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb42 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f0b expref: 26 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.655343:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bb57 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f0b expref: 25 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.655351:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff968983653400) 00010000:00010000:2.0:1780997298.655353:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997298.655355:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2600, rc 0) 00000100:00100000:2.0:1780997298.655447:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+26:72804:x1867507110433536:12345-192.168.206.51@tcp:101:touch.0 Request processed in 5429us (5946us total) trans 81604378775 rc 0/0 00000100:00100000:2.0:1780997298.655457:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1472 00000100:00100000:3.0:1780997298.665513:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.665633:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110433792 00000100:00100000:2.0:1780997298.665646:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110433792 00000100:00100000:2.0:1780997298.665706:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1473 00000100:00100000:2.0:1780997298.665717:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+26:72804:x1867507110433792:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:2.0:1780997298.665779:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997298.665823:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bb57 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f0b expref: 26 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.665841:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff968983653400) 00010000:00010000:2.0:1780997298.665852:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997298.665916:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb65 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.665929:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb65 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.665951:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb65 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.666064:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000eb708a9 reply state 0000000016c4584b transno 81604378776 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb65 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.666076:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb65 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.666082:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff968983653e00) 00010000:00010000:2.0:1780997298.666084:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.666086:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997298.666174:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:72804:x1867507110433792:12345-192.168.206.51@tcp:36:touch.0 Request processed in 459us (671us total) trans 81604378776 rc 0/0 00000100:00100000:2.0:1780997298.666181:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1473 00000100:00100000:1.0:1780997298.670790:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.670948:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110433920 00000100:00100000:3.0:1780997298.670959:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110433920 00000100:00100000:3.0:1780997298.671015:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1474 00000100:00100000:3.0:1780997298.671025:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:72804:x1867507110433920:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:3.0:1780997298.671054:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997298.671076:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1400/0x30fd811c0305bb6c lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f12 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.671132:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1400/0x30fd811c0305bb6c lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f12 expref: 28 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.671163:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1400/0x30fd811c0305bb6c lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f12 expref: 28 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.671183:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff968983653e00) 00010000:00010000:3.0:1780997298.671185:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780997298.671189:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1400, rc 0) 00000100:00100000:3.0:1780997298.671258:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+28:72804:x1867507110433920:12345-192.168.206.51@tcp:101:touch.0 Request processed in 235us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.671266:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1474 00000100:00100000:3.0:1780997298.680584:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.681111:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110434048 00000100:00100000:0.0:1780997298.681122:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110434048 00000100:00100000:0.0:1780997298.683497:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5983 00000100:00100000:0.0:1780997298.683516:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2395:x1867507110434048:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:0.0:1780997298.683823:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110434048:12345-192.168.206.51@tcp:2:touch.0 Request processed in 313us (3246us total) trans 4294969458 rc 0/0 00000100:00100000:0.0:1780997298.683832:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5983 00000100:00100000:2.0:1780997298.688410:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.688740:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110434304 00000100:00100000:1.0:1780997298.688750:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110434304 00000100:00100000:1.0:1780997298.688816:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 245 00000100:00100000:1.0:1780997298.688826:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889fe4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+28:72804:x1867507110434304:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:1.0:1780997298.689123:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889fe4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:72804:x1867507110434304:12345-192.168.206.51@tcp:35:touch.0 Request processed in 297us (720us total) trans 81604378777 rc 0/0 00000100:00100000:1.0:1780997298.689130:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 245 00000100:00100000:2.0:1780997298.691713:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.691822:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110434560 00000100:00100000:0.0:1780997298.691832:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110434560 00000100:00100000:0.0:1780997298.691897:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1475 00000100:00100000:0.0:1780997298.691907:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:72804:x1867507110434560:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997298.691931:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997298.691950:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eec00/0x30fd811c0305bb73 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f19 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.692069:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bb7a lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.692084:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bb7a lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.692095:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bb7a lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.692109:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305bb81 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.692115:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305bb81 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.692121:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305bb81 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780997298.693652:0:63419:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x624:0x0], index 0: 0 00010000:00010000:0.0:1780997298.693816:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bb88 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.693831:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bb88 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.693841:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bb88 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.693888:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bb7a lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.693896:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bb7a lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.693903:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bb7a lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.693910:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bb7a lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.693916:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4eee00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997298.693920:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bb7a lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.693927:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bb7a lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.693939:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:0.0:1780997298.693942:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997298.693947:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bb7a lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.693964:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bb7a lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997298.693980:0:63419:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f802245 reply state 000000004dca430a transno 81604378778 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305bb81 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.693990:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305bb81 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.693997:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x2c9ecea3 (ffff96898d864600) 00010000:00010000:0.0:1780997298.693999:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997298.694002:0:63419:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780997298.694034:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eec00/0x30fd811c0305bb73 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f19 expref: 32 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.694048:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bb88 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f19 expref: 31 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.694055:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff96898d864e00) 00010000:00010000:0.0:1780997298.694057:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780997298.694060:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ef000, rc 0) 00000100:00100000:0.0:1780997298.694133:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+32:72804:x1867507110434560:12345-192.168.206.51@tcp:101:touch.0 Request processed in 2226us (2428us total) trans 81604378778 rc 0/0 00000100:00100000:0.0:1780997298.694142:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1475 00000100:00100000:0.0:1780997298.733250:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.733696:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110434816 00000100:00100000:1.0:1780997298.733710:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110434816 00000100:00100000:1.0:1780997298.733768:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1476 00000100:00100000:1.0:1780997298.733779:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+32:72804:x1867507110434816:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:1.0:1780997298.733858:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997298.733895:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bb88 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f19 expref: 32 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.733915:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff96898d864e00) 00010000:00010000:1.0:1780997298.733927:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780997298.733994:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bb96 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.734008:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bb96 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.734020:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bb96 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997298.734131:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f29559c reply state 00000000d966343f transno 81604378779 ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bb96 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.734143:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bb96 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.734149:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff9689896fe500) 00010000:00010000:1.0:1780997298.734151:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997298.734153:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780997298.734251:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+33:72804:x1867507110434816:12345-192.168.206.51@tcp:36:touch.0 Request processed in 473us (1011us total) trans 81604378779 rc 0/0 00000100:00100000:1.0:1780997298.734258:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1476 00000100:00100000:2.0:1780997298.742111:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.751241:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110434944 00000100:00100000:3.0:1780997298.751256:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110434944 00000100:00100000:3.0:1780997298.751350:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1477 00000100:00100000:3.0:1780997298.751362:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+33:72804:x1867507110434944:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:3.0:1780997298.751404:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997298.751425:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1a00/0x30fd811c0305bb9d lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f20 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.751482:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1a00/0x30fd811c0305bb9d lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f20 expref: 34 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.751498:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1a00/0x30fd811c0305bb9d lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f20 expref: 34 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.751515:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff9689896fe500) 00010000:00010000:3.0:1780997298.751532:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780997298.751536:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1a00, rc 0) 00000100:00100000:3.0:1780997298.751605:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+34:72804:x1867507110434944:12345-192.168.206.51@tcp:101:touch.0 Request processed in 246us (9505us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.751613:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1477 00000100:00100000:3.0:1780997298.759105:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.764596:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110435072 00000100:00100000:2.0:1780997298.764617:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110435072 00000100:00100000:2.0:1780997298.764702:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5984 00000100:00100000:2.0:1780997298.764714:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd01ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110435072:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:2.0:1780997298.764982:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd01ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2395:x1867507110435072:12345-192.168.206.51@tcp:2:touch.0 Request processed in 270us (5888us total) trans 4294969459 rc 0/0 00000100:00100000:2.0:1780997298.764990:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5984 00000100:00100000:1.0:1780997298.769138:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.770054:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110435328 00000100:00100000:2.0:1780997298.770065:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110435328 00000100:00100000:2.0:1780997298.770133:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 246 00000100:00100000:2.0:1780997298.770161:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+34:72804:x1867507110435328:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:2.0:1780997298.770517:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+35:72804:x1867507110435328:12345-192.168.206.51@tcp:35:touch.0 Request processed in 358us (1388us total) trans 81604378780 rc 0/0 00000100:00100000:2.0:1780997298.770526:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 246 00000100:00100000:3.0:1780997298.773408:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.774035:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110435584 00000100:00100000:2.0:1780997298.774046:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110435584 00000100:00100000:2.0:1780997298.774106:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1478 00000100:00100000:2.0:1780997298.774117:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+35:72804:x1867507110435584:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:2.0:1780997298.774141:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997298.774162:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bba4 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f27 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.774315:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbab lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.774334:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbab lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.774345:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbab lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.774359:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2400/0x30fd811c0305bbb2 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.774365:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2400/0x30fd811c0305bbb2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.774371:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2400/0x30fd811c0305bbb2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780997298.774708:0:65272:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x625:0x0], index 0: 0 00010000:00010000:2.0:1780997298.774841:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbb9 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.774849:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbb9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.774856:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbb9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.774898:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbab lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.774905:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbab lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.774911:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbab lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.774917:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbab lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.774922:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997298.774926:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbab lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.775339:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbab lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.775357:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:2.0:1780997298.775360:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997298.775376:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbab lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.775383:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbab lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.775399:0:65272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a5f6d3d reply state 00000000039b5c38 transno 81604378781 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2400/0x30fd811c0305bbb2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.775410:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2400/0x30fd811c0305bbb2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.775416:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x74f887a3 (ffff968983653400) 00010000:00010000:2.0:1780997298.775419:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.775421:0:65272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780997298.775454:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bba4 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f27 expref: 38 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.775468:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbb9 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f27 expref: 37 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.775475:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff968983653f00) 00010000:00010000:2.0:1780997298.775478:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997298.775480:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3200, rc 0) 00000100:00100000:2.0:1780997298.775598:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+38:72804:x1867507110435584:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1482us (2197us total) trans 81604378781 rc 0/0 00000100:00100000:2.0:1780997298.775607:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1478 00000100:00100000:1.0:1780997298.795633:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.795759:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110435840 00000100:00100000:2.0:1780997298.795769:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110435840 00000100:00100000:2.0:1780997298.795956:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1479 00000100:00100000:2.0:1780997298.795968:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+38:72804:x1867507110435840:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:2.0:1780997298.796044:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997298.796071:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbb9 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f27 expref: 38 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.796088:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff968983653f00) 00010000:00010000:2.0:1780997298.796098:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997298.796145:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bbc7 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.796157:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bbc7 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.796168:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bbc7 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.796656:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bbb8491a reply state 00000000557fb46a transno 81604378782 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bbc7 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.796668:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bbc7 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.796674:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff968983653c00) 00010000:00010000:2.0:1780997298.796677:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.796679:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997298.796898:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+39:72804:x1867507110435840:12345-192.168.206.51@tcp:36:touch.0 Request processed in 932us (1274us total) trans 81604378782 rc 0/0 00000100:00100000:2.0:1780997298.796906:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1479 00000100:00100000:1.0:1780997298.799923:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.800025:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110435968 00000100:00100000:3.0:1780997298.800037:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110435968 00000100:00100000:3.0:1780997298.800103:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1480 00000100:00100000:3.0:1780997298.800114:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+39:72804:x1867507110435968:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:3.0:1780997298.800144:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997298.800166:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1000/0x30fd811c0305bbce lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f2e expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.800574:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1000/0x30fd811c0305bbce lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f2e expref: 40 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.800592:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1000/0x30fd811c0305bbce lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f2e expref: 40 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.800608:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff968983653c00) 00010000:00010000:3.0:1780997298.800611:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780997298.800614:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1000, rc 0) 00000100:00100000:3.0:1780997298.800677:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+40:72804:x1867507110435968:12345-192.168.206.51@tcp:101:touch.0 Request processed in 565us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.800684:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1480 00000100:00100000:3.0:1780997298.804967:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.805124:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110436096 00000100:00100000:0.0:1780997298.805133:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110436096 00000100:00100000:0.0:1780997298.805208:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5985 00000100:00100000:0.0:1780997298.805245:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2394:x1867507110436096:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:2.0:1780997298.805814:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2394:x1867507110436096:12345-192.168.206.51@tcp:2:touch.0 Request processed in 561us (844us total) trans 4294969460 rc 0/0 00000100:00100000:2.0:1780997298.805824:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5985 00000100:00100000:1.0:1780997298.809145:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.809389:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110436352 00000100:00100000:2.0:1780997298.809400:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110436352 00000100:00100000:2.0:1780997298.809457:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 247 00000100:00100000:2.0:1780997298.809468:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+40:72804:x1867507110436352:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:2.0:1780997298.809777:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+41:72804:x1867507110436352:12345-192.168.206.51@tcp:35:touch.0 Request processed in 311us (641us total) trans 81604378783 rc 0/0 00000100:00100000:2.0:1780997298.809786:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 247 00000100:00100000:1.0:1780997298.814163:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.814506:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110436608 00000100:00100000:2.0:1780997298.814517:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110436608 00000100:00100000:2.0:1780997298.814586:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1481 00000100:00100000:2.0:1780997298.814597:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+41:72804:x1867507110436608:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:2.0:1780997298.814621:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997298.814642:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbd5 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f35 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.814743:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbdc lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.814758:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbdc lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.814769:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbdc lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.814782:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2800/0x30fd811c0305bbe3 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.814790:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2800/0x30fd811c0305bbe3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.814946:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2800/0x30fd811c0305bbe3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780997298.818161:0:63419:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x626:0x0], index 0: 0 00010000:00010000:2.0:1780997298.819166:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bbea lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819458:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bbea lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819472:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bbea lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819512:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbdc lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819519:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbdc lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819524:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbdc lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819530:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbdc lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819536:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997298.819541:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbdc lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819548:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbdc lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819575:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:2.0:1780997298.819579:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997298.819583:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbdc lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819590:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bbdc lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.819606:0:63419:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000018e659c2 reply state 0000000082e544c2 transno 81604378784 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2800/0x30fd811c0305bbe3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819617:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2800/0x30fd811c0305bbe3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819624:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xbd5240a3 (ffff968983653f00) 00010000:00010000:2.0:1780997298.819627:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.819629:0:63419:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780997298.819666:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbd5 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f35 expref: 44 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819681:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bbea lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f35 expref: 43 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.819687:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff968983653600) 00010000:00010000:2.0:1780997298.819690:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997298.819692:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3000, rc 0) 00000100:00100000:2.0:1780997298.819821:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+44:72804:x1867507110436608:12345-192.168.206.51@tcp:101:touch.0 Request processed in 5226us (5669us total) trans 81604378784 rc 0/0 00000100:00100000:2.0:1780997298.819830:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1481 00000100:00100000:0.0:1780997298.826548:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.826650:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110436864 00000100:00100000:2.0:1780997298.826662:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110436864 00000100:00100000:2.0:1780997298.826732:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1482 00000100:00100000:2.0:1780997298.826744:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+44:72804:x1867507110436864:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:2.0:1780997298.826806:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997298.826835:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bbea lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f35 expref: 44 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.826853:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff968983653600) 00010000:00010000:2.0:1780997298.826864:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997298.826933:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbf8 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.826948:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbf8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.826960:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbf8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.827086:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006b01b2e2 reply state 00000000df081c32 transno 81604378785 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbf8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.827098:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbf8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.827103:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff968983653700) 00010000:00010000:2.0:1780997298.827106:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.827108:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997298.827208:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+45:72804:x1867507110436864:12345-192.168.206.51@tcp:36:touch.0 Request processed in 466us (669us total) trans 81604378785 rc 0/0 00000100:00100000:2.0:1780997298.827240:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1482 00000100:00100000:1.0:1780997298.831540:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.831736:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110436992 00000100:00100000:0.0:1780997298.831747:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110436992 00000100:00100000:0.0:1780997298.831810:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1483 00000100:00100000:0.0:1780997298.831821:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+45:72804:x1867507110436992:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997298.831844:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997298.831865:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee200/0x30fd811c0305bbff lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f3c expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.831932:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee200/0x30fd811c0305bbff lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f3c expref: 46 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.831947:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee200/0x30fd811c0305bbff lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f3c expref: 46 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.831965:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff968983653700) 00010000:00010000:0.0:1780997298.831969:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780997298.831972:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ee200, rc 0) 00000100:00100000:0.0:1780997298.832033:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+46:72804:x1867507110436992:12345-192.168.206.51@tcp:101:touch.0 Request processed in 213us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.832040:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1483 00000100:00100000:2.0:1780997298.840370:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.840469:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110437120 00000100:00100000:0.0:1780997298.840480:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110437120 00000100:00100000:0.0:1780997298.840538:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5986 00000100:00100000:0.0:1780997298.840548:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2395:x1867507110437120:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:0.0:1780997298.840799:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2395:x1867507110437120:12345-192.168.206.51@tcp:2:touch.0 Request processed in 252us (438us total) trans 4294969461 rc 0/0 00000100:00100000:0.0:1780997298.840807:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5986 00000100:00100000:0.0:1780997298.845175:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.845319:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110437376 00000100:00100000:2.0:1780997298.845329:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110437376 00000100:00100000:2.0:1780997298.845381:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 248 00000100:00100000:2.0:1780997298.845390:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+46:72804:x1867507110437376:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:2.0:1780997298.845639:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+47:72804:x1867507110437376:12345-192.168.206.51@tcp:35:touch.0 Request processed in 249us (472us total) trans 81604378786 rc 0/0 00000100:00100000:2.0:1780997298.845646:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 248 00000100:00100000:3.0:1780997298.859961:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.860134:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110437632 00000100:00100000:2.0:1780997298.860146:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110437632 00000100:00100000:2.0:1780997298.860220:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1484 00000100:00100000:2.0:1780997298.860230:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+47:72804:x1867507110437632:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:2.0:1780997298.860253:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997298.860312:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc06 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f43 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.860437:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc0d lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.860453:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc0d lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.860464:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc0d lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.860480:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bc14 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.860494:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bc14 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.860501:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bc14 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780997298.861101:0:65272:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x627:0x0], index 0: 0 00010000:00010000:2.0:1780997298.861320:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bc1b lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861330:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bc1b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861337:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bc1b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861366:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc0d lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861372:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc0d lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861378:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc0d lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861384:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc0d lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861389:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997298.861393:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc0d lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861410:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc0d lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861421:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:2.0:1780997298.861424:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997298.861429:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc0d lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861435:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc0d lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.861449:0:65272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029df970f reply state 000000005da0ddfa transno 81604378787 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bc14 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861459:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bc14 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861464:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x5abf9a3 (ffff968983653600) 00010000:00010000:2.0:1780997298.861466:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.861468:0:65272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780997298.861498:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc06 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f43 expref: 50 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861512:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bc1b lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f43 expref: 49 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.861518:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff968983653000) 00010000:00010000:2.0:1780997298.861521:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997298.861523:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2e00, rc 0) 00000100:00100000:2.0:1780997298.861716:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+50:72804:x1867507110437632:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1487us (1882us total) trans 81604378787 rc 0/0 00000100:00100000:2.0:1780997298.861725:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1484 00000100:00100000:0.0:1780997298.874914:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.875073:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110437888 00000100:00100000:2.0:1780997298.875084:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110437888 00000100:00100000:2.0:1780997298.875143:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1485 00000100:00100000:2.0:1780997298.875154:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+50:72804:x1867507110437888:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:2.0:1780997298.875211:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997298.875236:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bc1b lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f43 expref: 50 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.875253:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff968983653000) 00010000:00010000:2.0:1780997298.875264:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997298.875357:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc29 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.875371:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc29 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.875380:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc29 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.875490:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001cae7375 reply state 000000004bfb079a transno 81604378788 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc29 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.875502:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc29 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.875507:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff968983653d00) 00010000:00010000:2.0:1780997298.875509:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.875526:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997298.875617:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:72804:x1867507110437888:12345-192.168.206.51@tcp:36:touch.0 Request processed in 464us (710us total) trans 81604378788 rc 0/0 00000100:00100000:2.0:1780997298.875625:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1485 00000100:00100000:1.0:1780997298.885782:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.885955:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110438016 00000100:00100000:3.0:1780997298.885966:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110438016 00000100:00100000:3.0:1780997298.886029:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1486 00000100:00100000:3.0:1780997298.886040:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:72804:x1867507110438016:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:3.0:1780997298.886069:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997298.886090:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1800/0x30fd811c0305bc30 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f4a expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.886145:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1800/0x30fd811c0305bc30 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f4a expref: 52 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.886159:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1800/0x30fd811c0305bc30 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f4a expref: 52 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.886177:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff968983653d00) 00010000:00010000:3.0:1780997298.886180:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780997298.886183:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1800, rc 0) 00000100:00100000:3.0:1780997298.886545:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:72804:x1867507110438016:12345-192.168.206.51@tcp:101:touch.0 Request processed in 506us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.886552:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1486 00000100:00100000:3.0:1780997298.892156:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.892366:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110438144 00000100:00100000:1.0:1780997298.892380:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110438144 00000100:00100000:1.0:1780997298.892503:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5987 00000100:00100000:1.0:1780997298.892516:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2397:x1867507110438144:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:1.0:1780997298.892755:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2397:x1867507110438144:12345-192.168.206.51@tcp:2:touch.0 Request processed in 242us (609us total) trans 4294969462 rc 0/0 00000100:00100000:1.0:1780997298.892762:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5987 00000100:00100000:2.0:1780997298.895791:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.896051:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110438400 00000100:00100000:1.0:1780997298.896060:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110438400 00000100:00100000:1.0:1780997298.896117:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 249 00000100:00100000:1.0:1780997298.896127:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:72804:x1867507110438400:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:0.0:1780997298.901562:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+53:72804:x1867507110438400:12345-192.168.206.51@tcp:35:touch.0 Request processed in 5424us (5767us total) trans 81604378789 rc 0/0 00000100:00100000:0.0:1780997298.901576:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 249 00000100:00100000:0.0:1780997298.909759:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.910075:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110438656 00000100:00100000:2.0:1780997298.910088:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110438656 00000100:00100000:2.0:1780997298.910159:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1487 00000100:00100000:2.0:1780997298.910171:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+53:72804:x1867507110438656:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:2.0:1780997298.910199:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997298.910221:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc37 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f51 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.910371:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bc3e lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.910388:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bc3e lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.910402:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bc3e lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.910418:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2a00/0x30fd811c0305bc45 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.910426:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2a00/0x30fd811c0305bc45 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.910433:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2a00/0x30fd811c0305bc45 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780997298.910778:0:63419:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x628:0x0], index 0: 0 00010000:00010000:2.0:1780997298.911257:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bc4c lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911292:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bc4c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911302:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bc4c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911339:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bc3e lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911348:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bc3e lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911354:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bc3e lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911361:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bc3e lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911366:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997298.911371:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bc3e lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911379:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bc3e lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911391:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:2.0:1780997298.911395:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997298.911407:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bc3e lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911414:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bc3e lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.911428:0:63419:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000892c754a reply state 00000000fe62f290 transno 81604378790 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2a00/0x30fd811c0305bc45 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911440:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2a00/0x30fd811c0305bc45 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911447:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x4e05b2a3 (ffff968983653000) 00010000:00010000:2.0:1780997298.911449:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.911451:0:63419:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780997298.911481:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc37 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f51 expref: 56 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911496:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bc4c lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f51 expref: 55 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.911504:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff968983653300) 00010000:00010000:2.0:1780997298.911507:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997298.911509:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb2e00, rc 0) 00000100:00100000:2.0:1780997298.911644:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+56:72804:x1867507110438656:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1474us (1897us total) trans 81604378790 rc 0/0 00000100:00100000:2.0:1780997298.911653:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1487 00010000:00010000:0.0:1780997298.917497:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997298.918831:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.918981:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110438912 00000100:00100000:2.0:1780997298.918991:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110438912 00000100:00100000:2.0:1780997298.919051:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1488 00000100:00100000:2.0:1780997298.919062:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+56:72804:x1867507110438912:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:2.0:1780997298.919138:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997298.919163:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bc4c lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f51 expref: 56 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.919179:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff968983653300) 00010000:00010000:2.0:1780997298.919189:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997298.919237:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc5a lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.919252:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc5a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.919262:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc5a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.919395:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e383f11a reply state 0000000009e3b718 transno 81604378791 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc5a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.919408:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc5a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.919413:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff968983653200) 00010000:00010000:2.0:1780997298.919416:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.919418:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997298.919507:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+57:72804:x1867507110438912:12345-192.168.206.51@tcp:36:touch.0 Request processed in 446us (683us total) trans 81604378791 rc 0/0 00000100:00100000:2.0:1780997298.919515:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1488 00000100:00100000:0.0:1780997298.921959:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.922136:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110439040 00000100:00100000:3.0:1780997298.922147:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110439040 00000100:00100000:3.0:1780997298.922436:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1489 00000100:00100000:3.0:1780997298.922447:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+57:72804:x1867507110439040:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:3.0:1780997298.922485:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997298.922506:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1200/0x30fd811c0305bc61 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f58 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.922560:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1200/0x30fd811c0305bc61 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f58 expref: 58 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.922575:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1200/0x30fd811c0305bc61 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f58 expref: 58 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.922592:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff968983653200) 00010000:00010000:3.0:1780997298.922594:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780997298.922598:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1200, rc 0) 00000100:00100000:3.0:1780997298.922663:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+58:72804:x1867507110439040:12345-192.168.206.51@tcp:101:touch.0 Request processed in 219us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.922670:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1489 00000100:00100000:3.0:1780997298.930393:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.930483:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110439168 00000100:00100000:1.0:1780997298.930492:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110439168 00000100:00100000:1.0:1780997298.930547:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5988 00000100:00100000:1.0:1780997298.930557:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2395:x1867507110439168:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:1.0:1780997298.930772:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:2395:x1867507110439168:12345-192.168.206.51@tcp:2:touch.0 Request processed in 215us (387us total) trans 4294969463 rc 0/0 00000100:00100000:1.0:1780997298.930780:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5988 00000100:00100000:1.0:1780997298.932941:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.933024:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110439424 00000100:00100000:3.0:1780997298.933034:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110439424 00000100:00100000:3.0:1780997298.933116:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 250 00000100:00100000:3.0:1780997298.933125:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+58:72804:x1867507110439424:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:3.0:1780997298.933443:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+59:72804:x1867507110439424:12345-192.168.206.51@tcp:35:touch.0 Request processed in 318us (509us total) trans 81604378792 rc 0/0 00000100:00100000:3.0:1780997298.933451:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 250 00000100:00100000:0.0:1780997298.935955:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.936079:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110439680 00000100:00100000:3.0:1780997298.936088:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110439680 00000100:00100000:3.0:1780997298.936159:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1490 00000100:00100000:3.0:1780997298.936168:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc63aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+59:72804:x1867507110439680:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:3.0:1780997298.936365:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997298.936386:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bc68 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f5f expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.936485:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bc6f lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.936500:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bc6f lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.936511:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bc6f lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.936525:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bc76 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.936533:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bc76 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.936539:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bc76 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780997298.936835:0:65272:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x629:0x0], index 0: 0 00010000:00010000:3.0:1780997298.937148:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305bc7d lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937158:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305bc7d lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937166:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305bc7d lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937298:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bc6f lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937306:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bc6f lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937312:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bc6f lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937318:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bc6f lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937324:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997298.937329:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bc6f lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937336:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bc6f lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937347:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:3.0:1780997298.937350:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997298.937355:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bc6f lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937361:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bc6f lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997298.937374:0:65272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a0584fd reply state 0000000099a8482e transno 81604378793 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bc76 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937385:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bc76 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937397:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x965f6ba3 (ffff96898712d300) 00010000:00010000:3.0:1780997298.937399:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997298.937401:0:65272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1780997298.937430:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bc68 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f5f expref: 62 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937444:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305bc7d lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f5f expref: 61 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997298.937452:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xe:0x0].0x0 (ffff96898712d200) 00010000:00010000:3.0:1780997298.937454:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780997298.937456:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968980031a00, rc 0) 00000100:00100000:3.0:1780997298.937530:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc63aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+62:72804:x1867507110439680:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1363us (1693us total) trans 81604378793 rc 0/0 00000100:00100000:3.0:1780997298.937537:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1490 00000100:00100000:1.0:1780997298.940045:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.940286:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110439936 00000100:00100000:0.0:1780997298.940296:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110439936 00000100:00100000:0.0:1780997298.940355:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1491 00000100:00100000:0.0:1780997298.940364:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+62:72804:x1867507110439936:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:0.0:1780997298.940417:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997298.940441:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305bc7d lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f5f expref: 62 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.940459:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xe:0x0].0x0 (ffff96898712d200) 00010000:00010000:0.0:1780997298.940471:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997298.940520:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bc8b lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.940533:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bc8b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.940559:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bc8b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997298.940664:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2e93b4c reply state 0000000068ba7cb7 transno 81604378794 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bc8b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.940676:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bc8b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.940682:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xe:0x0].0x0 (ffff96898d864f00) 00010000:00010000:0.0:1780997298.940685:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997298.940687:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997298.940770:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+63:72804:x1867507110439936:12345-192.168.206.51@tcp:36:touch.0 Request processed in 406us (734us total) trans 81604378794 rc 0/0 00000100:00100000:0.0:1780997298.940777:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1491 00000100:00100000:1.0:1780997298.942722:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.942825:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110440064 00000100:00100000:0.0:1780997298.942835:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110440064 00000100:00100000:0.0:1780997298.942978:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1492 00000100:00100000:0.0:1780997298.942988:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+63:72804:x1867507110440064:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997298.943009:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997298.943029:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eec00/0x30fd811c0305bc92 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f66 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.943077:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eec00/0x30fd811c0305bc92 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f66 expref: 64 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.943091:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eec00/0x30fd811c0305bc92 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f66 expref: 64 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.943125:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xe:0x0].0x0 (ffff96898d864f00) 00010000:00010000:0.0:1780997298.943128:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780997298.943131:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4eec00, rc 0) 00000100:00100000:0.0:1780997298.943219:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+64:72804:x1867507110440064:12345-192.168.206.51@tcp:101:touch.0 Request processed in 232us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.943226:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1492 00000100:00100000:2.0:1780997298.945533:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.945614:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110440192 00000100:00100000:3.0:1780997298.945624:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110440192 00000100:00100000:3.0:1780997298.945720:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5989 00000100:00100000:3.0:1780997298.945731:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:2397:x1867507110440192:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:3.0:1780997298.946000:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:2397:x1867507110440192:12345-192.168.206.51@tcp:2:touch.0 Request processed in 270us (473us total) trans 4294969464 rc 0/0 00000100:00100000:3.0:1780997298.946008:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5989 00000100:00100000:1.0:1780997298.948230:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.948342:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.948366:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997298.948426:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110440448 00000100:00100000:2.0:1780997298.948436:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110440448 00000100:00100000:2.0:1780997298.948533:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1423 00000100:00100000:2.0:1780997298.948543:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2396:x1867507110440448:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997298.948614:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110440320 00000100:00100000:2.0:1780997298.948616:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2396:x1867507110440448:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 74us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.948620:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110440320 00000100:00100000:2.0:1780997298.948628:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1423 00000100:00100000:3.0:1780997298.948657:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00100000:3.0:1780997298.948665:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2396:x1867507110440320:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997298.948668:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110440576 00000100:00100000:0.0:1780997298.948673:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110440576 00000100:00100000:3.0:1780997298.948704:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2396:x1867507110440320:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 40us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997298.948711:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00100000:0.0:1780997298.948712:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2702 00000100:00100000:0.0:1780997298.948719:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110440576:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997298.948740:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.948749:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110440576:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.948756:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2702 00000100:00100000:3.0:1780997298.948767:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110440832 00000100:00100000:3.0:1780997298.948771:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110440832 00000100:00080000:0.0:1780997298.948773:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997298.948808:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 251 00000100:00100000:3.0:1780997298.948817:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+64:72804:x1867507110440832:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:3.0:1780997298.949801:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+65:72804:x1867507110440832:12345-192.168.206.51@tcp:35:touch.0 Request processed in 981us (1057us total) trans 81604378795 rc 0/0 00000100:00100000:3.0:1780997298.949811:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 251 00000100:00100000:1.0:1780997298.952338:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.953145:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110441088 00000100:00100000:0.0:1780997298.953157:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110441088 00000100:00100000:0.0:1780997298.953221:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1493 00000100:00100000:0.0:1780997298.953242:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+65:72804:x1867507110441088:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997298.953297:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997298.953318:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bc99 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f6d expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.953432:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bca0 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.953448:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bca0 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.953474:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bca0 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.953492:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305bca7 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.953499:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305bca7 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.953506:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305bca7 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780997298.953854:0:63418:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x62a:0x0], index 0: 0 00010000:00010000:0.0:1780997298.954002:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305bcae lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954011:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305bcae lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954018:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305bcae lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954047:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bca0 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954054:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bca0 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954059:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bca0 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954066:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bca0 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954077:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997298.954081:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bca0 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954087:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bca0 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954099:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:0.0:1780997298.954102:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997298.954108:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bca0 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954115:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bca0 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997298.954128:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003dc4dcc8 reply state 00000000db0813c4 transno 81604378796 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305bca7 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954138:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305bca7 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954144:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xdeb924a3 (ffff96898d864e00) 00010000:00010000:0.0:1780997298.954146:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997298.954148:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780997298.954182:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bc99 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f6d expref: 68 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954196:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305bcae lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f6d expref: 67 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.954212:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xf:0x0].0x0 (ffff96898d864700) 00010000:00010000:0.0:1780997298.954214:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780997298.954217:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4eea00, rc 0) 00000100:00100000:0.0:1780997298.954319:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+68:72804:x1867507110441088:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1080us (1988us total) trans 81604378796 rc 0/0 00000100:00100000:0.0:1780997298.954327:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1493 00000100:00100000:1.0:1780997298.957616:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.957735:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110441344 00000100:00100000:3.0:1780997298.957747:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110441344 00000100:00100000:3.0:1780997298.959497:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1494 00000100:00100000:3.0:1780997298.959525:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+68:72804:x1867507110441344:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:2.0:1780997298.960234:0:80049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997298.960291:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305bcae lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f6d expref: 68 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.960319:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xf:0x0].0x0 (ffff96898d864700) 00010000:00010000:2.0:1780997298.960334:0:80049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997298.960471:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bcbc lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.960485:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bcbc lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.960497:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bcbc lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997298.960602:0:80049:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000303609ba reply state 000000009dcf66f9 transno 81604378797 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bcbc lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.960616:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bcbc lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997298.960623:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xf:0x0].0x0 (ffff968983653300) 00010000:00010000:2.0:1780997298.960626:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997298.960629:0:80049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997298.960782:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+69:72804:x1867507110441344:12345-192.168.206.51@tcp:36:touch.0 Request processed in 1270us (3178us total) trans 81604378797 rc 0/0 00000100:00100000:2.0:1780997298.960805:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1494 00000100:00100000:2.0:1780997298.966500:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.966978:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110441472 00000100:00100000:1.0:1780997298.966988:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110441472 00000100:00100000:1.0:1780997298.967049:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1495 00000100:00100000:1.0:1780997298.967209:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+69:72804:x1867507110441472:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997298.967235:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997298.967260:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9a00/0x30fd811c0305bcc3 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f74 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.967786:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9a00/0x30fd811c0305bcc3 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f74 expref: 70 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.967801:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9a00/0x30fd811c0305bcc3 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f74 expref: 70 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.967818:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xf:0x0].0x0 (ffff968983653300) 00010000:00010000:1.0:1780997298.967821:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1780997298.967825:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9a00, rc 0) 00000100:00100000:1.0:1780997298.967933:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+70:72804:x1867507110441472:12345-192.168.206.51@tcp:101:touch.0 Request processed in 728us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997298.967941:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1495 00000100:00100000:1.0:1780997298.972568:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997298.973138:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110441600 00000100:00100000:3.0:1780997298.973148:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110441600 00000100:00100000:3.0:1780997298.973203:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5990 00000100:00100000:3.0:1780997298.973214:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:2394:x1867507110441600:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:3.0:1780997298.973447:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:2394:x1867507110441600:12345-192.168.206.51@tcp:2:touch.0 Request processed in 235us (889us total) trans 4294969465 rc 0/0 00000100:00100000:3.0:1780997298.973455:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5990 00000100:00100000:3.0:1780997298.976673:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.976813:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110441856 00000100:00100000:0.0:1780997298.976822:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110441856 00000100:00100000:0.0:1780997298.976926:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 252 00000100:00100000:0.0:1780997298.976937:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+70:72804:x1867507110441856:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:0.0:1780997298.977227:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+71:72804:x1867507110441856:12345-192.168.206.51@tcp:35:touch.0 Request processed in 291us (561us total) trans 81604378798 rc 0/0 00000100:00100000:0.0:1780997298.977236:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 252 00000100:00100000:2.0:1780997298.980710:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997298.980865:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110442112 00000100:00100000:1.0:1780997298.980884:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110442112 00000100:00100000:1.0:1780997298.981004:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1496 00000100:00100000:1.0:1780997298.981014:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+71:72804:x1867507110442112:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997298.981036:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997298.981056:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305bcca lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f7b expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981160:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bcd1 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981176:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bcd1 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981199:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bcd1 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981215:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bcd8 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981222:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bcd8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981228:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bcd8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780997298.981561:0:63584:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x62b:0x0], index 0: 0 00010000:00010000:1.0:1780997298.981691:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bcdf lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981701:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bcdf lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981708:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bcdf lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981750:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bcd1 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981757:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bcd1 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981764:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bcd1 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981771:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bcd1 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981777:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997298.981781:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bcd1 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981787:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bcd1 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.981798:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:1.0:1780997298.981800:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997298.985438:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bcd1 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.985452:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bcd1 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997298.985480:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f2281ee reply state 0000000074047e2a transno 81604378799 ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bcd8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.985497:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bcd8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.985526:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x6e9b5ca3 (ffff9689896fe600) 00010000:00010000:1.0:1780997298.985529:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997298.985533:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780997298.985592:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305bcca lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f7b expref: 74 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.985611:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bcdf lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f7b expref: 73 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997298.985618:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x10:0x0].0x0 (ffff9689896fed00) 00010000:00010000:1.0:1780997298.985621:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997298.985623:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9000, rc 0) 00000100:00100000:1.0:1780997298.985861:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+74:72804:x1867507110442112:12345-192.168.206.51@tcp:101:touch.0 Request processed in 4846us (5157us total) trans 81604378799 rc 0/0 00000100:00100000:1.0:1780997298.985870:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1496 00000100:00100000:1.0:1780997298.991159:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.991258:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110442368 00000100:00100000:0.0:1780997298.991294:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110442368 00000100:00100000:0.0:1780997298.991355:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1497 00000100:00100000:0.0:1780997298.991366:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+74:72804:x1867507110442368:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:0.0:1780997298.991423:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997298.991449:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bcdf lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f7b expref: 74 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.991467:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x10:0x0].0x0 (ffff9689896fed00) 00010000:00010000:0.0:1780997298.991479:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997298.991530:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bced lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.991556:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bced lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.991565:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bced lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997298.991660:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007097c684 reply state 000000007c448d88 transno 81604378800 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bced lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.991669:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bced lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.991673:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x10:0x0].0x0 (ffff96898d864b00) 00010000:00010000:0.0:1780997298.991675:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997298.991677:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997298.991776:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+75:72804:x1867507110442368:12345-192.168.206.51@tcp:36:touch.0 Request processed in 412us (626us total) trans 81604378800 rc 0/0 00000100:00100000:0.0:1780997298.991787:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1497 00000100:00100000:2.0:1780997298.997937:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997298.998026:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110442496 00000100:00100000:0.0:1780997298.998036:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110442496 00000100:00100000:0.0:1780997298.998104:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1498 00000100:00100000:0.0:1780997298.998115:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+75:72804:x1867507110442496:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997298.998142:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997298.998165:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bcf4 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f82 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.998235:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bcf4 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f82 expref: 76 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.998321:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee000/0x30fd811c0305bcf4 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f82 expref: 76 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997298.998342:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x10:0x0].0x0 (ffff96898d864b00) 00010000:00010000:0.0:1780997298.998346:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780997298.998349:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ee000, rc 0) 00000100:00100000:0.0:1780997298.998410:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+76:72804:x1867507110442496:12345-192.168.206.51@tcp:101:touch.0 Request processed in 298us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997298.998417:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1498 00000100:00100000:3.0:1780997299.004872:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997299.004950:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110442624 00000100:00100000:2.0:1780997299.004961:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110442624 00000100:00100000:2.0:1780997299.005031:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5991 00000100:00100000:2.0:1780997299.005041:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:2394:x1867507110442624:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:2.0:1780997299.005501:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+15:2394:x1867507110442624:12345-192.168.206.51@tcp:2:touch.0 Request processed in 461us (636us total) trans 4294969466 rc 0/0 00000100:00100000:2.0:1780997299.005509:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5991 00000100:00100000:2.0:1780997299.011807:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997299.011912:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110442880 00000100:00100000:3.0:1780997299.011922:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110442880 00000100:00100000:3.0:1780997299.011993:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 253 00000100:00100000:3.0:1780997299.012003:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+76:72804:x1867507110442880:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:3.0:1780997299.012357:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+77:72804:x1867507110442880:12345-192.168.206.51@tcp:35:touch.0 Request processed in 354us (564us total) trans 81604378801 rc 0/0 00000100:00100000:3.0:1780997299.012366:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 253 00000100:00100000:1.0:1780997299.018791:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.019793:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110443136 00000100:00100000:0.0:1780997299.019967:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110443136 00000100:00100000:0.0:1780997299.020079:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1499 00000100:00100000:0.0:1780997299.020091:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+77:72804:x1867507110443136:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997299.020119:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997299.020144:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305bcfb lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f89 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.020261:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305bd02 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.020587:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305bd02 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.020604:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305bd02 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.020624:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305bd09 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.020658:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305bd09 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.020665:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305bd09 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780997299.021018:0:63418:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x62c:0x0], index 0: 0 00010000:00010000:0.0:1780997299.022302:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305bd10 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022320:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305bd10 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022329:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305bd10 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022366:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305bd02 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022374:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305bd02 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022381:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305bd02 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022388:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305bd02 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022394:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997299.022398:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305bd02 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022422:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305bd02 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022435:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:0.0:1780997299.022438:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997299.022443:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305bd02 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022450:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305bd02 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997299.022469:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008d30f671 reply state 000000003da5d0cd transno 81604378802 ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305bd09 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022479:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305bd09 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022485:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xc8545ca3 (ffff96898d864800) 00010000:00010000:0.0:1780997299.022487:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997299.022490:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780997299.022524:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305bcfb lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f89 expref: 80 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022537:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305bd10 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f89 expref: 79 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.022543:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x11:0x0].0x0 (ffff96898d864000) 00010000:00010000:0.0:1780997299.022544:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780997299.022547:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689c2054e00, rc 0) 00000100:00100000:0.0:1780997299.022680:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+80:72804:x1867507110443136:12345-192.168.206.51@tcp:101:touch.0 Request processed in 2590us (3965us total) trans 81604378802 rc 0/0 00000100:00100000:0.0:1780997299.022688:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1499 00000100:00100000:2.0:1780997299.026756:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.026843:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110443392 00000100:00100000:0.0:1780997299.026854:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110443392 00000100:00100000:0.0:1780997299.026926:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1500 00000100:00100000:0.0:1780997299.026937:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888917a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+80:72804:x1867507110443392:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:0.0:1780997299.026994:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997299.027021:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305bd10 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f89 expref: 80 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.027050:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x11:0x0].0x0 (ffff96898d864000) 00010000:00010000:0.0:1780997299.027068:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997299.027122:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bd1e lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.027136:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bd1e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.027145:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bd1e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997299.027260:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009123f131 reply state 00000000c404c70e transno 81604378803 ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bd1e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.027478:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bd1e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.027486:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x11:0x0].0x0 (ffff96898d864200) 00010000:00010000:0.0:1780997299.027488:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997299.027507:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997299.027652:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888917a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+81:72804:x1867507110443392:12345-192.168.206.51@tcp:36:touch.0 Request processed in 716us (904us total) trans 81604378803 rc 0/0 00000100:00100000:0.0:1780997299.027659:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1500 00000100:00100000:2.0:1780997299.031983:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.032078:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110443520 00000100:00100000:0.0:1780997299.032091:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110443520 00000100:00100000:0.0:1780997299.032155:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1501 00000100:00100000:0.0:1780997299.032166:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+81:72804:x1867507110443520:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997299.032195:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997299.032221:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955c00/0x30fd811c0305bd25 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f90 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.032307:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955c00/0x30fd811c0305bd25 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f90 expref: 82 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.032323:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955c00/0x30fd811c0305bd25 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f90 expref: 82 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.032343:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x11:0x0].0x0 (ffff96898d864200) 00010000:00010000:0.0:1780997299.032346:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780997299.032351:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955c00, rc 0) 00000100:00100000:0.0:1780997299.032401:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+82:72804:x1867507110443520:12345-192.168.206.51@tcp:101:touch.0 Request processed in 237us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997299.032408:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1501 00000100:00100000:1.0:1780997299.040855:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.041032:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110443648 00000100:00100000:0.0:1780997299.041042:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110443648 00000100:00100000:0.0:1780997299.041099:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5992 00000100:00100000:0.0:1780997299.041110:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+15:2396:x1867507110443648:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:0.0:1780997299.041428:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+16:2396:x1867507110443648:12345-192.168.206.51@tcp:2:touch.0 Request processed in 319us (580us total) trans 4294969467 rc 0/0 00000100:00100000:0.0:1780997299.041437:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5992 00000100:00100000:2.0:1780997299.047779:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997299.048018:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110443904 00000100:00100000:3.0:1780997299.048067:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110443904 00000100:00100000:3.0:1780997299.048179:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 254 00000100:00100000:3.0:1780997299.048190:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+82:72804:x1867507110443904:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:3.0:1780997299.048522:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+83:72804:x1867507110443904:12345-192.168.206.51@tcp:35:touch.0 Request processed in 333us (752us total) trans 81604378804 rc 0/0 00000100:00100000:3.0:1780997299.048530:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 254 00000100:00100000:2.0:1780997299.052397:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.052518:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110444160 00000100:00100000:1.0:1780997299.052528:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110444160 00000100:00100000:1.0:1780997299.052594:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1502 00000100:00100000:1.0:1780997299.052605:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+83:72804:x1867507110444160:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997299.052632:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997299.052653:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305bd2c lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f97 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.052758:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bd33 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.052787:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bd33 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.052798:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bd33 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.052886:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305bd3a lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.052896:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305bd3a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.052903:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305bd3a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780997299.053378:0:63584:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x62d:0x0], index 0: 0 00010000:00010000:1.0:1780997299.053976:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bd41 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.053988:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bd41 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.053997:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bd41 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.054141:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bd33 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.054150:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bd33 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.054156:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bd33 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.054172:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bd33 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.054225:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997299.054230:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bd33 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.054238:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bd33 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.054250:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:1.0:1780997299.054253:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997299.054259:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bd33 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.054266:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bd33 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997299.054305:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d8f73304 reply state 00000000993f8cbb transno 81604378805 ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305bd3a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.054315:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305bd3a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.054321:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x220d5ca3 (ffff9689896fe000) 00010000:00010000:1.0:1780997299.054324:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997299.054326:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780997299.054358:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305bd2c lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f97 expref: 86 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.054371:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bd41 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f97 expref: 85 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.054384:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x12:0x0].0x0 (ffff9689896fe400) 00010000:00010000:1.0:1780997299.054386:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997299.054388:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9800, rc 0) 00000100:00100000:1.0:1780997299.054513:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+86:72804:x1867507110444160:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1910us (2126us total) trans 81604378805 rc 0/0 00000100:00100000:1.0:1780997299.054521:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1502 00000100:00100000:1.0:1780997299.069665:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.069796:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110444416 00000100:00100000:0.0:1780997299.069806:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110444416 00000100:00100000:0.0:1780997299.069861:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1503 00000100:00100000:0.0:1780997299.069870:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+86:72804:x1867507110444416:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:0.0:1780997299.069934:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997299.069960:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bd41 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f97 expref: 86 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.069980:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x12:0x0].0x0 (ffff9689896fe400) 00010000:00010000:0.0:1780997299.069992:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997299.070044:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bd4f lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.070058:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bd4f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.070067:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bd4f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997299.070170:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c283780c reply state 00000000a6f071d0 transno 81604378806 ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bd4f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.070182:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bd4f lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.070189:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x12:0x0].0x0 (ffff96898d864000) 00010000:00010000:0.0:1780997299.070204:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997299.070207:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997299.070321:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+87:72804:x1867507110444416:12345-192.168.206.51@tcp:36:touch.0 Request processed in 451us (668us total) trans 81604378806 rc 0/0 00000100:00100000:0.0:1780997299.070329:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1503 00000100:00100000:2.0:1780997299.076140:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.076223:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110444544 00000100:00100000:0.0:1780997299.076235:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110444544 00000100:00100000:0.0:1780997299.076306:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1504 00000100:00100000:0.0:1780997299.076318:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+87:72804:x1867507110444544:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997299.076344:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997299.076368:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888954800/0x30fd811c0305bd56 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8f9e expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.076440:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954800/0x30fd811c0305bd56 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f9e expref: 88 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.076456:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954800/0x30fd811c0305bd56 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8f9e expref: 88 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.076474:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x12:0x0].0x0 (ffff96898d864000) 00010000:00010000:0.0:1780997299.076478:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780997299.076481:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954800, rc 0) 00000100:00100000:0.0:1780997299.076560:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+88:72804:x1867507110444544:12345-192.168.206.51@tcp:101:touch.0 Request processed in 244us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997299.076568:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1504 00000100:00100000:1.0:1780997299.082243:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.082608:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110444672 00000100:00100000:0.0:1780997299.082618:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110444672 00000100:00100000:0.0:1780997299.082665:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5993 00000100:00100000:0.0:1780997299.082688:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+16:2395:x1867507110444672:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:0.0:1780997299.082922:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+17:2395:x1867507110444672:12345-192.168.206.51@tcp:2:touch.0 Request processed in 235us (690us total) trans 4294969468 rc 0/0 00000100:00100000:0.0:1780997299.082929:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5993 00000100:00100000:2.0:1780997299.088513:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.088921:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110444928 00000100:00100000:0.0:1780997299.088931:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110444928 00000100:00100000:0.0:1780997299.088995:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 255 00000100:00100000:0.0:1780997299.089006:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+88:72804:x1867507110444928:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:0.0:1780997299.089345:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+89:72804:x1867507110444928:12345-192.168.206.51@tcp:35:touch.0 Request processed in 340us (841us total) trans 81604378807 rc 0/0 00000100:00100000:0.0:1780997299.089354:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 255 00000100:00100000:3.0:1780997299.091925:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.092871:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110445184 00000100:00100000:0.0:1780997299.092892:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110445184 00000100:00100000:0.0:1780997299.092971:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1505 00000100:00100000:0.0:1780997299.092982:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+89:72804:x1867507110445184:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997299.093014:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997299.093038:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955200/0x30fd811c0305bd5d lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8fa5 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.093157:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305bd64 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.093173:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305bd64 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.093185:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305bd64 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.093220:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bd6b lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.093228:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bd6b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.093235:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bd6b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780997299.093991:0:63418:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x62e:0x0], index 0: 0 00010000:00010000:1.0:1780997299.094156:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd72 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094179:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd72 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094188:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd72 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094224:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305bd64 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094230:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305bd64 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094237:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305bd64 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094243:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305bd64 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094290:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997299.094295:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305bd64 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094303:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305bd64 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094316:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:1.0:1780997299.094319:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997299.094323:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305bd64 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094330:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888954e00/0x30fd811c0305bd64 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997299.094346:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f685989e reply state 000000005f40144e transno 81604378808 ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bd6b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094355:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bd6b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094361:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x7bc65ca3 (ffff96898d864c00) 00010000:00010000:1.0:1780997299.094363:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997299.094366:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780997299.094398:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955200/0x30fd811c0305bd5d lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fa5 expref: 92 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094414:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd72 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fa5 expref: 91 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.094433:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x13:0x0].0x0 (ffff9689896fee00) 00010000:00010000:1.0:1780997299.094435:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997299.094437:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8800, rc 0) 00000100:00100000:1.0:1780997299.094511:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688895f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+92:72804:x1867507110445184:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1531us (2596us total) trans 81604378808 rc 0/0 00000100:00100000:1.0:1780997299.094520:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1505 00000100:00100000:0.0:1780997299.100178:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997299.101689:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110445440 00000100:00100000:3.0:1780997299.101708:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110445440 00000100:00100000:3.0:1780997299.101772:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1506 00000100:00100000:3.0:1780997299.101785:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+92:72804:x1867507110445440:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:3.0:1780997299.101870:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997299.101905:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd72 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fa5 expref: 92 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.101928:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x13:0x0].0x0 (ffff9689896fee00) 00010000:00010000:3.0:1780997299.101943:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997299.102006:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305bd80 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.102034:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305bd80 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.102044:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305bd80 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997299.102158:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ffed3fe1 reply state 00000000561bfcfe transno 81604378809 ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305bd80 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.102171:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305bd80 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.102178:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x13:0x0].0x0 (ffff96898712dc00) 00010000:00010000:3.0:1780997299.102180:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997299.102183:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780997299.102299:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+93:72804:x1867507110445440:12345-192.168.206.51@tcp:36:touch.0 Request processed in 517us (2131us total) trans 81604378809 rc 0/0 00000100:00100000:3.0:1780997299.102307:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1506 00000100:00100000:2.0:1780997299.107936:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.108061:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110445568 00000100:00100000:0.0:1780997299.108072:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110445568 00000100:00100000:0.0:1780997299.108136:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1507 00000100:00100000:0.0:1780997299.108147:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+93:72804:x1867507110445568:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997299.108184:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997299.108205:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955400/0x30fd811c0305bd87 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8fac expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.108296:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955400/0x30fd811c0305bd87 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fac expref: 94 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.108312:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955400/0x30fd811c0305bd87 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fac expref: 94 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.108334:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x13:0x0].0x0 (ffff96898712dc00) 00010000:00010000:0.0:1780997299.108337:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780997299.108340:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955400, rc 0) 00000100:00100000:0.0:1780997299.108401:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+94:72804:x1867507110445568:12345-192.168.206.51@tcp:101:touch.0 Request processed in 257us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997299.108421:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1507 00000100:00100000:1.0:1780997299.127011:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.127265:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110445696 00000100:00100000:0.0:1780997299.127303:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110445696 00000100:00100000:0.0:1780997299.127354:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5994 00000100:00100000:0.0:1780997299.127364:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+17:2397:x1867507110445696:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:0.0:1780997299.127568:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+18:2397:x1867507110445696:12345-192.168.206.51@tcp:2:touch.0 Request processed in 205us (567us total) trans 4294969469 rc 0/0 00000100:00100000:0.0:1780997299.127575:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5994 00000100:00100000:2.0:1780997299.140300:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.140408:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110445952 00000100:00100000:1.0:1780997299.140419:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110445952 00000100:00100000:1.0:1780997299.140479:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 256 00000100:00100000:1.0:1780997299.140490:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+94:72804:x1867507110445952:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:1.0:1780997299.140789:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+95:72804:x1867507110445952:12345-192.168.206.51@tcp:35:touch.0 Request processed in 301us (500us total) trans 81604378810 rc 0/0 00000100:00100000:1.0:1780997299.140796:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 256 00000100:00100000:2.0:1780997299.151029:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.151205:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110446208 00000100:00100000:1.0:1780997299.151220:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110446208 00000100:00100000:1.0:1780997299.151328:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1508 00000100:00100000:1.0:1780997299.151339:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+95:72804:x1867507110446208:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997299.151367:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997299.151392:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bd8e lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8fb3 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.151689:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bd95 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.151722:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bd95 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.151734:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bd95 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.151751:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd9c lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.151758:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd9c lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.151764:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd9c lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780997299.152098:0:63584:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x62f:0x0], index 0: 0 00010000:00010000:1.0:1780997299.152237:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305bda3 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152247:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305bda3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152254:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305bda3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152311:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bd95 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152318:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bd95 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152324:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bd95 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152336:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bd95 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152342:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997299.152346:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bd95 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152354:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bd95 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152364:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:1.0:1780997299.152367:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997299.152371:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bd95 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152377:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bd95 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997299.152391:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000137f026 reply state 00000000cfb2869e transno 81604378811 ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd9c lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152402:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd9c lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152408:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xd57f5ca3 (ffff9689896fe300) 00010000:00010000:1.0:1780997299.152411:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997299.152414:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780997299.152443:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bd8e lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fb3 expref: 98 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152457:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305bda3 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fb3 expref: 97 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.152882:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x14:0x0].0x0 (ffff9689896fe100) 00010000:00010000:1.0:1780997299.152886:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997299.152889:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9e00, rc 0) 00000100:00100000:1.0:1780997299.153017:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+98:72804:x1867507110446208:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1679us (1996us total) trans 81604378811 rc 0/0 00000100:00100000:1.0:1780997299.153026:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1508 00000100:00100000:3.0:1780997299.163425:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.164051:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110446464 00000100:00100000:0.0:1780997299.164064:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110446464 00000100:00100000:0.0:1780997299.164132:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1509 00000100:00100000:0.0:1780997299.164143:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+98:72804:x1867507110446464:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:0.0:1780997299.164236:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997299.164410:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305bda3 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fb3 expref: 98 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.164429:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x14:0x0].0x0 (ffff9689896fe100) 00010000:00010000:0.0:1780997299.164440:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997299.164500:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305bdb1 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.164513:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305bdb1 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.164523:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305bdb1 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997299.164651:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f68714e1 reply state 00000000929c52b4 transno 81604378812 ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305bdb1 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.164663:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305bdb1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.164669:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x14:0x0].0x0 (ffff96898d864700) 00010000:00010000:0.0:1780997299.164671:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997299.164674:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997299.164774:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+99:72804:x1867507110446464:12345-192.168.206.51@tcp:36:touch.0 Request processed in 632us (1359us total) trans 81604378812 rc 0/0 00000100:00100000:0.0:1780997299.164781:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1509 00000100:00100000:2.0:1780997299.169475:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.176452:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110446592 00000100:00100000:0.0:1780997299.176468:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110446592 00000100:00100000:0.0:1780997299.176583:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1510 00000100:00100000:0.0:1780997299.176596:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+99:72804:x1867507110446592:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997299.176625:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997299.176647:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888954600/0x30fd811c0305bdb8 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8fba expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.176710:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954600/0x30fd811c0305bdb8 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fba expref: 100 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.176726:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954600/0x30fd811c0305bdb8 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fba expref: 100 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.176744:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x14:0x0].0x0 (ffff96898d864700) 00010000:00010000:0.0:1780997299.176760:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780997299.176765:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954600, rc 0) 00000100:00100000:0.0:1780997299.176838:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+100:72804:x1867507110446592:12345-192.168.206.51@tcp:101:touch.0 Request processed in 246us (7374us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997299.176846:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1510 00000100:00100000:2.0:1780997299.180982:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.181263:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110446720 00000100:00100000:1.0:1780997299.181331:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110446720 00000100:00100000:1.0:1780997299.181413:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5995 00000100:00100000:1.0:1780997299.181425:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+18:2395:x1867507110446720:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:1.0:1780997299.181672:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+19:2395:x1867507110446720:12345-192.168.206.51@tcp:2:touch.0 Request processed in 249us (702us total) trans 4294969470 rc 0/0 00000100:00100000:1.0:1780997299.181681:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5995 00000100:00100000:3.0:1780997299.187433:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.189403:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110446976 00000100:00100000:0.0:1780997299.189418:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110446976 00000100:00100000:0.0:1780997299.189499:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 257 00000100:00100000:0.0:1780997299.189510:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889fe7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+100:72804:x1867507110446976:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:0.0:1780997299.189847:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889fe7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+101:72804:x1867507110446976:12345-192.168.206.51@tcp:35:touch.0 Request processed in 338us (2426us total) trans 81604378813 rc 0/0 00000100:00100000:0.0:1780997299.189856:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 257 00000100:00100000:0.0:1780997299.200423:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997299.200523:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110447232 00000100:00100000:2.0:1780997299.200534:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110447232 00000100:00100000:2.0:1780997299.200602:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1511 00000100:00100000:2.0:1780997299.200625:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+101:72804:x1867507110447232:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:2.0:1780997299.200654:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997299.200678:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bdbf lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8fc1 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.200784:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305bdc6 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.202387:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305bdc6 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.202412:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305bdc6 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.202446:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305bdcd lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.202455:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305bdcd lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.202688:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305bdcd lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780997299.203150:0:63418:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x630:0x0], index 0: 0 00010000:00010000:2.0:1780997299.205744:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fc00/0x30fd811c0305bdd4 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.205776:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fc00/0x30fd811c0305bdd4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.205790:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fc00/0x30fd811c0305bdd4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.205850:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305bdc6 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.205859:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305bdc6 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.205865:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305bdc6 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.205884:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305bdc6 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.205892:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997299.205897:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305bdc6 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.205904:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305bdc6 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.205917:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:2.0:1780997299.205920:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997299.205925:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305bdc6 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.205931:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305bdc6 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997299.205948:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e3a65f8 reply state 00000000d38fd6b9 transno 81604378814 ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305bdcd lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.205959:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305bdcd lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.205973:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x2f385ca3 (ffff968983653800) 00010000:00010000:2.0:1780997299.205975:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997299.205978:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780997299.206018:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2e00/0x30fd811c0305bdbf lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fc1 expref: 104 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.206047:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fc00/0x30fd811c0305bdd4 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fc1 expref: 103 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.206055:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x15:0x0].0x0 (ffff9689896ff600) 00010000:00010000:2.0:1780997299.206058:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997299.206061:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956fc00, rc 0) 00000100:00100000:2.0:1780997299.206150:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+104:72804:x1867507110447232:12345-192.168.206.51@tcp:101:touch.0 Request processed in 5526us (5736us total) trans 81604378814 rc 0/0 00000100:00100000:2.0:1780997299.206160:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1511 00000100:00100000:2.0:1780997299.226048:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.226150:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110447488 00000100:00100000:0.0:1780997299.226160:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110447488 00000100:00100000:0.0:1780997299.226239:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1512 00000100:00100000:0.0:1780997299.226736:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+104:72804:x1867507110447488:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:0.0:1780997299.226809:0:80049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997299.226839:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fc00/0x30fd811c0305bdd4 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fc1 expref: 104 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.226859:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x15:0x0].0x0 (ffff9689896ff600) 00010000:00010000:0.0:1780997299.226870:0:80049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997299.226937:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305bde2 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.226951:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305bde2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.226972:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305bde2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780997299.227070:0:80049:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e1cf8255 reply state 00000000d35e5270 transno 81604378815 ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305bde2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.227081:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305bde2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.227087:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x15:0x0].0x0 (ffff9689882bd000) 00010000:00010000:0.0:1780997299.227089:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997299.227092:0:80049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997299.227524:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+105:72804:x1867507110447488:12345-192.168.206.51@tcp:36:touch.0 Request processed in 1273us (1481us total) trans 81604378815 rc 0/0 00000100:00100000:0.0:1780997299.227533:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1512 00000100:00100000:3.0:1780997299.234675:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.234773:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110447616 00000100:00100000:0.0:1780997299.234783:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110447616 00000100:00100000:0.0:1780997299.234850:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1513 00000100:00100000:0.0:1780997299.234861:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a6795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+105:72804:x1867507110447616:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997299.234892:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997299.234914:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888954c00/0x30fd811c0305bde9 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8fc8 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.234972:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954c00/0x30fd811c0305bde9 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fc8 expref: 106 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.234986:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954c00/0x30fd811c0305bde9 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fc8 expref: 106 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.235035:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x15:0x0].0x0 (ffff9689882bd000) 00010000:00010000:0.0:1780997299.235038:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780997299.235042:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954c00, rc 0) 00000100:00100000:0.0:1780997299.235101:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a6795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+106:72804:x1867507110447616:12345-192.168.206.51@tcp:101:touch.0 Request processed in 243us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997299.235108:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1513 00000100:00100000:2.0:1780997299.242970:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.243064:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110447744 00000100:00100000:1.0:1780997299.243074:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110447744 00000100:00100000:1.0:1780997299.243133:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5996 00000100:00100000:1.0:1780997299.243143:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+19:2395:x1867507110447744:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:1.0:1780997299.243422:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+20:2395:x1867507110447744:12345-192.168.206.51@tcp:2:touch.0 Request processed in 280us (461us total) trans 4294969471 rc 0/0 00000100:00100000:1.0:1780997299.243429:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5996 00000100:00100000:2.0:1780997299.249096:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.249194:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110448000 00000100:00100000:0.0:1780997299.249204:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110448000 00000100:00100000:0.0:1780997299.249300:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 258 00000100:00100000:0.0:1780997299.249311:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+106:72804:x1867507110448000:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:0.0:1780997299.249563:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+107:72804:x1867507110448000:12345-192.168.206.51@tcp:35:touch.0 Request processed in 254us (477us total) trans 81604378816 rc 0/0 00000100:00100000:0.0:1780997299.249568:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 258 00000100:00100000:0.0:1780997299.252451:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.252552:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110448256 00000100:00100000:1.0:1780997299.252563:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110448256 00000100:00100000:1.0:1780997299.252632:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1514 00000100:00100000:1.0:1780997299.252643:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+107:72804:x1867507110448256:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997299.252685:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997299.252707:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bdf0 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8fcf expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.252832:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bdf7 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.252846:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bdf7 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.252858:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bdf7 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.252871:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bdfe lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.252888:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bdfe lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.252895:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bdfe lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780997299.253193:0:63584:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x631:0x0], index 0: 0 00010000:00010000:1.0:1780997299.253849:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305be05 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.253862:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305be05 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.253871:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305be05 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.253930:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bdf7 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.253938:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bdf7 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.253944:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bdf7 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.253950:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bdf7 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.253956:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997299.253960:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bdf7 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.253968:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bdf7 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.253980:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:1.0:1780997299.253982:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997299.253989:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bdf7 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.253995:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bdf7 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997299.254009:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dcad32c7 reply state 000000003e73f7bd transno 81604378817 ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bdfe lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.254019:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bdfe lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.254029:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x88f15ca3 (ffff9689896feb00) 00010000:00010000:1.0:1780997299.254031:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997299.254034:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780997299.254064:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bdf0 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fcf expref: 110 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.254078:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305be05 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fcf expref: 109 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.254085:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x16:0x0].0x0 (ffff9689896fe900) 00010000:00010000:1.0:1780997299.254087:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997299.254089:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9800, rc 0) 00000100:00100000:1.0:1780997299.254228:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+110:72804:x1867507110448256:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1587us (1791us total) trans 81604378817 rc 0/0 00000100:00100000:1.0:1780997299.254236:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1514 00000100:00100000:2.0:1780997299.264451:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997299.264602:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110448512 00000100:00100000:3.0:1780997299.264613:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110448512 00000100:00100000:3.0:1780997299.264696:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1515 00000100:00100000:3.0:1780997299.264707:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+110:72804:x1867507110448512:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:3.0:1780997299.264777:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997299.264821:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305be05 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fcf expref: 110 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.264862:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x16:0x0].0x0 (ffff9689896fe900) 00010000:00010000:3.0:1780997299.264890:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997299.264945:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968980031c00/0x30fd811c0305be13 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.264958:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968980031c00/0x30fd811c0305be13 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.264967:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968980031c00/0x30fd811c0305be13 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997299.265069:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c0f42543 reply state 000000007e038c82 transno 81604378818 ns: mdt-lustre-MDT0001_UUID lock: ffff968980031c00/0x30fd811c0305be13 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.265081:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968980031c00/0x30fd811c0305be13 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.265088:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x16:0x0].0x0 (ffff96898712de00) 00010000:00010000:3.0:1780997299.265090:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997299.265093:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780997299.265189:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+111:72804:x1867507110448512:12345-192.168.206.51@tcp:36:touch.0 Request processed in 484us (749us total) trans 81604378818 rc 0/0 00000100:00100000:3.0:1780997299.265197:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1515 00000100:00100000:3.0:1780997299.270609:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.270837:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110448640 00000100:00100000:0.0:1780997299.270848:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110448640 00000100:00100000:0.0:1780997299.270920:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1516 00000100:00100000:0.0:1780997299.270933:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+111:72804:x1867507110448640:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997299.270958:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997299.270979:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955000/0x30fd811c0305be1a lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8fd6 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.271042:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955000/0x30fd811c0305be1a lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fd6 expref: 112 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.271077:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955000/0x30fd811c0305be1a lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fd6 expref: 112 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.271098:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x16:0x0].0x0 (ffff96898712de00) 00010000:00010000:0.0:1780997299.271102:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780997299.271105:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955000, rc 0) 00000100:00100000:0.0:1780997299.271185:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+112:72804:x1867507110448640:12345-192.168.206.51@tcp:101:touch.0 Request processed in 248us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997299.271192:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1516 00000100:00100000:0.0:1780997299.274557:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.274641:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110448768 00000100:00100000:1.0:1780997299.274651:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110448768 00000100:00100000:1.0:1780997299.274724:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5997 00000100:00100000:1.0:1780997299.274734:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+20:2397:x1867507110448768:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:1.0:1780997299.275207:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+21:2397:x1867507110448768:12345-192.168.206.51@tcp:2:touch.0 Request processed in 472us (657us total) trans 4294969472 rc 0/0 00000100:00100000:1.0:1780997299.275215:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5997 00000100:00100000:2.0:1780997299.278718:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.278816:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110449024 00000100:00100000:0.0:1780997299.278827:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110449024 00000100:00100000:0.0:1780997299.278900:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 259 00000100:00100000:0.0:1780997299.278912:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+112:72804:x1867507110449024:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:0.0:1780997299.279259:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+113:72804:x1867507110449024:12345-192.168.206.51@tcp:35:touch.0 Request processed in 349us (550us total) trans 81604378819 rc 0/0 00000100:00100000:0.0:1780997299.279303:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 259 00000100:00100000:3.0:1780997299.282832:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.282943:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110449280 00000100:00100000:1.0:1780997299.282953:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110449280 00000100:00100000:1.0:1780997299.283014:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1517 00000100:00100000:1.0:1780997299.283024:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+113:72804:x1867507110449280:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997299.283060:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997299.283081:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305be21 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8fdd expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283200:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305be28 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283214:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305be28 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283225:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305be28 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283239:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305be2f lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283245:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305be2f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283251:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305be2f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780997299.283651:0:63584:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x632:0x0], index 0: 0 00010000:00010000:1.0:1780997299.283784:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305be36 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283793:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305be36 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283801:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305be36 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283845:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305be28 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283854:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305be28 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283860:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305be28 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283866:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305be28 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283872:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997299.283886:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305be28 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283893:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305be28 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283905:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:1.0:1780997299.283908:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997299.283913:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305be28 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283919:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305be28 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997299.283934:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008df571e1 reply state 00000000316bc8a7 transno 81604378820 ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305be2f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283943:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305be2f lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.283956:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xe2aa5ca3 (ffff9689896fe900) 00010000:00010000:1.0:1780997299.283958:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997299.283961:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780997299.283989:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305be21 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fdd expref: 116 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.284003:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305be36 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fdd expref: 115 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.284010:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x17:0x0].0x0 (ffff9689896fe100) 00010000:00010000:1.0:1780997299.284012:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997299.284015:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9800, rc 0) 00000100:00100000:1.0:1780997299.284093:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+116:72804:x1867507110449280:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1070us (1270us total) trans 81604378820 rc 0/0 00000100:00100000:1.0:1780997299.284100:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1517 00000100:00100000:0.0:1780997299.284762:0:72373:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b100b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:72373:1867507127038080:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1780997299.284823:0:72373:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997299.284853:0:72373:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780997299.284921:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127038080 00000100:00100000:3.0:1780997299.284928:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127038080 00000100:00100000:3.0:1780997299.284973:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5998 00000100:00100000:3.0:1780997299.284982:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:72373:x1867507127038080:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1780997299.285029:0:25171:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1602 00000100:00100000:3.0:1780997299.286459:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:72373:x1867507127038080:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1474us (1631us total) trans 4294969473 rc 0/0 00000100:00100000:3.0:1780997299.286470:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5998 00000100:00100000:1.0:1780997299.287008:0:72373:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b100b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:72373:1867507127038080:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1780997299.287023:0:72373:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000401:0x632:0x0]-[0x280000401:0x661:0x0] 00000100:00100000:3.0:1780997299.289603:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.289775:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110449536 00000100:00100000:1.0:1780997299.289785:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110449536 00000100:00100000:1.0:1780997299.289851:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1518 00000100:00100000:1.0:1780997299.289860:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+116:72804:x1867507110449536:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:1.0:1780997299.289921:0:80049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997299.289946:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305be36 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fdd expref: 116 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.289984:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x17:0x0].0x0 (ffff9689896fe100) 00010000:00010000:1.0:1780997299.289996:0:80049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780997299.290047:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305be44 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.290061:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305be44 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.290070:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305be44 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997299.290201:0:80049:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034b090d4 reply state 00000000ed0481bc transno 81604378821 ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305be44 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.290212:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305be44 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.290218:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x17:0x0].0x0 (ffff9689896fee00) 00010000:00010000:1.0:1780997299.290221:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997299.290223:0:80049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780997299.290606:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+117:72804:x1867507110449536:12345-192.168.206.51@tcp:36:touch.0 Request processed in 746us (1009us total) trans 81604378821 rc 0/0 00000100:00100000:1.0:1780997299.290614:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1518 00000100:00100000:3.0:1780997299.293139:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.293222:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110449664 00000100:00100000:1.0:1780997299.293231:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110449664 00000100:00100000:1.0:1780997299.293298:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1519 00000100:00100000:1.0:1780997299.293306:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+117:72804:x1867507110449664:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997299.293327:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997299.293360:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd600/0x30fd811c0305be4b lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8fe4 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.293409:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd600/0x30fd811c0305be4b lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fe4 expref: 118 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.293423:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd600/0x30fd811c0305be4b lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8fe4 expref: 118 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.293440:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x17:0x0].0x0 (ffff9689896fee00) 00010000:00010000:1.0:1780997299.293443:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1780997299.293446:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffd600, rc 0) 00000100:00100000:1.0:1780997299.293495:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+118:72804:x1867507110449664:12345-192.168.206.51@tcp:101:touch.0 Request processed in 190us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997299.293502:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1519 00000100:00100000:2.0:1780997299.297928:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997299.298315:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110449792 00000100:00100000:3.0:1780997299.298327:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110449792 00000100:00100000:3.0:1780997299.298382:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5999 00000100:00100000:3.0:1780997299.298391:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+21:2397:x1867507110449792:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:3.0:1780997299.298613:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:2397:x1867507110449792:12345-192.168.206.51@tcp:2:touch.0 Request processed in 222us (697us total) trans 4294969474 rc 0/0 00000100:00100000:3.0:1780997299.298621:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5999 00000100:00100000:3.0:1780997299.302798:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.302995:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110450048 00000100:00100000:0.0:1780997299.303005:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110450048 00000100:00100000:0.0:1780997299.303062:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 260 00000100:00100000:0.0:1780997299.303072:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+118:72804:x1867507110450048:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:0.0:1780997299.303411:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+119:72804:x1867507110450048:12345-192.168.206.51@tcp:35:touch.0 Request processed in 339us (622us total) trans 81604378822 rc 0/0 00000100:00100000:0.0:1780997299.303418:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 260 00000100:00100000:2.0:1780997299.307947:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.308466:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110450304 00000100:00100000:1.0:1780997299.308478:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110450304 00000100:00100000:1.0:1780997299.308569:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1520 00000100:00100000:1.0:1780997299.308580:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+119:72804:x1867507110450304:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997299.308605:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997299.308627:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd800/0x30fd811c0305be52 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8feb expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.308850:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305be59 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.308866:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305be59 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.308913:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305be59 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.308930:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305be60 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.308937:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305be60 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.308943:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305be60 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780997299.309256:0:63584:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x633:0x0], index 0: 0 00010000:00010000:1.0:1780997299.309410:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305be67 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309420:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305be67 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309428:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305be67 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309459:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305be59 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309466:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305be59 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309472:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305be59 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309478:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305be59 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309492:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffcc00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997299.309497:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305be59 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309504:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305be59 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309516:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:1.0:1780997299.309519:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997299.309524:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305be59 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309531:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305be59 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997299.309543:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000007eed2f0 reply state 00000000f2ca9656 transno 81604378823 ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305be60 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309553:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305be60 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309558:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x3c635ca3 (ffff9689896fe100) 00010000:00010000:1.0:1780997299.309560:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997299.309562:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780997299.309591:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd800/0x30fd811c0305be52 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8feb expref: 122 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309603:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305be67 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8feb expref: 121 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.309621:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x18:0x0].0x0 (ffff9689896fe400) 00010000:00010000:1.0:1780997299.309624:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997299.309626:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffc000, rc 0) 00000100:00100000:1.0:1780997299.310105:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+122:72804:x1867507110450304:12345-192.168.206.51@tcp:101:touch.0 Request processed in 1524us (2233us total) trans 81604378823 rc 0/0 00000100:00100000:1.0:1780997299.310114:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1520 00000100:00100000:2.0:1780997299.314362:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997299.314563:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110450560 00000100:00100000:3.0:1780997299.314573:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110450560 00000100:00100000:3.0:1780997299.314626:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1521 00000100:00100000:3.0:1780997299.314635:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+122:72804:x1867507110450560:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:3.0:1780997299.314687:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997299.314713:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305be67 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8feb expref: 122 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.314733:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x18:0x0].0x0 (ffff9689896fe400) 00010000:00010000:3.0:1780997299.314745:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997299.314941:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305be75 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.314973:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305be75 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.314983:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305be75 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997299.315093:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009fac277f reply state 000000003002151e transno 81604378824 ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305be75 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.315103:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305be75 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.315109:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x18:0x0].0x0 (ffff96898712d900) 00010000:00010000:3.0:1780997299.315111:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997299.315114:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780997299.315250:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+123:72804:x1867507110450560:12345-192.168.206.51@tcp:36:touch.0 Request processed in 615us (896us total) trans 81604378824 rc 0/0 00000100:00100000:3.0:1780997299.315257:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1521 00000100:00100000:0.0:1780997299.317966:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.318072:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110450688 00000100:00100000:1.0:1780997299.318082:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110450688 00000100:00100000:1.0:1780997299.318163:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1522 00000100:00100000:1.0:1780997299.318172:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688874f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+123:72804:x1867507110450688:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997299.318205:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997299.318226:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd800/0x30fd811c0305be7c lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ff2 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.318319:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd800/0x30fd811c0305be7c lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ff2 expref: 124 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.318332:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd800/0x30fd811c0305be7c lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ff2 expref: 124 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.318348:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x18:0x0].0x0 (ffff96898712d900) 00010000:00010000:1.0:1780997299.318350:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1780997299.318354:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffd800, rc 0) 00000100:00100000:1.0:1780997299.318409:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688874f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+124:72804:x1867507110450688:12345-192.168.206.51@tcp:101:touch.0 Request processed in 238us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997299.318432:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1522 00000100:00100000:2.0:1780997299.322247:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997299.322377:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110450816 00000100:00100000:3.0:1780997299.322387:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110450816 00000100:00100000:3.0:1780997299.322442:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6000 00000100:00100000:3.0:1780997299.322452:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:2395:x1867507110450816:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:3.0:1780997299.322670:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+23:2395:x1867507110450816:12345-192.168.206.51@tcp:2:touch.0 Request processed in 206us (421us total) trans 4294969475 rc 0/0 00000100:00100000:3.0:1780997299.322679:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6000 00000100:00100000:2.0:1780997299.326499:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.326658:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110451072 00000100:00100000:0.0:1780997299.326669:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110451072 00000100:00100000:0.0:1780997299.326717:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 261 00000100:00100000:0.0:1780997299.326727:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+124:72804:x1867507110451072:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:0.0:1780997299.327027:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+125:72804:x1867507110451072:12345-192.168.206.51@tcp:35:touch.0 Request processed in 301us (536us total) trans 81604378825 rc 0/0 00000100:00100000:0.0:1780997299.327036:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 261 00000100:00100000:0.0:1780997299.331578:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997299.331665:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110451328 00000100:00100000:2.0:1780997299.331685:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110451328 00000100:00100000:2.0:1780997299.331754:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1523 00000100:00100000:2.0:1780997299.331763:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+125:72804:x1867507110451328:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:2.0:1780997299.331784:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997299.331812:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305be83 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae8ff9 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.331924:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305be8a lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.331940:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305be8a lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.331951:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305be8a lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.331963:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e000/0x30fd811c0305be91 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.331969:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e000/0x30fd811c0305be91 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.331974:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e000/0x30fd811c0305be91 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780997299.332326:0:63418:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x634:0x0], index 0: 0 00010000:00010000:2.0:1780997299.332457:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fa00/0x30fd811c0305be98 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332466:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fa00/0x30fd811c0305be98 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332474:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fa00/0x30fd811c0305be98 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332517:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305be8a lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332525:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305be8a lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332531:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305be8a lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332536:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305be8a lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332542:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997299.332546:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305be8a lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332553:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305be8a lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332564:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:2.0:1780997299.332567:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997299.332571:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305be8a lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332578:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305be8a lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997299.332592:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2f6068f reply state 00000000695cfc91 transno 81604378826 ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e000/0x30fd811c0305be91 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332602:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e000/0x30fd811c0305be91 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332614:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x961c5ca3 (ffff9689896ff000) 00010000:00010000:2.0:1780997299.332616:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997299.332618:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780997299.332648:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305be83 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ff9 expref: 128 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332674:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fa00/0x30fd811c0305be98 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ff9 expref: 127 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.332682:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x19:0x0].0x0 (ffff9689896ff600) 00010000:00010000:2.0:1780997299.332684:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997299.332686:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956fa00, rc 0) 00000100:00100000:2.0:1780997299.332755:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+128:72804:x1867507110451328:12345-192.168.206.51@tcp:101:touch.0 Request processed in 993us (1186us total) trans 81604378826 rc 0/0 00000100:00100000:2.0:1780997299.332763:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1523 00000100:00100000:3.0:1780997299.340553:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.340647:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110451584 00000100:00100000:1.0:1780997299.340668:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110451584 00000100:00100000:1.0:1780997299.340734:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1524 00000100:00100000:1.0:1780997299.340744:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+128:72804:x1867507110451584:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:1.0:1780997299.340813:0:80049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997299.340839:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fa00/0x30fd811c0305be98 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ff9 expref: 128 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.340860:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x19:0x0].0x0 (ffff9689896ff600) 00010000:00010000:1.0:1780997299.340871:0:80049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780997299.340948:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305bea6 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.340962:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305bea6 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.340972:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305bea6 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997299.341089:0:80049:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009369bb71 reply state 000000006b965530 transno 81604378827 ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305bea6 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.341103:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305bea6 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.341109:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x19:0x0].0x0 (ffff9689896fed00) 00010000:00010000:1.0:1780997299.341112:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997299.341126:0:80049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780997299.341564:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+129:72804:x1867507110451584:12345-192.168.206.51@tcp:36:touch.0 Request processed in 819us (1018us total) trans 81604378827 rc 0/0 00000100:00100000:1.0:1780997299.341571:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1524 00000100:00100000:3.0:1780997299.346512:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.346749:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110451712 00000100:00100000:0.0:1780997299.346760:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110451712 00000100:00100000:0.0:1780997299.347198:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1525 00000100:00100000:0.0:1780997299.347210:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+129:72804:x1867507110451712:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:0.0:1780997299.347232:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997299.347253:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955200/0x30fd811c0305bead lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9000 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.347341:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955200/0x30fd811c0305bead lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9000 expref: 130 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.347355:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955200/0x30fd811c0305bead lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9000 expref: 130 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997299.347392:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x19:0x0].0x0 (ffff9689896fed00) 00010000:00010000:0.0:1780997299.347395:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780997299.347400:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955200, rc 0) 00000100:00100000:0.0:1780997299.347461:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+130:72804:x1867507110451712:12345-192.168.206.51@tcp:101:touch.0 Request processed in 254us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997299.347468:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1525 00000100:00100000:3.0:1780997299.350407:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997299.350610:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110451840 00000100:00100000:2.0:1780997299.350621:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110451840 00000100:00100000:2.0:1780997299.350680:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6001 00000100:00100000:2.0:1780997299.350690:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+23:2395:x1867507110451840:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:2.0:1780997299.350930:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+24:2395:x1867507110451840:12345-192.168.206.51@tcp:2:touch.0 Request processed in 241us (533us total) trans 4294969476 rc 0/0 00000100:00100000:2.0:1780997299.350938:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6001 00000100:00100000:3.0:1780997299.356044:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.356155:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110452096 00000100:00100000:0.0:1780997299.356166:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110452096 00000100:00100000:0.0:1780997299.356224:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 262 00000100:00100000:0.0:1780997299.356233:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+130:72804:x1867507110452096:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:0.0:1780997299.356564:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+131:72804:x1867507110452096:12345-192.168.206.51@tcp:35:touch.0 Request processed in 331us (529us total) trans 81604378828 rc 0/0 00000100:00100000:0.0:1780997299.356572:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 262 00000100:00100000:3.0:1780997299.359478:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997299.359614:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110452352 00000100:00100000:2.0:1780997299.359625:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110452352 00000100:00100000:2.0:1780997299.359686:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1526 00000100:00100000:2.0:1780997299.359696:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+131:72804:x1867507110452352:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:2.0:1780997299.359741:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997299.359762:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305beb4 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9007 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.359903:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bebb lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.359920:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bebb lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.359931:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bebb lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.359948:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305bec2 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.359955:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305bec2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.359962:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305bec2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780997299.360245:0:63418:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x635:0x0], index 0: 0 00010000:00010000:2.0:1780997299.360405:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fa00/0x30fd811c0305bec9 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360414:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fa00/0x30fd811c0305bec9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360420:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fa00/0x30fd811c0305bec9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360462:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bebb lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360469:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bebb lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360475:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bebb lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360481:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bebb lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360487:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997299.360491:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bebb lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360498:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bebb lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360510:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:2.0:1780997299.360513:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997299.360517:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bebb lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360523:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bebb lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780997299.360536:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c745c57a reply state 0000000059cc9d81 transno 81604378829 ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305bec2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360546:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305bec2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360559:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xb6f515a3 (ffff9689896ff600) 00010000:00010000:2.0:1780997299.360561:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997299.360564:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780997299.360594:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305beb4 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9007 expref: 134 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360608:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fa00/0x30fd811c0305bec9 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9007 expref: 133 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997299.360615:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1a:0x0].0x0 (ffff96898b4c3100) 00010000:00010000:2.0:1780997299.360617:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997299.360620:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956fa00, rc 0) 00000100:00100000:2.0:1780997299.360677:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+134:72804:x1867507110452352:12345-192.168.206.51@tcp:101:touch.0 Request processed in 983us (1211us total) trans 81604378829 rc 0/0 00000100:00100000:2.0:1780997299.360685:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1526 00000100:00100000:2.0:1780997299.364415:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997299.364498:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110452608 00000100:00100000:3.0:1780997299.364508:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110452608 00000100:00100000:3.0:1780997299.364569:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1527 00000100:00100000:3.0:1780997299.364580:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+134:72804:x1867507110452608:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:3.0:1780997299.364633:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997299.364659:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fa00/0x30fd811c0305bec9 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9007 expref: 134 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.364678:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1a:0x0].0x0 (ffff96898b4c3100) 00010000:00010000:3.0:1780997299.364689:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997299.364747:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bed7 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.364761:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bed7 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.364771:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bed7 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997299.364910:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0310ae5 reply state 000000008cab9040 transno 81604378830 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bed7 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.364922:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bed7 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997299.364929:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1a:0x0].0x0 (ffff96898712d500) 00010000:00010000:3.0:1780997299.364931:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997299.364934:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780997299.365040:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+135:72804:x1867507110452608:12345-192.168.206.51@tcp:36:touch.0 Request processed in 461us (634us total) trans 81604378830 rc 0/0 00000100:00100000:3.0:1780997299.365048:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1527 00000100:00100000:3.0:1780997299.367858:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.367993:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110452736 00000100:00100000:1.0:1780997299.368003:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110452736 00000100:00100000:1.0:1780997299.368056:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1528 00000100:00100000:1.0:1780997299.368066:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+135:72804:x1867507110452736:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1780997299.368087:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997299.368106:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc600/0x30fd811c0305bede lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae900e expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.368161:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc600/0x30fd811c0305bede lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae900e expref: 136 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.368177:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc600/0x30fd811c0305bede lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae900e expref: 136 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997299.368194:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1a:0x0].0x0 (ffff96898712d500) 00010000:00010000:1.0:1780997299.368197:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1780997299.368200:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffc600, rc 0) 00000100:00100000:1.0:1780997299.368253:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+136:72804:x1867507110452736:12345-192.168.206.51@tcp:101:touch.0 Request processed in 189us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997299.368261:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1528 00000100:00100000:0.0:1780997299.371027:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997299.371237:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110452864 00000100:00100000:1.0:1780997299.371247:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110452864 00000100:00100000:1.0:1780997299.371329:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6002 00000100:00100000:1.0:1780997299.371339:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+24:2394:x1867507110452864:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:1.0:1780997299.371571:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2394:x1867507110452864:12345-192.168.206.51@tcp:2:touch.0 Request processed in 233us (553us total) trans 4294969477 rc 0/0 00000100:00100000:1.0:1780997299.371579:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6002 00000100:00100000:2.0:1780997299.380264:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997299.380399:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110453120 00000100:00100000:0.0:1780997299.380413:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110453120 00000100:00100000:0.0:1780997299.380469:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 263 00000100:00100000:0.0:1780997299.380479:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889fe4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+136:72804:x1867507110453120:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:0.0:1780997299.380776:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889fe4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+137:72804:x1867507110453120:12345-192.168.206.51@tcp:35:touch.0 Request processed in 297us (526us total) trans 81604378831 rc 0/0 00000100:00100000:0.0:1780997299.380784:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 263 00000100:00100000:0.0:1780997299.622548:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127038208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997299.622635:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997299.622823:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127038208 00000100:00100000:3.0:1780997299.622833:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127038208 00000100:00100000:3.0:1780997299.622902:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172 00000100:00100000:3.0:1780997299.622912:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127038208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997299.622934:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997299.622985:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127038208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997299.622993:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172 00000100:00100000:0.0:1780997299.623851:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127038208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997299.628756:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780997299.628778:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127038336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997299.628844:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997299.630007:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127038336 00000100:00100000:3.0:1780997299.630022:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127038336 00000100:00100000:3.0:1780997299.630091:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173 00000100:00100000:3.0:1780997299.630102:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507127038336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780997299.630131:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780997299.630217:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3496:x1867507127038336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997299.630224:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173 00000100:00100000:1.0:1780997299.630395:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127038336:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1780997299.942522:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997300.965758:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997301.261953:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997301.262138:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110453248 00000100:00100000:2.0:1780997301.262149:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110453248 00000100:00100000:2.0:1780997301.262412:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1529 00000100:00100000:2.0:1780997301.262423:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:72832:x1867507110453248:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:2.0:1780997301.262459:0:63418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:2.0:1780997301.262534:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:72832:x1867507110453248:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 114us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997301.262555:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1529 00000100:00080000:0.0:1780997301.268728:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780997301.269837:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997301.270073:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110453376 00000100:00100000:0.0:1780997301.270084:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110453376 00000100:00100000:0.0:1780997301.270213:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1530 00000100:00100000:0.0:1780997301.270225:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+137:72832:x1867507110453376:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:0.0:1780997301.270267:0:63417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:0.0:1780997301.270357:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+137:72832:x1867507110453376:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 135us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997301.270364:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1530 00000100:00080000:2.0:1780997301.270963:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997301.275114:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997301.275186:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110453504 00000100:00100000:2.0:1780997301.275205:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110453504 00000100:00100000:2.0:1780997301.275265:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2174 00000100:00100000:2.0:1780997301.275291:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adeddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:72832:x1867507110453504:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1780997301.275323:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780997301.275380:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adeddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:72832:x1867507110453504:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997301.275387:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2174 00000100:00080000:3.0:1780997301.275511:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997301.277923:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997301.278306:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110453632 00000100:00100000:1.0:1780997301.278318:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110453632 00000100:00100000:1.0:1780997301.278385:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2175 00000100:00100000:1.0:1780997301.278397:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adeded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:72832:x1867507110453632:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:1.0:1780997301.278427:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997301.278495:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adeded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:72832:x1867507110453632:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 101us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997301.278503:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2175 00000100:00080000:3.0:1780997301.279422:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1780997301.992116:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1780997302.187691:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969477 is committed 00000001:00080000:2.0:1780997302.187716:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969473 is committed 00000001:00080000:1.0:1780997302.190081:0:72364:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378831 is committed 00000020:00080000:1.0:1780997302.190201:0:72364:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9689bcc999c0 refcount 2 committed 0 result 0 batchid 77309411391 00000020:00080000:1.0:1780997302.190207:0:72364:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9689bca70c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9689bcc99cc0 00000020:00080000:1.0:1780997302.190210:0:72364:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].6 00000020:00080000:1.0:1780997302.190213:0:72364:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9689bca70100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9689b1074800 00000020:00080000:1.0:1780997302.190216:0:72364:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].7 00010000:00010000:2.0:1780997302.190558:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3600/0x30fd811c0305ba9a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190571:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3600/0x30fd811c0305ba9a lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190579:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3600/0x30fd811c0305ba9a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190586:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.190591:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3600/0x30fd811c0305ba9a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190600:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3600/0x30fd811c0305ba9a lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190618:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:2.0:1780997302.190622:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.190627:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3600/0x30fd811c0305ba9a lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190651:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3600/0x30fd811c0305ba9a lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190673:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bb0a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190678:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bb0a lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190684:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bb0a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190689:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.190692:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bb0a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190698:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bb0a lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190706:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898b4c3300) 00010000:00010000:2.0:1780997302.190708:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780997302.190711:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bb0a lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190716:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bb0a lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190732:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305bb1f lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190738:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305bb1f lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190749:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305bb1f lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190754:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.190758:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305bb1f lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190764:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305bb1f lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190773:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x9beb5ca3 (ffff96898712d400) 00010000:00010000:2.0:1780997302.190776:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.190780:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305bb1f lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190792:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305bb1f lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190811:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3800/0x30fd811c0305bb34 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190817:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3800/0x30fd811c0305bb34 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190823:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3800/0x30fd811c0305bb34 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190829:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.190831:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3800/0x30fd811c0305bb34 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190847:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3800/0x30fd811c0305bb34 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190866:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff968983653b00) 00010000:00010000:2.0:1780997302.190869:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.190873:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3800/0x30fd811c0305bb34 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190879:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3800/0x30fd811c0305bb34 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190892:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2000/0x30fd811c0305bb50 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190898:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2000/0x30fd811c0305bb50 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190904:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2000/0x30fd811c0305bb50 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190909:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.190911:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2000/0x30fd811c0305bb50 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190917:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2000/0x30fd811c0305bb50 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190924:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xe44515a3 (ffff968983653a00) 00010000:00010000:2.0:1780997302.190927:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.190929:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2000/0x30fd811c0305bb50 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190941:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2000/0x30fd811c0305bb50 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190973:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb65 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190980:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb65 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190986:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb65 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.190992:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.190995:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb65 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191002:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb65 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191012:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff968983653e00) 00010000:00010000:2.0:1780997302.191015:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191018:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb65 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191024:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2200/0x30fd811c0305bb65 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191035:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305bb81 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191042:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305bb81 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191055:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305bb81 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191061:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.191063:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305bb81 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191069:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305bb81 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191077:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x2c9ecea3 (ffff96898d864600) 00010000:00010000:2.0:1780997302.191080:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191083:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305bb81 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191088:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305bb81 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191118:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bb96 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191125:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bb96 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191130:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bb96 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191135:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.191138:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bb96 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191152:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bb96 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191160:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff9689896fe500) 00010000:00010000:2.0:1780997302.191162:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191165:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bb96 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191170:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bb96 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191184:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2400/0x30fd811c0305bbb2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191190:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2400/0x30fd811c0305bbb2 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191196:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2400/0x30fd811c0305bbb2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191202:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.191204:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2400/0x30fd811c0305bbb2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191210:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2400/0x30fd811c0305bbb2 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191218:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x74f887a3 (ffff968983653400) 00010000:00010000:2.0:1780997302.191220:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191222:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2400/0x30fd811c0305bbb2 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191234:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2400/0x30fd811c0305bbb2 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191252:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bbc7 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191258:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bbc7 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191264:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bbc7 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191316:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.191320:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bbc7 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191326:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bbc7 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191336:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff968983653c00) 00010000:00010000:2.0:1780997302.191339:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191342:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bbc7 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191347:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3c00/0x30fd811c0305bbc7 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1780997302.191350:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411391 committed batchid 77309411390 00010000:00010000:2.0:1780997302.191360:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2800/0x30fd811c0305bbe3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191367:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2800/0x30fd811c0305bbe3 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191381:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2800/0x30fd811c0305bbe3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191387:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.191391:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2800/0x30fd811c0305bbe3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191397:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2800/0x30fd811c0305bbe3 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191406:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xbd5240a3 (ffff968983653f00) 00010000:00010000:2.0:1780997302.191409:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191412:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2800/0x30fd811c0305bbe3 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191418:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2800/0x30fd811c0305bbe3 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1780997302.191420:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411390 00010000:00010000:2.0:1780997302.191439:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbf8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191447:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbf8 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191453:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbf8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191459:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.191462:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbf8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191478:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbf8 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191488:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff968983653700) 00010000:00010000:2.0:1780997302.191490:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191493:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbf8 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191499:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3200/0x30fd811c0305bbf8 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191511:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bc14 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191516:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bc14 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191522:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bc14 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191528:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.191532:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bc14 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191539:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bc14 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191547:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x5abf9a3 (ffff968983653600) 00010000:00010000:2.0:1780997302.191550:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191553:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bc14 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191566:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2600/0x30fd811c0305bc14 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191587:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc29 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191594:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc29 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191600:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc29 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191606:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.191610:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc29 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191617:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc29 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191626:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff968983653d00) 00010000:00010000:2.0:1780997302.191629:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191632:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc29 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191639:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3000/0x30fd811c0305bc29 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191652:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2a00/0x30fd811c0305bc45 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191659:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2a00/0x30fd811c0305bc45 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191671:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2a00/0x30fd811c0305bc45 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191676:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.191679:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2a00/0x30fd811c0305bc45 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191685:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2a00/0x30fd811c0305bc45 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191693:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x4e05b2a3 (ffff968983653000) 00010000:00010000:2.0:1780997302.191695:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191698:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2a00/0x30fd811c0305bc45 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191704:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb2a00/0x30fd811c0305bc45 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191720:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc5a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191726:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc5a lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191732:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc5a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191736:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.191739:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc5a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191754:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc5a lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191763:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff968983653200) 00010000:00010000:2.0:1780997302.191766:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191769:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc5a lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191775:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305bc5a lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191787:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bc76 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191794:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bc76 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191800:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bc76 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191805:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.191808:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bc76 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191815:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bc76 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191823:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x965f6ba3 (ffff96898712d300) 00010000:00010000:2.0:1780997302.191826:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191829:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bc76 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191842:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bc76 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191871:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bc8b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191877:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bc8b lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191884:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bc8b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191890:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4eee00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.191893:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bc8b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191899:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bc8b lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191909:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xe:0x0].0x0 (ffff96898d864f00) 00010000:00010000:2.0:1780997302.191911:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191914:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bc8b lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191920:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305bc8b lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191932:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305bca7 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191939:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305bca7 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191951:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305bca7 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191957:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.191959:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305bca7 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191966:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305bca7 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191975:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xdeb924a3 (ffff96898d864e00) 00010000:00010000:2.0:1780997302.191977:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.191981:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305bca7 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.191987:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305bca7 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192004:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bcbc lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192010:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bcbc lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192016:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bcbc lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192021:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.192024:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bcbc lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192042:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bcbc lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192051:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xf:0x0].0x0 (ffff968983653300) 00010000:00010000:2.0:1780997302.192054:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.192057:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bcbc lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192063:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3400/0x30fd811c0305bcbc lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192075:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bcd8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192081:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bcd8 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192087:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bcd8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192093:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.192096:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bcd8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192102:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bcd8 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192109:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x6e9b5ca3 (ffff9689896fe600) 00010000:00010000:2.0:1780997302.192111:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.192114:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bcd8 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192126:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305bcd8 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192144:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bced lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192150:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bced lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192156:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bced lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192162:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ef000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.192166:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bced lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192172:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bced lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192181:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x10:0x0].0x0 (ffff96898d864b00) 00010000:00010000:2.0:1780997302.192183:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.192186:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bced lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192193:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305bced lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192203:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305bd09 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192210:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305bd09 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192223:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305bd09 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192229:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.192233:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305bd09 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192240:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305bd09 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192248:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xc8545ca3 (ffff96898d864800) 00010000:00010000:2.0:1780997302.192251:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.192253:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305bd09 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192259:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305bd09 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192303:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bd1e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192311:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bd1e lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192316:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bd1e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192322:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.192325:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bd1e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192342:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bd1e lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192352:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x11:0x0].0x0 (ffff96898d864200) 00010000:00010000:2.0:1780997302.192355:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.192359:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bd1e lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192365:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bd1e lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192380:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305bd3a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192387:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305bd3a lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192393:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305bd3a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192400:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.192403:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305bd3a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192409:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305bd3a lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192416:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x220d5ca3 (ffff9689896fe000) 00010000:00010000:2.0:1780997302.192419:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.192422:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305bd3a lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192434:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305bd3a lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192451:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bd4f lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192457:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bd4f lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192463:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bd4f lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192468:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.192471:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bd4f lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192478:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bd4f lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192486:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x12:0x0].0x0 (ffff96898d864000) 00010000:00010000:2.0:1780997302.192488:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.192490:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bd4f lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192495:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bd4f lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192506:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bd6b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192512:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bd6b lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192525:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bd6b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192530:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.192533:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bd6b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192539:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bd6b lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192547:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x7bc65ca3 (ffff96898d864c00) 00010000:00010000:2.0:1780997302.192549:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.192553:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bd6b lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192558:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bd6b lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192575:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305bd80 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192581:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305bd80 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192587:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305bd80 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192592:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980030000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.192594:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305bd80 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192610:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305bd80 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192618:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x13:0x0].0x0 (ffff96898712dc00) 00010000:00010000:2.0:1780997302.192620:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.192623:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305bd80 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192629:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968980030000/0x30fd811c0305bd80 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192642:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd9c lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192649:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd9c lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192654:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd9c lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192658:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.192661:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd9c lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192667:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd9c lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192674:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xd57f5ca3 (ffff9689896fe300) 00010000:00010000:2.0:1780997302.192676:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.192679:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd9c lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192692:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305bd9c lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192709:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305bdb1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192714:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305bdb1 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192720:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305bdb1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192725:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.192728:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305bdb1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192734:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305bdb1 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192741:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x14:0x0].0x0 (ffff96898d864700) 00010000:00010000:2.0:1780997302.192743:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.192746:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305bdb1 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192752:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305bdb1 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192762:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305bdcd lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192769:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305bdcd lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192781:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305bdcd lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.192787:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.192789:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305bdcd lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201258:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305bdcd lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201290:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x2f385ca3 (ffff968983653800) 00010000:00010000:2.0:1780997302.201293:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.201299:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305bdcd lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201305:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305bdcd lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201342:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305bde2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201349:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305bde2 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201355:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305bde2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201361:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888954a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.201364:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305bde2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201380:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305bde2 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201388:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x15:0x0].0x0 (ffff9689882bd000) 00010000:00010000:2.0:1780997302.201390:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.201394:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305bde2 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201400:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305bde2 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201414:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bdfe lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201419:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bdfe lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201425:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bdfe lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201430:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.201433:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bdfe lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201439:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bdfe lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201447:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x88f15ca3 (ffff9689896feb00) 00010000:00010000:2.0:1780997302.201449:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.201451:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bdfe lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201464:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305bdfe lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201484:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968980031c00/0x30fd811c0305be13 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201491:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968980031c00/0x30fd811c0305be13 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201497:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968980031c00/0x30fd811c0305be13 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201503:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.201506:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968980031c00/0x30fd811c0305be13 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201512:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968980031c00/0x30fd811c0305be13 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201520:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x16:0x0].0x0 (ffff96898712de00) 00010000:00010000:2.0:1780997302.201522:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.201526:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968980031c00/0x30fd811c0305be13 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201531:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968980031c00/0x30fd811c0305be13 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201546:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305be2f lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201553:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305be2f lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201565:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305be2f lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201571:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.201574:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305be2f lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201580:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305be2f lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201589:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xe2aa5ca3 (ffff9689896fe900) 00010000:00010000:2.0:1780997302.201591:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.201594:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305be2f lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201599:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305be2f lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201615:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305be44 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201621:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305be44 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201626:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305be44 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201631:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.201634:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305be44 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201650:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305be44 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201661:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x17:0x0].0x0 (ffff9689896fee00) 00010000:00010000:2.0:1780997302.201663:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.201666:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305be44 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201673:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305be44 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201685:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305be60 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201692:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305be60 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201698:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305be60 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201704:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffd400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.201707:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305be60 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201714:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305be60 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201723:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x3c635ca3 (ffff9689896fe100) 00010000:00010000:2.0:1780997302.201726:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.201729:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305be60 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201742:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305be60 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201759:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305be75 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201766:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305be75 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201773:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305be75 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201779:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.201782:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305be75 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201789:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305be75 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201798:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x18:0x0].0x0 (ffff96898712d900) 00010000:00010000:2.0:1780997302.201801:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.201805:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305be75 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201811:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305be75 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201822:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e000/0x30fd811c0305be91 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201829:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e000/0x30fd811c0305be91 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201841:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e000/0x30fd811c0305be91 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201846:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.201849:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e000/0x30fd811c0305be91 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.201854:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e000/0x30fd811c0305be91 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1780997302.202745:0:72364:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411391 batchid updated 00000020:00080000:3.0:1780997302.202800:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411391 00000004:00080000:3.0:1780997302.202867:0:72384:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9689bbc72f00 with version 21 00000020:00080000:3.0:1780997302.202886:0:72384:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411391 cancel update log [0x2000088d1:0x2:0x0].6: rc = 0 00000020:00080000:3.0:1780997302.202964:0:72384:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411391 cancel update log [0x2400090a0:0x2:0x0].7: rc = 0 00000020:00080000:3.0:1780997302.202972:0:72384:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411391 00000004:00080000:0.0:1780997302.203049:0:72369:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff968889e33300 version 21 rpc_version 21 00000020:00100000:0.0:1780997302.203087:0:72369:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1780997302.203099:0:72369:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9689bfaa9c00 x1867507127038592/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997302.203124:0:72369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa9c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507127038592:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1780997302.203193:0:72369:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997302.203232:0:72369:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997302.203302:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127038592 00000100:00100000:3.0:1780997302.203312:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127038592 00000100:00100000:3.0:1780997302.203365:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4134 00000100:00100000:3.0:1780997302.203374:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:72369:x1867507127038592:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1780997302.203511:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:72369:x1867507127038592:12345-0@lo:1000:osp_up0-1.0 Request processed in 137us (317us total) trans 120259084290 rc 0/0 00000100:00100000:3.0:1780997302.203519:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4134 00000100:00100000:3.0:1780997302.203569:0:72369:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa9c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72369:1867507127038592:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1780997302.205091:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x961c5ca3 (ffff9689896ff000) 00010000:00010000:2.0:1780997302.205095:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.205102:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e000/0x30fd811c0305be91 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205111:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e000/0x30fd811c0305be91 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205140:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305bea6 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205148:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305bea6 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205155:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305bea6 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205162:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffcc00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.205166:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305bea6 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205194:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305bea6 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205205:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x19:0x0].0x0 (ffff9689896fed00) 00010000:00010000:2.0:1780997302.205208:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.205212:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305bea6 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205218:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305bea6 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205232:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305bec2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205238:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305bec2 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205244:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305bec2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205250:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.205253:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305bec2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205259:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305bec2 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205266:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xb6f515a3 (ffff9689896ff600) 00010000:00010000:2.0:1780997302.205285:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.205291:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305bec2 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205304:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305bec2 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205321:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bed7 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205328:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bed7 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205335:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bed7 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205340:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997302.205343:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bed7 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205349:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bed7 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205358:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1a:0x0].0x0 (ffff96898712d500) 00010000:00010000:2.0:1780997302.205361:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997302.205364:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bed7 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997302.205369:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bed7 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780997302.211566:0:90240:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084290 is committed 00000100:00100000:0.0:1780997302.343463:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997302.343644:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110453888 00000100:00100000:1.0:1780997302.343654:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110453888 00000100:00100000:1.0:1780997302.343710:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1531 00000100:00100000:1.0:1780997302.343720:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:72874:x1867507110453888:12345-192.168.206.51@tcp:36:mcreate.0 00010000:00010000:1.0:1780997302.343792:0:65272:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997302.343817:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0e00/0x30fd811c0305bad9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ee8 expref: 11 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.343840:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:1.0:1780997302.343844:0:65272:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780997302.343915:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305bee5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.343929:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305bee5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.343939:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305bee5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.343951:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305beec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.343958:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305beec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.343964:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305beec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.344367:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305bee5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.344376:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305bee5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.344383:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305bee5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.344389:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305bee5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.344404:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffda00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997302.344409:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305bee5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.344417:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305bee5 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.344425:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:1.0:1780997302.344428:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997302.344432:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305bee5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.344439:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305bee5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780997302.344449:0:65272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da54fcb6 reply state 00000000fa39a8b3 transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305beec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.344459:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305beec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.344466:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff968983c39700) 00010000:00010000:1.0:1780997302.344468:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997302.345796:0:65272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780997302.346046:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:72874:x1867507110453888:12345-192.168.206.51@tcp:36:mcreate.0 Request processed in 2322us (2589us total) trans 120259084291 rc 0/0 00000100:00100000:1.0:1780997302.346055:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1531 00000100:00100000:2.0:1780997302.375702:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997302.376001:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110454016 00000100:00100000:0.0:1780997302.376013:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110454016 00000100:00100000:0.0:1780997302.376081:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1532 00000100:00100000:0.0:1780997302.376090:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:72877:x1867507110454016:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1780997302.376123:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997302.376142:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954e00/0x30fd811c0305bef3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9015 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997302.376209:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c0305befa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997302.376225:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c0305befa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997302.376238:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c0305befa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997302.376306:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780997302.376310:0:63418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997302.376330:0:63418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c0305befa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997302.376354:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954e00/0x30fd811c0305bef3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9015 expref: 14 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997302.376377:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c0305befa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9015 expref: 13 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997302.376386:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:0.0:1780997302.376388:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780997302.376392:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954a00, rc 0) 00000100:00100000:0.0:1780997302.376440:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:72877:x1867507110454016:12345-192.168.206.51@tcp:101:rm.0 Request processed in 352us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997302.376447:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1532 00000100:00100000:1.0:1780997302.382724:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997302.382761:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110454144 00000100:00100000:1.0:1780997302.382778:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110454144 00000100:00100000:1.0:1780997302.382841:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1533 00000100:00100000:1.0:1780997302.382852:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:72877:x1867507110454144:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:1.0:1780997302.382960:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997302.382985:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305bf01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae901c expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383058:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305bf08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383074:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305bf08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383086:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305bf08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383097:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305bf0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383105:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305bf0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383113:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305bf0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383520:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc000/0x30fd811c0305bf16 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383529:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc000/0x30fd811c0305bf16 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383537:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc000/0x30fd811c0305bf16 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997302.383657:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x5:0x0]: returning size 0 00000004:00200000:1.0:1780997302.383662:0:80049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780997302.383688:0:80049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc000/0x30fd811c0305bf16 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383701:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc000/0x30fd811c0305bf16 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383709:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305bf08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383715:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305bf08 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383721:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305bf08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383728:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffcc00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997302.383732:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305bf08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383740:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305bf08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383752:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:1.0:1780997302.383755:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997302.383760:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305bf08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383766:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffcc00/0x30fd811c0305bf08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383791:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305bf0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383797:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305bf0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383803:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305bf0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383808:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffd400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997302.383812:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305bf0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383818:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305bf0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383826:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff968983c39700) 00010000:00010000:1.0:1780997302.383828:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997302.383831:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305bf0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383837:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffd400/0x30fd811c0305bf0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383948:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffda00/0x30fd811c0305bf01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae901c expref: 15 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383967:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc000/0x30fd811c0305bf16 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae901c expref: 14 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997302.383987:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x5:0x0].0x0 (ffff968983c39800) 00010000:00010000:1.0:1780997302.383989:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997302.383992:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffc000, rc 0) 00000100:00100000:1.0:1780997302.384057:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:72877:x1867507110454144:12345-192.168.206.51@tcp:101:rm.0 Request processed in 1205us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997302.384066:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1533 00000100:00100000:0.0:1780997302.399118:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997302.399465:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110454400 00000100:00100000:3.0:1780997302.399476:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110454400 00000100:00100000:3.0:1780997302.399531:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1534 00000100:00100000:3.0:1780997302.399542:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:72877:x1867507110454400:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:3.0:1780997302.399597:0:63419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1780997302.399635:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffc000/0x30fd811c0305bf16 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae901c expref: 14 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.399665:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x5:0x0].0x0 (ffff968983c39800) 00010000:00010000:3.0:1780997302.399686:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888954a00/0x30fd811c0305befa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9015 expref: 13 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.399723:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:3.0:1780997302.399726:0:63419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997302.399749:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0200/0x30fd811c0305bf1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.399763:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0200/0x30fd811c0305bf1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.399772:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0200/0x30fd811c0305bf1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.399782:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305bf24 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.399788:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305bf24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.399794:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305bf24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.399885:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bf2b lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.399894:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bf2b lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.399900:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bf2b lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400079:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305bf32 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400097:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305bf32 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400105:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305bf32 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400112:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305bf32 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400118:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305bf32 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400125:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305bf32 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400149:0:63419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780997302.400169:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bf2b lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400176:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bf2b lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400182:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bf2b lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400188:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997302.400192:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bf2b lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400199:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bf2b lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400217:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x5:0x0].0x0 (ffff96898712df00) 00010000:00010000:3.0:1780997302.400219:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1780997302.400223:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bf2b lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400229:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bf2b lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400243:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0200/0x30fd811c0305bf1d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400250:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0200/0x30fd811c0305bf1d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400255:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0200/0x30fd811c0305bf1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400261:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0200/0x30fd811c0305bf1d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400265:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997302.400297:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0200/0x30fd811c0305bf1d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400304:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0200/0x30fd811c0305bf1d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400313:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:3.0:1780997302.400315:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997302.400319:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0200/0x30fd811c0305bf1d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400334:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0200/0x30fd811c0305bf1d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780997302.400344:0:63419:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033abae15 reply state 0000000075560ed3 transno 120259084292 ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305bf24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400356:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305bf24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997302.400362:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff968983c39700) 00010000:00010000:3.0:1780997302.400375:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997302.400378:0:63419:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780997302.400461:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:72877:x1867507110454400:12345-192.168.206.51@tcp:36:rm.0 Request processed in 921us (1352us total) trans 120259084292 rc 0/0 00000100:00100000:3.0:1780997302.400469:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1534 00010000:00010000:0.0:1780997302.402253:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997302.402266:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305bf32 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997302.402290:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0400 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:0.0:1780997302.402294:0:6339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305bf32 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997302.402305:0:6339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305bf32 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997302.402320:0:6339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x5:0x0].0x0 (ffff96898712df00) 00010000:00010000:0.0:1780997302.402324:0:6339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1780997302.402327:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305bf32 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997302.402334:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0400/0x30fd811c0305bf32 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997302.402353:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997302.402355:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997302.402356:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997303.013463:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997303.206230:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507127038848:0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.206249:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968986954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127038720:0@lo:400:kworker.0 00000100:00100000:0.0:1780997303.206333:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507127038976:0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.206776:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997303.206813:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127039232:0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.206838:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997303.206870:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507127039744:0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.206892:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997303.206917:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507127040256:0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.206944:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997303.206961:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780997303.207514:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127039872:0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.208730:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997303.209376:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507127039104:0@lo:400:kworker.0 00000100:00100000:1.0:1780997303.209422:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997303.209469:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127039360:0@lo:400:kworker.0 00000100:00100000:1.0:1780997303.209503:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997303.209530:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127039872 00000100:00100000:1.0:1780997303.209536:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127040384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997303.209541:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127039872 00000100:00100000:1.0:1780997303.209564:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997303.209597:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127039360 00000100:00100000:0.0:1780997303.209602:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127039360 00000100:00100000:1.0:1780997303.209609:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127039232 00000100:00100000:1.0:1780997303.209617:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127039232 00000100:00100000:0.0:1780997303.209623:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127040384 00000100:00100000:0.0:1780997303.209628:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127040384 00000100:00100000:3.0:1780997303.209642:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127038720 00000100:00100000:3.0:1780997303.209650:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127038720 00000100:00100000:0.0:1780997303.209665:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4135 00000100:00100000:1.0:1780997303.209668:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127039744 00000100:00100000:1.0:1780997303.209674:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127039744 00000100:00100000:0.0:1780997303.209678:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507127039872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.209695:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1780997303.209700:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1780997303.209706:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507127038720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997303.209712:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adedf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127039232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.209763:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507127038720:12345-0@lo:400:kworker.0 Request processed in 60us (2988us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997303.209766:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adedf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127039232:12345-0@lo:400:kworker.0 Request processed in 57us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997303.209776:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1780997303.209779:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:1.0:1780997303.209798:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127040256 00000100:00100000:1.0:1780997303.209802:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127040256 00000100:00100000:3.0:1780997303.209819:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127038848 00000100:00100000:3.0:1780997303.209824:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127038848 00000100:00100000:1.0:1780997303.209835:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:1.0:1780997303.209844:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507127039744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.209864:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1780997303.209874:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507127040256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.209906:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507127040256:12345-0@lo:400:kworker.0 Request processed in 34us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997303.209912:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1780997303.209923:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:3.0:1780997303.209929:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507127038848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.209962:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507127038848:12345-0@lo:400:kworker.0 Request processed in 34us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997303.209968:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:3.0:1780997303.209994:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4136 00000100:00100000:3.0:1780997303.210000:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3499:x1867507127039360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.210032:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3499:x1867507127039360:12345-0@lo:400:kworker.0 Request processed in 33us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997303.210039:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4136 00000100:00100000:3.0:1780997303.210054:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4137 00000100:00100000:3.0:1780997303.210067:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507127040384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780997303.210090:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:3.0:1780997303.210120:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3499:x1867507127040384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997303.210127:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4137 00000100:00100000:1.0:1780997303.210222:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507127039744:12345-0@lo:400:kworker.0 Request processed in 378us (3328us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997303.210229:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:0.0:1780997303.210380:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507127039872:12345-0@lo:400:kworker.0 Request processed in 706us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997303.210388:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4135 00000100:00100000:0.0:1780997303.210413:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997303.210437:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968990f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127039616:0@lo:400:kworker.0 00000100:00100000:0.0:1780997303.210468:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997303.210497:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127040128:0@lo:400:kworker.0 00000100:00100000:1.0:1780997303.210499:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127039616 00000100:00100000:1.0:1780997303.210505:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127039616 00000100:00100000:0.0:1780997303.210528:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997303.210564:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997303.210570:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127040512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997303.210592:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997303.210779:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127040128 00000100:00100000:1.0:1780997303.210784:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127040128 00000100:00100000:1.0:1780997303.210829:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703 00000100:00100000:1.0:1780997303.210837:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127039616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997303.210896:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704 00000100:00100000:0.0:1780997303.210906:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127040128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.211306:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127040512 00000100:00100000:0.0:1780997303.211310:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127040128:12345-0@lo:400:kworker.0 Request processed in 404us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997303.211312:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127040512 00000100:00100000:0.0:1780997303.211321:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704 00000100:00100000:3.0:1780997303.211344:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4138 00000100:00100000:3.0:1780997303.211352:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3497:x1867507127040512:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997303.211363:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1780997303.211378:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:0.0:1780997303.211395:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127039488:0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.211417:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3497:x1867507127040512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997303.211425:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4138 00000100:00100000:0.0:1780997303.211433:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780997303.211452:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997303.211458:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780997303.211460:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127040000:0@lo:400:kworker.0 00000100:00080000:3.0:1780997303.211462:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997303.211476:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127039104 00000100:00100000:3.0:1780997303.211480:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127039104 00000100:00100000:0.0:1780997303.211489:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997303.211511:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127038976 00000100:00100000:3.0:1780997303.211515:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127038976 00000100:00100000:0.0:1780997303.211527:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127039488 00000100:00100000:0.0:1780997303.211532:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127039488 00000100:00100000:0.0:1780997303.211555:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127040000 00000100:00100000:0.0:1780997303.211569:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127040000 00000100:00100000:0.0:1780997303.211591:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00100000:0.0:1780997303.211597:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127039488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997303.211632:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127039488:12345-0@lo:400:kworker.0 Request processed in 34us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997303.211638:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00100000:0.0:1780997303.211649:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706 00000100:00100000:0.0:1780997303.211654:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127040000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997303.211682:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127040000:12345-0@lo:400:kworker.0 Request processed in 28us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997303.211688:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706 00000100:00100000:0.0:1780997303.211724:0:3496:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969473 gen 2 00000100:00100000:0.0:1780997303.211753:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127039488:0@lo:400:kworker.0 00000100:00100000:0.0:1780997303.211762:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127040000:0@lo:400:kworker.0 00000100:00100000:2.0:1780997303.211969:0:3497:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084290 gen 3 00000004:00080000:2.0:1780997303.211976:0:3497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 120259084290 committed transno 120259084290 00000100:00100000:2.0:1780997303.212006:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127040512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997303.212022:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127040128:0@lo:400:kworker.0 00000100:00100000:2.0:1780997303.212341:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1780997303.212351:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507127039104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997303.212402:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507127039104:12345-0@lo:400:kworker.0 Request processed in 53us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997303.212407:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1780997303.212456:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507127039104:0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.212462:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1780997303.212473:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507127038976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997303.212498:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127040384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997303.212514:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507127038848:0@lo:400:kworker.0 00000100:00100000:2.0:1780997303.212526:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127039360:0@lo:400:kworker.0 00000100:00100000:2.0:1780997303.212559:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127039872:0@lo:400:kworker.0 00000100:00100000:2.0:1780997303.212571:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507127040256:0@lo:400:kworker.0 00000100:00100000:2.0:1780997303.212581:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968986954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127038720:0@lo:400:kworker.0 00000100:00100000:2.0:1780997303.212591:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127039232:0@lo:400:kworker.0 00000100:00100000:2.0:1780997303.212602:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507127039744:0@lo:400:kworker.0 00000100:00100000:3.0:1780997303.212629:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507127038976:12345-0@lo:400:kworker.0 Request processed in 157us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997303.212636:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00080000:3.0:1780997303.212659:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780997303.212664:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997303.212666:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780997303.212702:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507127038976:0@lo:400:kworker.0 00000100:00100000:1.0:1780997303.218468:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127039616:12345-0@lo:400:kworker.0 Request processed in 7621us (7987us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997303.218484:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703 00000100:00100000:3.0:1780997303.218574:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968990f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127039616:0@lo:400:kworker.0 00000100:00100000:1.0:1780997303.717590:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127040640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997303.717680:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997303.717781:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127040640 00000100:00100000:2.0:1780997303.717789:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127040640 00000100:00100000:2.0:1780997303.717847:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00100000:2.0:1780997303.717865:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127040640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780997303.717894:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997303.717955:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127040640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997303.717963:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00100000:1.0:1780997303.718162:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127040640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997303.719085:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780997303.719098:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127040768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780997303.719141:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997303.719209:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127040768 00000100:00100000:0.0:1780997303.719216:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127040768 00000100:00100000:0.0:1780997303.721537:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177 00000100:00100000:0.0:1780997303.721561:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127040768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780997303.721597:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000080:0.0:1780997303.721615:0:14235:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a5c44000 x1867507127040768/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:634/0 lens 224/368 e 0 to 0 dl 1780997314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997303.721704:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127040768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997303.721712:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177 00000100:00100000:2.0:1780997303.721797:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127040768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1780997304.038438:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780997304.070340:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997304.070387:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997304.070415:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997304.070442:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997304.070471:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997304.070499:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110455040 00000100:00100000:1.0:1780997304.070509:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110455040 00000100:00100000:1.0:1780997304.070580:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110454912 00000100:00100000:1.0:1780997304.070584:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110454912 00000100:00100000:1.0:1780997304.070627:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2707 00000100:00100000:1.0:1780997304.070637:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110455040:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997304.070730:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110455040:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 93us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997304.070737:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2707 00000100:00100000:1.0:1780997304.070756:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2708 00000100:00100000:1.0:1780997304.070762:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2396:x1867507110454912:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000080:1.0:1780997304.070782:0:25181:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a5c47b80 x1867507110454912/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:635/0 lens 224/224 e 0 to 0 dl 1780997315 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997304.071026:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110454784 00000100:00100000:2.0:1780997304.071032:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110454784 00000100:00100000:2.0:1780997304.071060:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110454656 00000100:00100000:2.0:1780997304.071063:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110454656 00000100:00100000:2.0:1780997304.071080:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1430 00000100:00100000:2.0:1780997304.071088:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+31:2396:x1867507110454784:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997304.071119:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+31:2396:x1867507110454784:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997304.071125:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1430 00000100:00100000:2.0:1780997304.071138:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1431 00000100:00100000:2.0:1780997304.071144:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:2396:x1867507110454656:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997304.071174:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:2396:x1867507110454656:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997304.071179:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1431 00000100:00100000:1.0:1780997304.071216:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2396:x1867507110454912:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 43us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997304.071225:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2708 00000100:00080000:1.0:1780997304.071250:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780997304.071254:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997304.071257:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780997304.071259:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997304.071706:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110454528 00000100:00100000:3.0:1780997304.071712:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110454528 00000100:00100000:3.0:1780997304.071755:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:3.0:1780997304.071763:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2396:x1867507110454528:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997304.071826:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2396:x1867507110454528:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 65us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997304.071833:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:1.0:1780997304.742373:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127040896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997304.742439:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997304.742497:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127040896 00000100:00100000:1.0:1780997304.742505:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127040896 00000100:00100000:1.0:1780997304.742546:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178 00000100:00100000:1.0:1780997304.742555:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127040896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997304.742578:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997304.742621:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127040896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997304.742641:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178 00000100:00100000:1.0:1780997304.742691:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127040896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780997304.742805:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780997304.742821:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127041024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780997304.742858:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997304.742885:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127041024 00000100:00100000:0.0:1780997304.742889:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127041024 00000100:00100000:0.0:1780997304.742915:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179 00000100:00100000:0.0:1780997304.742921:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127041024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997304.742933:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000080:0.0:1780997304.742944:0:8234:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff96888b337100 x1867507127041024/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:635/0 lens 224/368 e 0 to 0 dl 1780997315 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997304.742976:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127041024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997304.742983:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179 00000100:00100000:0.0:1780997304.743017:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127041024:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1780997305.062697:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997306.085518:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997307.111447:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997308.133636:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997308.332932:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780997308.332962:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127041280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780997308.333066:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997308.333110:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780997308.333119:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127041152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997308.333569:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997308.333610:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127041280 00000100:00100000:3.0:1780997308.333618:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127041280 00000100:00100000:3.0:1780997308.333684:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127041152 00000100:00100000:3.0:1780997308.333687:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127041152 00000100:00100000:3.0:1780997308.333712:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4139 00000100:00100000:3.0:1780997308.333721:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3499:x1867507127041280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780997308.333905:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:3.0:1780997308.333957:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3499:x1867507127041280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 236us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997308.333979:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4139 00000100:00100000:3.0:1780997308.333996:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4140 00000100:00100000:3.0:1780997308.334003:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127041152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780997308.334024:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:3.0:1780997308.334265:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127041152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 261us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997308.334290:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4140 00000100:00100000:3.0:1780997308.334428:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127041152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997308.337246:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127041280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997308.337840:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888d28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507127041792:0@lo:400:kworker.0 00000100:00100000:1.0:1780997308.337902:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997308.337930:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888d28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507127042304:0@lo:400:kworker.0 00000100:00100000:1.0:1780997308.337953:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997308.337976:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1780997308.337983:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127041408:0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.338005:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888d28f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507127041664:0@lo:400:kworker.0 00000100:00100000:1.0:1780997308.338013:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997308.338046:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997308.338081:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127041792 00000100:00100000:0.0:1780997308.338096:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127041792 00000100:00100000:0.0:1780997308.338160:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127042304 00000100:00100000:0.0:1780997308.338164:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127042304 00000100:00100000:0.0:1780997308.338180:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127041664 00000100:00100000:0.0:1780997308.338182:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127041664 00000100:00100000:0.0:1780997308.338204:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:0.0:1780997308.338212:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507127041792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.338256:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507127041792:12345-0@lo:400:kworker.0 Request processed in 45us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.338263:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:0.0:1780997308.338306:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1780997308.338312:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507127042304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.338342:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507127042304:12345-0@lo:400:kworker.0 Request processed in 30us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.338348:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1780997308.338362:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:0.0:1780997308.338369:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507127041664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.338400:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507127041664:12345-0@lo:400:kworker.0 Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.338407:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:0.0:1780997308.338427:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888d28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507127041536:0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.338472:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997308.338491:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127041536 00000100:00100000:0.0:1780997308.338494:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127041536 00000100:00100000:0.0:1780997308.338514:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1780997308.338520:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507127041536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.338554:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507127041536:12345-0@lo:400:kworker.0 Request processed in 34us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.338560:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:1.0:1780997308.338974:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888d28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127041920:0@lo:400:kworker.0 00000100:00100000:1.0:1780997308.339006:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997308.339036:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127041920 00000100:00100000:1.0:1780997308.339040:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127041920 00000100:00100000:1.0:1780997308.339890:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:1.0:1780997308.339902:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127041920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997308.339962:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127041920:12345-0@lo:400:kworker.0 Request processed in 64us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997308.339969:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:1.0:1780997308.340002:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127041408 00000100:00100000:1.0:1780997308.340008:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127041408 00000100:00100000:1.0:1780997308.340041:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1780997308.340048:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507127041408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997308.340305:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507127041408:12345-0@lo:400:kworker.0 Request processed in 257us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997308.340323:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:1.0:1780997308.340355:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780997308.340360:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780997308.341774:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888d28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507127041536:0@lo:400:kworker.0 00000100:00100000:3.0:1780997308.341789:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888d28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127042048:0@lo:400:kworker.0 00000100:00100000:3.0:1780997308.341854:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997308.341884:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888d28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127042560:0@lo:400:kworker.0 00000100:00100000:3.0:1780997308.341910:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997308.341964:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127042048 00000100:00100000:3.0:1780997308.341971:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127042048 00000100:00100000:3.0:1780997308.342019:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127042560 00000100:00100000:3.0:1780997308.342022:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127042560 00000100:00100000:3.0:1780997308.342045:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709 00000100:00100000:3.0:1780997308.342068:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127042048:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1780997308.342088:0:25182:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bff6f100 x1867507127042048/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:639/0 lens 224/224 e 0 to 0 dl 1780997319 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997308.342358:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888d28f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507127041664:0@lo:400:kworker.0 00000100:00100000:1.0:1780997308.342369:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888d28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127042176:0@lo:400:kworker.0 00000100:00100000:1.0:1780997308.342399:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997308.342423:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888d28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507127042688:0@lo:400:kworker.0 00000100:00100000:1.0:1780997308.342462:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997308.342503:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127042176 00000100:00100000:1.0:1780997308.342508:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127042176 00000100:00100000:1.0:1780997308.342535:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710 00000100:00100000:1.0:1780997308.342542:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127042560:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1780997308.342757:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997308.342762:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780997308.342786:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888d28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127041920:0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.342795:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888d28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127042432:0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.342835:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997308.342863:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888d28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507127041792:0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.342886:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888d28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507127042304:0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.342910:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127041408:0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.342927:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127042432 00000100:00100000:0.0:1780997308.342930:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127042432 00000100:00100000:0.0:1780997308.342960:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00100000:0.0:1780997308.342967:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127042176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.343004:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127042176:12345-0@lo:400:kworker.0 Request processed in 37us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.343012:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000100:00100000:0.0:1780997308.343027:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:0.0:1780997308.343033:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127042432:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780997308.343045:0:25179:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff96888b334e00 x1867507127042432/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:639/0 lens 224/224 e 0 to 0 dl 1780997319 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997308.343074:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127042432:12345-0@lo:400:kworker.0 Request processed in 41us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.343080:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00080000:0.0:1780997308.343094:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780997308.343112:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888d28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127042432:0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.343131:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127042688 00000100:00100000:0.0:1780997308.343135:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127042688 00000100:00100000:0.0:1780997308.343159:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1780997308.343165:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507127042688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.343195:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507127042688:12345-0@lo:400:kworker.0 Request processed in 30us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.343211:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1780997308.343251:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888d28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127042176:0@lo:400:kworker.0 00000100:00100000:0.0:1780997308.343261:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888d28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507127042688:0@lo:400:kworker.0 00000100:00100000:3.0:1780997308.344339:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127042048:12345-0@lo:400:kworker.0 Request processed in 2280us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997308.344424:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709 00000100:00100000:2.0:1780997308.344673:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888d28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127042048:0@lo:400:kworker.0 00000100:00100000:1.0:1780997308.344965:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127042560:12345-0@lo:400:kworker.0 Request processed in 2422us (3053us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997308.344975:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710 00000001:00080000:3.0:1780997308.345699:0:90240:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084292 is committed 00010000:00010000:3.0:1780997308.345730:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305beec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.345742:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305beec lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.346535:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305beec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.346543:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffdc00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.346547:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305beec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.346556:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305beec lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.346574:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff968983c39700) 00010000:00010000:3.0:1780997308.346577:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.346582:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305beec lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.346588:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968889ffdc00/0x30fd811c0305beec lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.346606:0:3483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305bf24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.346612:0:3483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305bf24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.346628:0:3483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305bf24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.346633:0:3483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.346636:0:3483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305bf24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.346642:0:3483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305bf24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.346650:0:3483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb86e2a00 (ffff968983c39700) 00010000:00010000:3.0:1780997308.346653:0:3483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.346656:0:3483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305bf24 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.346661:0:3483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9689bc4c0000/0x30fd811c0305bf24 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb86e2a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997308.347182:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888d28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127042560:0@lo:400:kworker.0 00000001:02000400:2.0:1780997308.419007:0:91666:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:1.0:1780997308.619444:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.619688:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110455168 00000100:00100000:2.0:1780997308.619699:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110455168 00000100:00100000:2.0:1780997308.619834:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1535 00000100:00100000:2.0:1780997308.619861:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:72955:x1867507110455168:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997308.619882:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997308.619902:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f200/0x30fd811c0305bf39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9023 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.619970:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fa00/0x30fd811c0305bf40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.619983:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fa00/0x30fd811c0305bf40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.619995:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fa00/0x30fd811c0305bf40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997308.620042:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780997308.620045:0:63417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780997308.620080:0:63417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fa00/0x30fd811c0305bf40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.620102:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96888956f200/0x30fd811c0305bf39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9023 expref: 12 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.620119:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fa00/0x30fd811c0305bf40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9023 expref: 11 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.620128:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:2.0:1780997308.620131:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780997308.620134:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956fa00, rc 0) 00000100:00100000:2.0:1780997308.620214:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:72955:x1867507110455168:12345-192.168.206.51@tcp:101:dd.0 Request processed in 355us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997308.620232:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1535 00000100:00080000:0.0:1780997308.620924:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780997308.624854:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.625031:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110455296 00000100:00100000:0.0:1780997308.625041:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110455296 00000100:00100000:0.0:1780997308.625120:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1536 00000100:00100000:0.0:1780997308.625130:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:72957:x1867507110455296:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.625152:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.625174:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305bf47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae902a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.625239:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954000/0x30fd811c0305bf4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.625253:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888954000/0x30fd811c0305bf4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.625265:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888954000/0x30fd811c0305bf4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997308.625353:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780997308.625357:0:63418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997308.625381:0:63418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968888954000/0x30fd811c0305bf4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.625555:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955a00/0x30fd811c0305bf47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae902a expref: 13 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.625586:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888954000/0x30fd811c0305bf4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae902a expref: 12 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.625596:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:0.0:1780997308.625599:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780997308.625602:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954000, rc 0) 00000100:00100000:0.0:1780997308.625651:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:72957:x1867507110455296:12345-192.168.206.51@tcp:101:dd.0 Request processed in 523us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.625658:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1536 00000100:00100000:3.0:1780997308.628222:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.628419:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110455424 00000100:00100000:0.0:1780997308.628430:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110455424 00000100:00100000:0.0:1780997308.628511:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1537 00000100:00100000:0.0:1780997308.628520:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:72956:x1867507110455424:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.628541:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.628561:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305bf55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9031 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.628621:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c0305bf5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.628640:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c0305bf5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.628649:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c0305bf5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997308.628691:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780997308.628704:0:80049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780997308.628724:0:80049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c0305bf5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.628744:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955e00/0x30fd811c0305bf55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9031 expref: 14 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.628758:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c0305bf5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9031 expref: 13 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.628764:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:0.0:1780997308.628766:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780997308.628769:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955800, rc 0) 00000100:00100000:0.0:1780997308.628856:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:72956:x1867507110455424:12345-192.168.206.51@tcp:101:dd.0 Request processed in 337us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.628866:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1537 00000100:00100000:2.0:1780997308.639568:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.639666:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.639724:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.639806:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110455808 00000100:00100000:0.0:1780997308.639817:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110455808 00000100:00100000:0.0:1780997308.639895:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110455936 00000100:00100000:0.0:1780997308.639898:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110455936 00000100:00100000:0.0:1780997308.639920:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 706 00000100:00100000:0.0:1780997308.639930:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b6208050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:2397:x1867507110455808:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780997308.639945:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997308.639971:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff968888955800/0x30fd811c0305bf5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9031 expref: 14 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.639989:0:25183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:0.0:1780997308.639995:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997308.640055:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b6208050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:2397:x1867507110455808:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 126us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.640062:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 706 00000100:00100000:0.0:1780997308.640110:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 707 00000100:00100000:0.0:1780997308.640117:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:2395:x1867507110455936:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780997308.640125:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997308.640135:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96888956fa00/0x30fd811c0305bf40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9023 expref: 12 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.640147:0:25183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9689882bd600) 00010000:00010000:0.0:1780997308.640150:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997308.640168:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2395:x1867507110455936:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 52us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.640174:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 707 00000100:00100000:1.0:1780997308.640961:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110455680 00000100:00100000:1.0:1780997308.640969:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110455680 00000100:00100000:1.0:1780997308.641074:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1538 00000100:00080000:0.0:1780997308.641081:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997308.641083:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+31:72957:x1867507110455680:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1780997308.641100:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997308.641120:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bf63 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9038 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641251:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bf6a lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641287:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bf6a lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641313:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bf6a lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641328:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bf71 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641336:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bf71 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641342:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bf71 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641400:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bf78 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641409:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bf78 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641416:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bf78 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997308.641425:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x9:0x0]: returning size 0 00010000:00010000:1.0:1780997308.641512:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bf6a lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641520:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bf6a lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641525:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bf6a lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641537:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bf6a lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641543:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997308.641547:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bf6a lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641554:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bf6a lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641563:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96899634fe00) 00010000:00010000:1.0:1780997308.641566:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997308.641570:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bf6a lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641576:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305bf6a lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641594:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bf71 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641600:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bf71 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641606:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bf71 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641610:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997308.641613:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bf71 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641627:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bf71 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641635:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x2c9ecea3 (ffff96899634f200) 00010000:00010000:1.0:1780997308.641637:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997308.641641:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bf71 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641647:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bf71 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641704:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bf63 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9038 expref: 34 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641719:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bf78 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9038 expref: 33 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.641726:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff9689896fe500) 00010000:00010000:1.0:1780997308.641728:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997308.641731:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8a00, rc 0) 00000100:00100000:1.0:1780997308.641848:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+33:72957:x1867507110455680:12345-192.168.206.51@tcp:101:dd.0 Request processed in 767us (2291us total) trans 81604378832 rc 0/0 00000100:00100000:1.0:1780997308.641855:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1538 00000100:00100000:2.0:1780997308.648238:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.649286:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.650476:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110456064 00000100:00100000:0.0:1780997308.650488:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110456064 00000100:00100000:0.0:1780997308.650589:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110456320 00000100:00100000:0.0:1780997308.650593:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110456320 00000100:00100000:0.0:1780997308.650617:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1539 00000100:00100000:0.0:1780997308.650626:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+34:72957:x1867507110456064:12345-192.168.206.51@tcp:101:dd.0 00000100:00100000:2.0:1780997308.650628:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1540 00000100:00100000:2.0:1780997308.650636:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+34:72956:x1867507110456320:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997308.650650:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.650650:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997308.650674:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305bf86 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9046 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.650675:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bf8d lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae903f expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.650708:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305bf94 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.650739:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305bf94 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.650750:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305bf94 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.650861:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bf8d lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae903f expref: 37 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.650879:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955e00/0x30fd811c0305bf94 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae903f expref: 36 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.650887:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff9689896fe500) 00010000:00010000:0.0:1780997308.650890:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1780997308.650894:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955e00, rc 0) 00000100:00100000:0.0:1780997308.650962:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+36:72957:x1867507110456064:12345-192.168.206.51@tcp:101:dd.0 Request processed in 337us (2733us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.650970:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1539 00010000:00010000:2.0:1780997308.652880:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bf9b lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.652903:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bf9b lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.652913:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bf9b lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.652929:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fe00/0x30fd811c0305bfa2 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.652935:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fe00/0x30fd811c0305bfa2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.652941:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fe00/0x30fd811c0305bfa2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653035:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305bfa9 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653044:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305bfa9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653051:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305bfa9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997308.653062:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x8:0x0]: returning size 0 00010000:00010000:2.0:1780997308.653140:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bf9b lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653148:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bf9b lrc: 2/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653155:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bf9b lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653161:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997308.653166:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bf9b lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653174:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bf9b lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653186:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898d864800) 00010000:00010000:2.0:1780997308.653189:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997308.653193:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bf9b lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653208:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305bf9b lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653220:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fe00/0x30fd811c0305bfa2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653225:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fe00/0x30fd811c0305bfa2 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653231:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fe00/0x30fd811c0305bfa2 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653237:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956fe00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997308.653239:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fe00/0x30fd811c0305bfa2 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653245:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fe00/0x30fd811c0305bfa2 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653251:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xe44515a3 (ffff96898d864e00) 00010000:00010000:2.0:1780997308.653253:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997308.653255:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fe00/0x30fd811c0305bfa2 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653261:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fe00/0x30fd811c0305bfa2 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653334:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305bf86 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9046 expref: 37 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653360:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305bfa9 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9046 expref: 36 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.653367:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff968983653e00) 00010000:00010000:2.0:1780997308.653369:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997308.653372:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956e800, rc 0) 00000100:00100000:2.0:1780997308.653444:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+36:72956:x1867507110456320:12345-192.168.206.51@tcp:101:dd.0 Request processed in 2808us (4175us total) trans 81604378833 rc 0/0 00000100:00100000:2.0:1780997308.653451:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1540 00000100:00100000:2.0:1780997308.663475:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.663519:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.663623:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110456576 00000100:00100000:3.0:1780997308.663640:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110456576 00000100:00100000:3.0:1780997308.663703:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110456704 00000100:00100000:3.0:1780997308.663707:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110456704 00000100:00100000:3.0:1780997308.663739:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1541 00000100:00100000:3.0:1780997308.663749:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+37:72955:x1867507110456576:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.663771:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.663804:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfb7 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae904d expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997308.663886:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1542 00000100:00100000:1.0:1780997308.663896:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+38:72956:x1867507110456704:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1780997308.663904:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997308.663915:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bfbe lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9054 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.663946:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bfc5 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.663963:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bfc5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.663974:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bfc5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.663981:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bfcc lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.663990:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bfcc lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.663999:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bfcc lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664010:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bfd3 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664016:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bfd3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664021:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bfd3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664059:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bfda lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.664065:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305bfbe lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9054 expref: 40 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664067:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bfda lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664074:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bfda lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997308.664083:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x7:0x0]: returning size 0 00010000:00010000:1.0:1780997308.664086:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9800/0x30fd811c0305bfc5 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9054 expref: 39 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.664094:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff968983653e00) 00010000:00010000:1.0:1780997308.664096:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780997308.664100:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9800, rc 0) 00000100:00100000:1.0:1780997308.664162:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+40:72956:x1867507110456704:12345-192.168.206.51@tcp:101:dd.0 Request processed in 267us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997308.664169:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1542 00010000:00010000:3.0:1780997308.664172:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bfcc lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664178:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bfcc lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664191:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bfcc lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664197:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bfcc lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664205:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.664210:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bfcc lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664218:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bfcc lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664230:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898712d700) 00010000:00010000:3.0:1780997308.664232:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.664236:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bfcc lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664243:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305bfcc lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664253:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bfd3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664259:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bfd3 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664265:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bfd3 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664307:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.664316:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bfd3 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664322:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bfd3 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664329:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x9beb5ca3 (ffff96898712dd00) 00010000:00010000:3.0:1780997308.664332:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.664334:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bfd3 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664339:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305bfd3 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664376:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfb7 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae904d expref: 40 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664390:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bfda lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae904d expref: 39 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.664396:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff968983653b00) 00010000:00010000:3.0:1780997308.664398:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780997308.664400:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0800, rc 0) 00000100:00100000:3.0:1780997308.664431:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968990f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+39:72955:x1867507110456576:12345-192.168.206.51@tcp:101:dd.0 Request processed in 684us (970us total) trans 81604378834 rc 0/0 00000100:00100000:3.0:1780997308.664436:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1541 00000100:00100000:2.0:1780997308.667106:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.667251:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110456960 00000100:00100000:0.0:1780997308.667263:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110456960 00000100:00100000:0.0:1780997308.667424:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1543 00000100:00100000:0.0:1780997308.667434:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+39:72957:x1867507110456960:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:0.0:1780997308.667498:0:80049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997308.667529:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305bf78 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9038 expref: 39 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.667555:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff9689896fe500) 00010000:00010000:0.0:1780997308.667577:0:80049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997308.667863:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bfe8 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.667878:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bfe8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.667888:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bfe8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1780997308.667935:0:80049:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378835 00000004:00010000:0.0:1780997308.667960:0:80049:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b8391c3 reply state 000000006b5a9398 transno 81604378836 ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bfe8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.667971:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bfe8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.667977:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff9689896fe500) 00010000:00010000:0.0:1780997308.667979:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997308.667982:0:80049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997308.668072:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+41:72957:x1867507110456960:12345-192.168.206.51@tcp:36:dd.0 Request processed in 639us (976us total) trans 81604378836 rc 0/0 00000100:00100000:0.0:1780997308.668080:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1543 00000020:00080000:0.0:1780997308.668085:0:80049:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1780997308.674118:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.674185:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.674450:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110457216 00000100:00100000:3.0:1780997308.674461:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110457216 00000100:00100000:3.0:1780997308.674516:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110457344 00000100:00100000:3.0:1780997308.674520:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110457344 00000100:00100000:3.0:1780997308.674564:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1544 00000100:00100000:3.0:1780997308.674574:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+42:72956:x1867507110457216:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:3.0:1780997308.674634:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997308.674666:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305bfa9 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9046 expref: 42 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.674686:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff968983653e00) 00010000:00010000:3.0:1780997308.674690:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997308.674906:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfef lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.674921:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfef lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.674930:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfef lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1780997308.674974:0:63417:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378837 00000004:00010000:3.0:1780997308.674996:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b6e29ca8 reply state 000000006f358ebc transno 81604378838 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfef lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.675006:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfef lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.675013:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff968983653e00) 00010000:00010000:3.0:1780997308.675015:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997308.675019:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780997308.675111:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+44:72956:x1867507110457216:12345-192.168.206.51@tcp:36:dd.0 Request processed in 538us (1009us total) trans 81604378838 rc 0/0 00000100:00100000:0.0:1780997308.675120:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1545 00000100:00100000:0.0:1780997308.675133:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+44:72955:x1867507110457344:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.675144:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.675156:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bff6 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae905b expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.675182:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bffd lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.675199:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bffd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.675207:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bffd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997308.675241:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1544 00000020:00080000:3.0:1780997308.675254:0:63417:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1780997308.675643:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305bff6 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae905b expref: 45 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.675661:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954200/0x30fd811c0305bffd lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae905b expref: 44 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.675668:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff968983653b00) 00010000:00010000:0.0:1780997308.675670:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1780997308.675674:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954200, rc 0) 00000100:00100000:0.0:1780997308.675707:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+44:72955:x1867507110457344:12345-192.168.206.51@tcp:101:dd.0 Request processed in 579us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.675714:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1545 00000100:00100000:3.0:1780997308.677183:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.677314:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.677525:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110457472 00000100:00100000:0.0:1780997308.677538:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110457472 00000100:00100000:0.0:1780997308.677605:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6003 00000100:00100000:0.0:1780997308.677625:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:72957:x1867507110457472:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.677644:0:25177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.677670:0:25177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c0305c004 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x624:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9062 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997308.677695:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x624:0x0] initial LVB size: 0, mtime: 0x6a27dcb2, atime: 0x6a27dcb2, ctime: 0x6a27dcb2, blocks: 0x0 00010000:00010000:0.0:1780997308.677738:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.677740:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.677749:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c0305c004 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9062 expref: 6 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.677778:0:25177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c0305c004 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9062 expref: 6 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.678107:0:25177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954e00, rc 0) 00010000:00000080:0.0:1780997308.678115:0:25177:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689aebbad80 x1867507110457472/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997308.678184:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:72957:x1867507110457472:12345-192.168.206.51@tcp:101:dd.0 Request processed in 562us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.678192:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6003 00000100:00080000:0.0:1780997308.678224:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780997308.678503:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110457728 00000100:00100000:3.0:1780997308.678510:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110457728 00000100:00100000:3.0:1780997308.678556:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1546 00000100:00100000:3.0:1780997308.678564:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+44:72958:x1867507110457728:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.678580:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.678599:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305c00b lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9069 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.678754:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c012 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679465:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c012 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679483:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c012 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679499:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c019 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679506:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c019 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679512:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c019 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679579:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c020 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679601:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c020 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679608:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c020 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997308.679622:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xa:0x0]: returning size 0 00010000:00010000:3.0:1780997308.679704:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c012 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679711:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c012 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679717:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c012 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679724:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c012 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679730:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.679735:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c012 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679743:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c012 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679755:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898712d700) 00010000:00010000:3.0:1780997308.679758:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.679763:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c012 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679768:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c012 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679788:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c019 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679795:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c019 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679800:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c019 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679805:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.679808:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c019 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679814:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c019 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679834:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x74f887a3 (ffff96898712dd00) 00010000:00010000:3.0:1780997308.679837:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.679840:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c019 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679846:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c019 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679907:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305c00b lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9069 expref: 47 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679925:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c020 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9069 expref: 46 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.679943:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff968983653c00) 00010000:00010000:3.0:1780997308.679945:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780997308.679947:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03000, rc 0) 00000100:00100000:3.0:1780997308.681626:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+46:72958:x1867507110457728:12345-192.168.206.51@tcp:101:dd.0 Request processed in 3054us (4303us total) trans 81604378839 rc 0/0 00000100:00100000:3.0:1780997308.681640:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1546 00000100:00100000:0.0:1780997308.682228:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.682479:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.682567:0:23856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110457984 00000100:00100000:3.0:1780997308.682579:0:23856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110457984 00002000:00010000:3.0:1780997308.682629:0:23856:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1572 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.682634:0:23856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96888b336a00 with x1867507110457984 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.682648:0:23856:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96888b336a00. 00000100:00100000:3.0:1780997308.682712:0:23856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1008 00000100:00100000:3.0:1780997308.682723:0:23856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2394:x1867507110457984:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:3.0:1780997308.682954:0:23856:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x624:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780997308.682958:0:23856:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x624:0x0] updating lvb mtime from disk: 1780997298 -> 1780997308 00002000:00010000:3.0:1780997308.682961:0:23856:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x624:0x0] updating lvb atime from disk: 1780997298 -> 1780997298 00002000:00010000:3.0:1780997308.682964:0:23856:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x624:0x0] updating lvb ctime from disk: 1780997298 -> 1780997308 00002000:00010000:3.0:1780997308.682967:0:23856:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x624:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780997308.682975:0:23856:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff96888b336a00 x1867507110457984/t4294969478(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997308.683095:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110457856 00000100:00100000:2.0:1780997308.683100:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110457856 00000100:00100000:2.0:1780997308.683133:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6004 00000100:00100000:2.0:1780997308.683141:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:72956:x1867507110457856:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997308.683152:0:8230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997308.683172:0:8230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305c02e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x623:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9070 expref: -99 pid: 8230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997308.683194:0:8230:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x623:0x0] initial LVB size: 0, mtime: 0x6a27dcb2, atime: 0x6a27dcb2, ctime: 0x6a27dcb2, blocks: 0x0 00010000:00010000:2.0:1780997308.683214:0:8230:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997308.683217:0:8230:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997308.683225:0:8230:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305c02e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9070 expref: 9 pid: 8230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.683295:0:8230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305c02e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9070 expref: 9 pid: 8230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.683310:0:8230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956fe00, rc 0) 00010000:00000080:2.0:1780997308.683315:0:8230:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff96888b335500 x1867507110457856/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997308.683378:0:23856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2394:x1867507110457984:12345-192.168.206.51@tcp:10:dd.0 Request processed in 656us (898us total) trans 4294969478 rc 0/0 00000100:00100000:3.0:1780997308.683386:0:23856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1008 00002000:00010000:3.0:1780997308.683391:0:23856:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1572 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.683401:0:23856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96888b336a00 with x1867507110457984 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.683406:0:23856:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96888b336a00. 00000100:00100000:2.0:1780997308.683490:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:72956:x1867507110457856:12345-192.168.206.51@tcp:101:dd.0 Request processed in 349us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997308.683497:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6004 00000100:00100000:2.0:1780997308.693977:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.698901:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.698954:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.699064:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110458240 00000100:00100000:2.0:1780997308.699075:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110458240 00000100:00100000:2.0:1780997308.699136:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110458368 00000100:00100000:2.0:1780997308.699139:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110458368 00000100:00100000:2.0:1780997308.699160:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110458624 00000100:00100000:2.0:1780997308.699163:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110458624 00000100:00100000:2.0:1780997308.699185:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1547 00000100:00100000:2.0:1780997308.699195:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+48:72955:x1867507110458240:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:2.0:1780997308.699254:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997308.699318:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305bfda lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae904d expref: 48 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.699338:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff968983653b00) 00010000:00010000:2.0:1780997308.699353:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997308.699533:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305c035 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.699567:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305c035 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.699579:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305c035 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780997308.699632:0:63418:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378840 00000004:00010000:2.0:1780997308.699654:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000001730341 reply state 0000000080c98956 transno 81604378841 ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305c035 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.699667:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305c035 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.699674:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff968983653b00) 00010000:00010000:2.0:1780997308.699677:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997308.699679:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997308.699771:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+50:72955:x1867507110458240:12345-192.168.206.51@tcp:36:dd.0 Request processed in 577us (5803us total) trans 81604378841 rc 0/0 00000100:00100000:2.0:1780997308.699779:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1547 00000020:00080000:2.0:1780997308.699785:0:63418:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1780997308.699802:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1548 00000100:00100000:2.0:1780997308.699809:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+49:72958:x1867507110458368:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997308.699832:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997308.699844:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c03c lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9077 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.699869:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e400/0x30fd811c0305c043 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.699889:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e400/0x30fd811c0305c043 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.699897:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e400/0x30fd811c0305c043 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.699973:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c03c lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9077 expref: 51 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.699989:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e400/0x30fd811c0305c043 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9077 expref: 50 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.699995:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff968983653c00) 00010000:00010000:2.0:1780997308.699998:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780997308.700000:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956e400, rc 0) 00000100:00100000:2.0:1780997308.700030:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+50:72958:x1867507110458368:12345-192.168.206.51@tcp:101:dd.0 Request processed in 221us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997308.700037:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1548 00000100:00100000:2.0:1780997308.700053:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1549 00000100:00100000:2.0:1780997308.700060:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+49:72959:x1867507110458624:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997308.700068:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997308.700079:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ec00/0x30fd811c0305c04a lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae907e expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700175:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c051 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700195:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c051 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700203:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c051 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700218:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c058 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700226:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c058 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700234:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c058 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700342:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fc00/0x30fd811c0305c05f lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700351:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fc00/0x30fd811c0305c05f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700359:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fc00/0x30fd811c0305c05f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997308.700369:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xb:0x0]: returning size 0 00010000:00010000:2.0:1780997308.700428:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c051 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700438:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c051 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700444:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c051 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700456:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c051 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700462:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997308.700467:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c051 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700474:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c051 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700483:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898d864600) 00010000:00010000:2.0:1780997308.700486:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997308.700490:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c051 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700496:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c051 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700506:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c058 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700511:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c058 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700517:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c058 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700521:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956ee00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997308.700524:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c058 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700537:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c058 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700544:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xbd5240a3 (ffff96898d864c00) 00010000:00010000:2.0:1780997308.700546:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997308.700548:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c058 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700554:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c058 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700585:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ec00/0x30fd811c0305c04a lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae907e expref: 52 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700598:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fc00/0x30fd811c0305c05f lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae907e expref: 51 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.700604:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff968983653700) 00010000:00010000:2.0:1780997308.700606:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997308.700608:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956fc00, rc 0) 00000100:00100000:2.0:1780997308.700634:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:72959:x1867507110458624:12345-192.168.206.51@tcp:101:dd.0 Request processed in 576us (1680us total) trans 81604378842 rc 0/0 00000100:00100000:2.0:1780997308.700641:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1549 00000100:00100000:0.0:1780997308.701972:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.702011:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.702079:0:8237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110458752 00000100:00100000:1.0:1780997308.702088:0:8237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110458752 00002000:00010000:1.0:1780997308.702121:0:8237:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1571 (0->18446744073709551615) 00002000:00100000:1.0:1780997308.702128:0:8237:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96888b334a80 with x1867507110458752 ext(0->18446744073709551615) 00002000:00010000:1.0:1780997308.702140:0:8237:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96888b334a80. 00000100:00100000:1.0:1780997308.702184:0:8237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1009 00000100:00100000:1.0:1780997308.702194:0:8237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2395:x1867507110458752:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:1.0:1780997308.702381:0:8237:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x623:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1780997308.702385:0:8237:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x623:0x0] updating lvb mtime from disk: 1780997298 -> 1780997308 00002000:00010000:1.0:1780997308.702388:0:8237:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x623:0x0] updating lvb atime from disk: 1780997298 -> 1780997298 00002000:00010000:1.0:1780997308.702390:0:8237:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x623:0x0] updating lvb ctime from disk: 1780997298 -> 1780997308 00002000:00010000:1.0:1780997308.702393:0:8237:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x623:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1780997308.702401:0:8237:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff96888b334a80 x1867507110458752/t4294969479(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997308.702450:0:8237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2395:x1867507110458752:12345-192.168.206.51@tcp:10:dd.0 Request processed in 257us (484us total) trans 4294969479 rc 0/0 00000100:00100000:1.0:1780997308.702457:0:8237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1009 00002000:00010000:1.0:1780997308.702461:0:8237:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1571 (0->18446744073709551615) 00002000:00100000:1.0:1780997308.702463:0:8237:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96888b334a80 with x1867507110458752 ext(0->18446744073709551615) 00002000:00010000:1.0:1780997308.702468:0:8237:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96888b334a80. 00000100:00100000:3.0:1780997308.702573:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110459008 00000100:00100000:3.0:1780997308.702579:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110459008 00000100:00100000:3.0:1780997308.702613:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 264 00000100:00100000:3.0:1780997308.702621:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:72957:x1867507110459008:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:3.0:1780997308.702800:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:72957:x1867507110459008:12345-192.168.206.51@tcp:35:dd.0 Request processed in 179us (788us total) trans 81604378843 rc 0/0 00000100:00100000:3.0:1780997308.702807:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 264 00000100:00100000:1.0:1780997308.709056:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.709115:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.709239:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.709289:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.709427:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110459136 00000100:00100000:3.0:1780997308.709438:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110459136 00000100:00100000:3.0:1780997308.709483:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6005 00000100:00100000:3.0:1780997308.709492:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:72955:x1867507110459136:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.709507:0:25174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.709525:0:25174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005015db48/0x30fd811c0305c06d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x622:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9085 expref: -99 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997308.709546:0:25174:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x622:0x0] initial LVB size: 0, mtime: 0x6a27dcb2, atime: 0x6a27dcb2, ctime: 0x6a27dcb2, blocks: 0x0 00010000:00010000:3.0:1780997308.709564:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997308.709565:0:25174:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997308.709572:0:25174:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005015db48/0x30fd811c0305c06d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9085 expref: 10 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.709586:0:25174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005015db48/0x30fd811c0305c06d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9085 expref: 10 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.709615:0:25174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03c00, rc 0) 00010000:00000080:3.0:1780997308.709623:0:25174:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff96888d28e680 x1867507110459136/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997308.709681:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:72955:x1867507110459136:12345-192.168.206.51@tcp:101:dd.0 Request processed in 189us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997308.709688:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6005 00000100:00100000:3.0:1780997308.714152:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.714439:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110460032 00000100:00100000:3.0:1780997308.714450:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110460032 00000100:00100000:3.0:1780997308.714520:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 265 00000100:00100000:3.0:1780997308.714532:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:72956:x1867507110460032:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:0.0:1780997308.714862:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110459264 00000100:00100000:0.0:1780997308.714868:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110459264 00000100:00100000:0.0:1780997308.714900:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110459648 00000100:00100000:0.0:1780997308.714904:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110459648 00000100:00100000:0.0:1780997308.714921:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110459776 00000100:00100000:0.0:1780997308.714924:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110459776 00000100:00100000:0.0:1780997308.714940:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1550 00000100:00100000:0.0:1780997308.714961:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+56:72959:x1867507110459264:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.714972:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.714992:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305c074 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae908c expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.715029:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305c07b lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.715048:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305c07b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.715061:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305c07b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.715155:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305c074 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae908c expref: 58 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.715176:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888954a00/0x30fd811c0305c07b lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae908c expref: 57 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.715186:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff968983653700) 00010000:00010000:0.0:1780997308.715189:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1780997308.715192:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888954a00, rc 0) 00000100:00100000:0.0:1780997308.715251:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+57:72959:x1867507110459264:12345-192.168.206.51@tcp:101:dd.0 Request processed in 291us (6136us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.715258:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1550 00000100:00100000:1.0:1780997308.715434:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1551 00000100:00100000:1.0:1780997308.715467:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+56:72958:x1867507110459648:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:1.0:1780997308.715499:0:80049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997308.715514:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c020 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9069 expref: 56 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.715537:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff968983653c00) 00010000:00010000:1.0:1780997308.715540:0:80049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780997308.715656:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305c082 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.715666:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305c082 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.715673:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305c082 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780997308.715722:0:80049:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378845 00000004:00010000:1.0:1780997308.715743:0:80049:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a02302dc reply state 00000000dbff3e00 transno 81604378846 ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305c082 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.715769:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305c082 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.715775:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff968983653c00) 00010000:00010000:1.0:1780997308.715778:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997308.715781:0:80049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780997308.715850:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+58:72958:x1867507110459648:12345-192.168.206.51@tcp:36:dd.0 Request processed in 407us (6609us total) trans 81604378846 rc 0/0 00000100:00100000:1.0:1780997308.715857:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1551 00000020:00080000:1.0:1780997308.715861:0:80049:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1780997308.715911:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1552 00000100:00100000:0.0:1780997308.715920:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+57:72961:x1867507110459776:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.715937:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.715950:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305c089 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9093 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997308.716606:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+57:72956:x1867507110460032:12345-192.168.206.51@tcp:35:dd.0 Request processed in 2073us (2463us total) trans 81604378844 rc 0/0 00000100:00100000:3.0:1780997308.716615:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 265 00000100:00100000:3.0:1780997308.716705:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.716890:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110460160 00000100:00100000:3.0:1780997308.716899:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110460160 00002000:00010000:3.0:1780997308.716928:0:24155:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1570 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.716932:0:24155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689aebbaa00 with x1867507110460160 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.716944:0:24155:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689aebbaa00. 00000100:00100000:3.0:1780997308.716971:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1010 00000100:00100000:3.0:1780997308.716979:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2396:x1867507110460160:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:3.0:1780997308.717116:0:24155:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x622:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780997308.717128:0:24155:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x622:0x0] updating lvb mtime from disk: 1780997298 -> 1780997308 00002000:00010000:3.0:1780997308.717131:0:24155:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x622:0x0] updating lvb atime from disk: 1780997298 -> 1780997298 00002000:00010000:3.0:1780997308.717134:0:24155:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x622:0x0] updating lvb ctime from disk: 1780997298 -> 1780997308 00002000:00010000:3.0:1780997308.717136:0:24155:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x622:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780997308.717146:0:24155:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689aebbaa00 x1867507110460160/t4294969480(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997308.717181:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2396:x1867507110460160:12345-192.168.206.51@tcp:10:dd.0 Request processed in 203us (476us total) trans 4294969480 rc 0/0 00000100:00100000:3.0:1780997308.717188:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1010 00002000:00010000:3.0:1780997308.717191:0:24155:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1570 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.717194:0:24155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689aebbaa00 with x1867507110460160 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.717198:0:24155:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689aebbaa00. 00010000:00010000:0.0:1780997308.717587:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c090 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717601:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c090 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717611:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c090 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717627:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c097 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717634:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c097 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717641:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c097 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717736:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c09e lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717756:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c09e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717764:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c09e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997308.717774:0:65272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xd:0x0]: returning size 0 00010000:00010000:0.0:1780997308.717857:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c090 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717866:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c090 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717872:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c090 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717878:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c090 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717885:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ef000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997308.717889:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c090 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717896:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c090 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717908:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff968990709e00) 00010000:00010000:0.0:1780997308.717912:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997308.717916:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c090 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717922:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c090 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717935:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c097 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717941:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c097 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717947:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c097 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717959:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ee600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997308.717962:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c097 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717967:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c097 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717976:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x4e05b2a3 (ffff968990709f00) 00010000:00010000:0.0:1780997308.717978:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997308.717981:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c097 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.717987:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c097 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.718024:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305c089 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9093 expref: 59 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.718042:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c09e lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9093 expref: 58 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.718049:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff968983653200) 00010000:00010000:0.0:1780997308.718051:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780997308.718053:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4eee00, rc 0) 00000100:00100000:0.0:1780997308.718098:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+58:72961:x1867507110459776:12345-192.168.206.51@tcp:101:dd.0 Request processed in 2179us (8807us total) trans 81604378847 rc 0/0 00000100:00100000:0.0:1780997308.718105:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1552 00000100:00100000:3.0:1780997308.725459:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.725568:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.727298:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110460288 00000100:00100000:2.0:1780997308.727314:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110460288 00000100:00100000:2.0:1780997308.727395:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6006 00000100:00100000:2.0:1780997308.727407:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:72958:x1867507110460288:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997308.727446:0:8232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997308.727468:0:8232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305c0ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x625:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae909a expref: -99 pid: 8232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997308.727495:0:8232:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x625:0x0] initial LVB size: 0, mtime: 0x6a27dcb2, atime: 0x6a27dcb2, ctime: 0x6a27dcb2, blocks: 0x0 00010000:00010000:2.0:1780997308.727518:0:8232:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997308.727520:0:8232:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997308.727528:0:8232:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305c0ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae909a expref: 12 pid: 8232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.727544:0:8232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305c0ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae909a expref: 12 pid: 8232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.727560:0:8232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956ec00, rc 0) 00010000:00000080:2.0:1780997308.727568:0:8232:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689aebb8000 x1867507110460288/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997308.727646:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:72958:x1867507110460288:12345-192.168.206.51@tcp:101:dd.0 Request processed in 241us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997308.727652:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6006 00000100:00100000:2.0:1780997308.733830:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110460544 00000100:00100000:2.0:1780997308.733847:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110460544 00000100:00100000:2.0:1780997308.733912:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1553 00000100:00100000:2.0:1780997308.733922:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+58:72959:x1867507110460544:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:2.0:1780997308.733987:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997308.734012:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956fc00/0x30fd811c0305c05f lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae907e expref: 58 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.734051:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff968983653700) 00010000:00010000:2.0:1780997308.734056:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997308.734219:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c0b3 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.734234:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c0b3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.734243:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c0b3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780997308.734313:0:63418:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378848 00000004:00010000:2.0:1780997308.734332:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002800f38b reply state 000000002ff44e42 transno 81604378849 ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c0b3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.734354:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c0b3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.734360:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff968983653700) 00010000:00010000:2.0:1780997308.734363:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997308.734365:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997308.734451:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+60:72959:x1867507110460544:12345-192.168.206.51@tcp:36:dd.0 Request processed in 530us (8881us total) trans 81604378849 rc 0/0 00000100:00100000:2.0:1780997308.734458:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1553 00000020:00080000:2.0:1780997308.734463:0:63418:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1780997308.739381:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.739517:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110460800 00000100:00100000:1.0:1780997308.739526:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110460800 00000100:00100000:1.0:1780997308.739619:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 266 00000100:00100000:1.0:1780997308.739630:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+60:72955:x1867507110460800:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:1.0:1780997308.740177:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+61:72955:x1867507110460800:12345-192.168.206.51@tcp:35:dd.0 Request processed in 548us (804us total) trans 81604378850 rc 0/0 00000100:00100000:1.0:1780997308.740186:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 266 00000100:00100000:0.0:1780997308.744345:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.744385:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.744422:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.744509:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110461056 00000100:00100000:1.0:1780997308.744520:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110461056 00000100:00100000:1.0:1780997308.744570:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110461312 00000100:00100000:1.0:1780997308.744583:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110461312 00000100:00100000:1.0:1780997308.744607:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1554 00000100:00100000:2.0:1780997308.744627:0:23858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110460928 00000100:00100000:1.0:1780997308.744627:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+62:72961:x1867507110461056:12345-192.168.206.51@tcp:101:dd.0 00000100:00100000:2.0:1780997308.744631:0:23858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110460928 00010000:00010000:1.0:1780997308.744649:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1780997308.744664:0:23858:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1573 (0->18446744073709551615) 00002000:00100000:2.0:1780997308.744670:0:23858:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bce80700 with x1867507110460928 ext(0->18446744073709551615) 00010000:00010000:1.0:1780997308.744681:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305c0ba lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90a1 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997308.744691:0:23858:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bce80700. 00000100:00100000:2.0:1780997308.744711:0:23858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1011 00010000:00010000:1.0:1780997308.744716:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305c0c1 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997308.744717:0:23858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bce80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:2396:x1867507110460928:12345-192.168.206.51@tcp:10:dd.0 00010000:00010000:1.0:1780997308.744730:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305c0c1 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.744743:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305c0c1 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997308.744888:0:23858:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x625:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1780997308.744888:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1555 00002000:00010000:2.0:1780997308.744891:0:23858:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x625:0x0] updating lvb mtime from disk: 1780997298 -> 1780997308 00002000:00010000:2.0:1780997308.744894:0:23858:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x625:0x0] updating lvb atime from disk: 1780997298 -> 1780997298 00002000:00010000:2.0:1780997308.744896:0:23858:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x625:0x0] updating lvb ctime from disk: 1780997298 -> 1780997308 00000100:00100000:0.0:1780997308.744898:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+63:72960:x1867507110461312:12345-192.168.206.51@tcp:101:dd.0 00002000:00010000:2.0:1780997308.744899:0:23858:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x625:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1780997308.744906:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000080:2.0:1780997308.744907:0:23858:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bce80700 x1867507110460928/t4294969481(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1780997308.744918:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c0c8 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90a8 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.745947:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c0cf lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.745973:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c0cf lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.745983:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c0cf lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.745997:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c0d6 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746004:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c0d6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746011:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c0d6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746069:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305c0dd lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746077:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305c0dd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746092:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305c0dd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997308.746104:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xc:0x0]: returning size 0 00010000:00010000:0.0:1780997308.746177:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c0cf lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746184:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c0cf lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746190:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c0cf lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746197:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c0cf lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746202:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4ef000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997308.746206:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c0cf lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746213:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c0cf lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746225:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff968990709e00) 00010000:00010000:0.0:1780997308.746228:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997308.746232:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c0cf lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746238:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c0cf lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746251:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c0d6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746262:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c0d6 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746309:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c0d6 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746316:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4eea00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997308.746318:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c0d6 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746325:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c0d6 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746334:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x5abf9a3 (ffff968990709f00) 00010000:00010000:0.0:1780997308.746336:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997308.746339:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c0d6 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746345:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c0d6 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746388:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c0c8 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90a8 expref: 66 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746405:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305c0dd lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90a8 expref: 65 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.746413:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff968983653d00) 00010000:00010000:0.0:1780997308.746416:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780997308.746425:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ee800, rc 0) 00000100:00100000:0.0:1780997308.746496:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+65:72960:x1867507110461312:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1599us (2108us total) trans 81604378851 rc 0/0 00000100:00100000:0.0:1780997308.746505:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1555 00010000:00010000:1.0:1780997308.746632:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8000/0x30fd811c0305c0ba lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90a1 expref: 65 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.746651:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8800/0x30fd811c0305c0c1 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90a1 expref: 64 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.746659:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff968983653200) 00010000:00010000:1.0:1780997308.746668:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780997308.746671:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8800, rc 0) 00000100:00100000:1.0:1780997308.746708:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888961b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+64:72961:x1867507110461056:12345-192.168.206.51@tcp:101:dd.0 Request processed in 2083us (2372us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997308.746714:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1554 00000100:00100000:2.0:1780997308.747207:0:23858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bce80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:2396:x1867507110460928:12345-192.168.206.51@tcp:10:dd.0 Request processed in 2487us (2781us total) trans 4294969481 rc 0/0 00000100:00100000:2.0:1780997308.747218:0:23858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1011 00002000:00010000:2.0:1780997308.747223:0:23858:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1573 (0->18446744073709551615) 00002000:00100000:2.0:1780997308.747226:0:23858:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bce80700 with x1867507110460928 ext(0->18446744073709551615) 00002000:00010000:2.0:1780997308.747234:0:23858:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bce80700. 00000100:00100000:1.0:1780997308.747938:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.748320:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110461440 00000100:00100000:2.0:1780997308.748489:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110461440 00000100:00100000:2.0:1780997308.748631:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6007 00000100:00100000:2.0:1780997308.748641:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:72959:x1867507110461440:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997308.748795:0:25171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997308.748829:0:25171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305c0eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x626:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90af expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997308.748860:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x626:0x0] initial LVB size: 0, mtime: 0x6a27dcb2, atime: 0x6a27dcb2, ctime: 0x6a27dcb2, blocks: 0x0 00010000:00010000:2.0:1780997308.748895:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997308.748897:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997308.748905:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305c0eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90af expref: 14 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.748920:0:25171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305c0eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90af expref: 14 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.748932:0:25171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956fc00, rc 0) 00010000:00000080:2.0:1780997308.748939:0:25171:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff96888d28d180 x1867507110461440/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997308.750072:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:72959:x1867507110461440:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1426us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997308.750082:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6007 00000100:00100000:3.0:1780997308.753847:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.755734:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110461696 00000100:00100000:2.0:1780997308.755765:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110461696 00000100:00100000:2.0:1780997308.755851:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1556 00000100:00100000:2.0:1780997308.755862:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+64:72961:x1867507110461696:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:2.0:1780997308.755932:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997308.755962:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c09e lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9093 expref: 64 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.755982:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff968983653200) 00010000:00010000:2.0:1780997308.755988:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997308.756163:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c0f2 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.756195:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c0f2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.756205:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c0f2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780997308.756254:0:63418:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378852 00000004:00010000:2.0:1780997308.756294:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c47183a8 reply state 0000000040d64afb transno 81604378853 ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c0f2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.756307:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c0f2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.756314:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff968983653200) 00010000:00010000:2.0:1780997308.756317:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997308.756320:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997308.756420:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+66:72961:x1867507110461696:12345-192.168.206.51@tcp:36:dd.0 Request processed in 559us (2581us total) trans 81604378853 rc 0/0 00000100:00100000:2.0:1780997308.756428:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1556 00000020:00080000:2.0:1780997308.756433:0:63418:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1780997308.758779:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.758888:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.758999:0:24143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110462208 00000100:00100000:0.0:1780997308.759012:0:24143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110462208 00002000:00010000:0.0:1780997308.759050:0:24143:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1574 (0->18446744073709551615) 00002000:00100000:0.0:1780997308.759055:0:24143:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96888d28ed80 with x1867507110462208 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997308.759067:0:24143:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96888d28ed80. 00000100:00100000:0.0:1780997308.759138:0:24143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1012 00000100:00100000:0.0:1780997308.759149:0:24143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:2394:x1867507110462208:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:0.0:1780997308.759354:0:24143:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x626:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1780997308.759358:0:24143:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x626:0x0] updating lvb mtime from disk: 1780997298 -> 1780997308 00002000:00010000:0.0:1780997308.759361:0:24143:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x626:0x0] updating lvb atime from disk: 1780997298 -> 1780997298 00002000:00010000:0.0:1780997308.759364:0:24143:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x626:0x0] updating lvb ctime from disk: 1780997298 -> 1780997308 00002000:00010000:0.0:1780997308.759366:0:24143:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x626:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1780997308.759384:0:24143:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff96888d28ed80 x1867507110462208/t4294969482(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997308.759452:0:24143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+15:2394:x1867507110462208:12345-192.168.206.51@tcp:10:dd.0 Request processed in 305us (681us total) trans 4294969482 rc 0/0 00000100:00100000:0.0:1780997308.759460:0:24143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1012 00002000:00010000:0.0:1780997308.759464:0:24143:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1574 (0->18446744073709551615) 00002000:00100000:0.0:1780997308.759467:0:24143:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96888d28ed80 with x1867507110462208 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997308.759472:0:24143:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96888d28ed80. 00000100:00100000:3.0:1780997308.759593:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110462080 00000100:00100000:3.0:1780997308.759599:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110462080 00000100:00100000:3.0:1780997308.759641:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1557 00000100:00100000:2.0:1780997308.759648:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.759654:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+66:72962:x1867507110462080:12345-192.168.206.51@tcp:101:dd.0 00000100:00100000:3.0:1780997308.759681:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110462464 00000100:00100000:3.0:1780997308.759684:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110462464 00000100:00100000:3.0:1780997308.759715:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 267 00000100:00100000:3.0:1780997308.759722:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+67:72958:x1867507110462464:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:3.0:1780997308.760130:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+68:72958:x1867507110462464:12345-192.168.206.51@tcp:35:dd.0 Request processed in 408us (486us total) trans 81604378854 rc 0/0 00000100:00100000:3.0:1780997308.760138:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 267 00010000:00010000:3.0:1780997308.760170:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.760191:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02800/0x30fd811c0305c0f9 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90bd expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760329:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c100 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760343:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c100 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760355:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c100 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760367:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c107 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760383:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c107 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760391:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c107 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760437:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c10e lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760445:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c10e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760453:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c10e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997308.760464:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xe:0x0]: returning size 0 00010000:00010000:3.0:1780997308.760518:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c100 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760530:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c100 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760536:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c100 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760543:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c100 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760549:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.760555:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c100 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760563:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c100 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760575:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898712da00) 00010000:00010000:3.0:1780997308.760578:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.760583:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c100 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760589:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c100 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760602:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c107 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760607:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c107 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760613:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c107 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760624:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.760628:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c107 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760633:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c107 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760642:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x965f6ba3 (ffff96898712d200) 00010000:00010000:3.0:1780997308.760644:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.760647:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c107 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760653:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c107 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760696:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02800/0x30fd811c0305c0f9 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90bd expref: 70 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760712:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c10e lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90bd expref: 69 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.760720:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xe:0x0].0x0 (ffff96898d864f00) 00010000:00010000:3.0:1780997308.760723:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780997308.760726:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03400, rc 0) 00000100:00100000:3.0:1780997308.760754:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+69:72962:x1867507110462080:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1104us (1866us total) trans 81604378855 rc 0/0 00000100:00100000:3.0:1780997308.760762:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1557 00000100:00100000:2.0:1780997308.766188:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.766266:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.766409:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110462592 00000100:00100000:1.0:1780997308.766420:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110462592 00000100:00100000:1.0:1780997308.766477:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6008 00000100:00100000:1.0:1780997308.766487:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+15:72961:x1867507110462592:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1780997308.766505:0:25178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997308.766538:0:25178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000794d842d/0x30fd811c0305c11c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x628:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90c4 expref: -99 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997308.766565:0:25178:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x628:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:1.0:1780997308.766599:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997308.766601:0:25178:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997308.766618:0:25178:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000794d842d/0x30fd811c0305c11c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90c4 expref: 16 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997308.766629:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1780997308.766640:0:25178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000794d842d/0x30fd811c0305c11c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90c4 expref: 16 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997308.766654:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110462848 00010000:00010000:1.0:1780997308.766658:0:25178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8000, rc 0) 00000100:00100000:2.0:1780997308.766659:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110462848 00010000:00000080:1.0:1780997308.766672:0:25178:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689854b6d80 x1867507110462592/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997308.766692:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 268 00000100:00100000:2.0:1780997308.766703:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+69:72959:x1867507110462848:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:1.0:1780997308.766760:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+16:72961:x1867507110462592:12345-192.168.206.51@tcp:101:dd.0 Request processed in 273us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997308.766768:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6008 00000100:00100000:2.0:1780997308.767000:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+70:72959:x1867507110462848:12345-192.168.206.51@tcp:35:dd.0 Request processed in 297us (372us total) trans 81604378856 rc 0/0 00000100:00100000:2.0:1780997308.767014:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 268 00000100:00100000:0.0:1780997308.767242:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110461824 00000100:00100000:0.0:1780997308.767247:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110461824 00000100:00100000:0.0:1780997308.767379:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1558 00000100:00100000:0.0:1780997308.767388:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+70:72960:x1867507110461824:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.767397:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.767410:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c123 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90b6 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.767439:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c12a lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.767452:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c12a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.767463:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c12a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.767539:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c123 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90b6 expref: 72 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.767555:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eea00/0x30fd811c0305c12a lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90b6 expref: 71 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.767564:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff968983653d00) 00010000:00010000:0.0:1780997308.767567:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1780997308.767570:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4eea00, rc 0) 00000100:00100000:0.0:1780997308.767597:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+71:72960:x1867507110461824:12345-192.168.206.51@tcp:101:dd.0 Request processed in 212us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.767603:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1558 00000100:00100000:2.0:1780997308.768919:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.769006:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110462976 00000100:00100000:0.0:1780997308.769017:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110462976 00000100:00100000:0.0:1780997308.769081:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1559 00000100:00100000:0.0:1780997308.769091:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+71:72962:x1867507110462976:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.769110:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.769141:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c131 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90cb expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.769175:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c138 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.769189:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c138 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.769199:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c138 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.769324:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c131 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90cb expref: 73 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.770191:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ef000/0x30fd811c0305c138 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90cb expref: 72 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.770204:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xe:0x0].0x0 (ffff96898d864f00) 00010000:00010000:0.0:1780997308.770207:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1780997308.770211:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ef000, rc 0) 00000100:00100000:0.0:1780997308.770309:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+72:72962:x1867507110462976:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1218us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.770319:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1559 00000100:00100000:2.0:1780997308.775207:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.778770:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110463232 00000100:00100000:3.0:1780997308.778799:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110463232 00000100:00100000:3.0:1780997308.778871:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1560 00000100:00100000:3.0:1780997308.778881:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+72:72963:x1867507110463232:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.778902:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.778925:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02800/0x30fd811c0305c13f lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90d2 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.779073:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c146 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.779090:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c146 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.779101:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c146 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.780534:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c14d lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.780559:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c14d lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.780574:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c14d lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.780678:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c154 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.780687:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c154 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.780696:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c154 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997308.780723:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xf:0x0]: returning size 0 00010000:00010000:3.0:1780997308.780951:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c146 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.780960:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c146 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.780967:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c146 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.780974:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c146 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.780980:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.780985:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c146 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.780992:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c146 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.781004:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898712da00) 00010000:00010000:3.0:1780997308.781007:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.781011:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c146 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.781017:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c146 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.781030:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c14d lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.781036:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c14d lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.781048:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c14d lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.781053:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.781056:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c14d lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.781061:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c14d lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.781068:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xdeb924a3 (ffff96898712d200) 00010000:00010000:3.0:1780997308.781071:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.781074:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c14d lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.781079:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c14d lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.781201:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02800/0x30fd811c0305c13f lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90d2 expref: 75 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.781224:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c154 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90d2 expref: 74 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.781231:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xf:0x0].0x0 (ffff968983653300) 00010000:00010000:3.0:1780997308.781233:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780997308.781236:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02a00, rc 0) 00000100:00100000:1.0:1780997308.783961:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.784004:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.784410:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110463488 00000100:00100000:2.0:1780997308.784423:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110463488 00000100:00100000:2.0:1780997308.784487:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1561 00000100:00100000:2.0:1780997308.784497:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+75:72960:x1867507110463488:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:2.0:1780997308.784566:0:65272:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997308.784599:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305c0dd lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90a8 expref: 75 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.784619:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff968983653d00) 00010000:00010000:2.0:1780997308.784624:0:65272:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997308.784810:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305c162 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.784835:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305c162 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.784846:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305c162 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780997308.784893:0:65272:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378858 00000004:00010000:2.0:1780997308.784915:0:65272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c9a55952 reply state 000000009bab4613 transno 81604378859 ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305c162 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.784928:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305c162 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.784950:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff968983653d00) 00010000:00010000:2.0:1780997308.784952:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997308.784955:0:65272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997308.785049:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+77:72960:x1867507110463488:12345-192.168.206.51@tcp:36:dd.0 Request processed in 552us (1101us total) trans 81604378859 rc 0/0 00000100:00100000:2.0:1780997308.785058:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1561 00000020:00080000:2.0:1780997308.785063:0:65272:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1780997308.785431:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.785566:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+76:72963:x1867507110463232:12345-192.168.206.51@tcp:101:dd.0 Request processed in 6684us (11195us total) trans 81604378857 rc 0/0 00000100:00100000:0.0:1780997308.785585:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1560 00000100:00100000:0.0:1780997308.785608:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110463872 00000100:00100000:0.0:1780997308.785614:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110463872 00000100:00100000:0.0:1780997308.785653:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1562 00000100:00100000:0.0:1780997308.785661:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+76:72962:x1867507110463872:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:0.0:1780997308.785701:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997308.785718:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c10e lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90bd expref: 76 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.785733:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xe:0x0].0x0 (ffff96898d864f00) 00010000:00010000:0.0:1780997308.785736:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997308.785861:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c169 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.785872:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c169 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.785879:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c169 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1780997308.785908:0:63417:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378860 00000004:00010000:0.0:1780997308.785926:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fdf7d0e8 reply state 000000002dc58e74 transno 81604378861 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c169 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.785936:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c169 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.785942:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xe:0x0].0x0 (ffff96898d864f00) 00010000:00010000:0.0:1780997308.785944:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997308.785953:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997308.786001:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+78:72962:x1867507110463872:12345-192.168.206.51@tcp:36:dd.0 Request processed in 340us (571us total) trans 81604378861 rc 0/0 00000100:00100000:0.0:1780997308.786008:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1562 00000020:00080000:0.0:1780997308.786012:0:63417:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1780997308.788721:0:8236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110463616 00000100:00100000:3.0:1780997308.788743:0:8236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110463616 00002000:00010000:3.0:1780997308.788894:0:8236:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1576 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.788901:0:8236:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96888d28c700 with x1867507110463616 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.788919:0:8236:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96888d28c700. 00000100:00100000:3.0:1780997308.789009:0:8236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1013 00000100:00100000:3.0:1780997308.789020:0:8236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+16:2395:x1867507110463616:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:3.0:1780997308.789313:0:8236:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x628:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780997308.789317:0:8236:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x628:0x0] updating lvb mtime from disk: 1780997299 -> 1780997308 00002000:00010000:3.0:1780997308.789320:0:8236:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x628:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:3.0:1780997308.789323:0:8236:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x628:0x0] updating lvb ctime from disk: 1780997299 -> 1780997308 00002000:00010000:3.0:1780997308.789326:0:8236:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x628:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780997308.789338:0:8236:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff96888d28c700 x1867507110463616/t4294969483(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997308.789628:0:8236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+17:2395:x1867507110463616:12345-192.168.206.51@tcp:10:dd.0 Request processed in 608us (5622us total) trans 4294969483 rc 0/0 00000100:00100000:3.0:1780997308.789637:0:8236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1013 00002000:00010000:3.0:1780997308.789642:0:8236:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1576 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.789645:0:8236:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96888d28c700 with x1867507110463616 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.789650:0:8236:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96888d28c700. 00000100:00100000:2.0:1780997308.794629:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.794707:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.794784:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110464000 00000100:00100000:0.0:1780997308.794794:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110464000 00000100:00100000:0.0:1780997308.794852:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110464256 00000100:00100000:0.0:1780997308.794856:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110464256 00000100:00100000:0.0:1780997308.794889:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1563 00000100:00100000:0.0:1780997308.794901:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+79:72963:x1867507110464000:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.794932:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.794959:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c170 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90d9 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.794997:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305c177 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795012:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305c177 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795023:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305c177 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795157:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c170 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90d9 expref: 81 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795177:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955600/0x30fd811c0305c177 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90d9 expref: 80 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795199:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xf:0x0].0x0 (ffff968983653300) 00010000:00010000:0.0:1780997308.795203:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1780997308.795207:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968888955600, rc 0) 00000100:00100000:0.0:1780997308.795313:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+80:72963:x1867507110464000:12345-192.168.206.51@tcp:101:dd.0 Request processed in 415us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.795321:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1563 00000100:00100000:0.0:1780997308.795339:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1564 00000100:00100000:0.0:1780997308.795490:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+79:72964:x1867507110464256:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.795500:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.795514:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305c17e lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90e0 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795635:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305c185 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795646:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305c185 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795654:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305c185 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795668:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305c18c lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795676:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305c18c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795683:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305c18c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795739:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305c193 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795747:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305c193 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.795755:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305c193 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997308.795765:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x10:0x0]: returning size 0 00010000:00010000:0.0:1780997308.798624:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305c185 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798648:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305c185 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798656:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305c185 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798664:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305c185 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798670:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997308.798676:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305c185 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798684:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305c185 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798705:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff968990709e00) 00010000:00010000:0.0:1780997308.798708:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997308.798733:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305c185 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798740:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054a00/0x30fd811c0305c185 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798761:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305c18c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798768:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305c18c lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798774:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305c18c lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798780:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689c2054e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997308.798783:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305c18c lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798789:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305c18c lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798797:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x6e9b5ca3 (ffff968990709f00) 00010000:00010000:0.0:1780997308.798800:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997308.798802:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305c18c lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798808:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054e00/0x30fd811c0305c18c lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798903:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955800/0x30fd811c0305c17e lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90e0 expref: 82 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798937:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305c193 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90e0 expref: 81 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.798945:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x10:0x0].0x0 (ffff96898d864b00) 00010000:00010000:0.0:1780997308.798947:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780997308.798951:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689c2054400, rc 0) 00000100:00100000:0.0:1780997308.799022:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+81:72964:x1867507110464256:12345-192.168.206.51@tcp:101:dd.0 Request processed in 3533us (4314us total) trans 81604378862 rc 0/0 00000100:00100000:0.0:1780997308.799032:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1564 00000100:00100000:1.0:1780997308.799295:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.799699:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110464384 00000100:00100000:0.0:1780997308.799709:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110464384 00000100:00100000:0.0:1780997308.799775:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6009 00000100:00100000:0.0:1780997308.799785:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+17:72960:x1867507110464384:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.799801:0:23044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.799832:0:23044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305c1a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x627:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90e7 expref: -99 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997308.799864:0:23044:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x627:0x0] initial LVB size: 0, mtime: 0x6a27dcb2, atime: 0x6a27dcb2, ctime: 0x6a27dcb2, blocks: 0x0 00010000:00010000:0.0:1780997308.799894:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.799897:0:23044:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.799907:0:23044:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305c1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90e7 expref: 18 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.799927:0:23044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305c1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90e7 expref: 18 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.799959:0:23044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2800, rc 0) 00010000:00000080:0.0:1780997308.799969:0:23044:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb5880 x1867507110464384/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997308.800006:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+18:72960:x1867507110464384:12345-192.168.206.51@tcp:101:dd.0 Request processed in 222us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.800012:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6009 00000100:00100000:1.0:1780997308.800954:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.801036:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110464640 00000100:00100000:2.0:1780997308.801043:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110464640 00000100:00100000:0.0:1780997308.801294:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.801489:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110464896 00000100:00100000:1.0:1780997308.801494:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110464896 00000100:00100000:1.0:1780997308.801541:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1565 00000100:00100000:1.0:1780997308.801551:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+82:72963:x1867507110464896:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:1.0:1780997308.801618:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997308.801649:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c154 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90d2 expref: 82 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.801670:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xf:0x0].0x0 (ffff968983653300) 00010000:00010000:1.0:1780997308.801675:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780997308.801916:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305c1a8 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.801935:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305c1a8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.801946:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305c1a8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780997308.802001:0:63418:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378863 00000004:00010000:1.0:1780997308.802041:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6759002 reply state 000000008092253a transno 81604378864 ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305c1a8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.802055:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305c1a8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.802062:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xf:0x0].0x0 (ffff968983653300) 00010000:00010000:1.0:1780997308.802065:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997308.802067:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780997308.802179:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+84:72963:x1867507110464896:12345-192.168.206.51@tcp:36:dd.0 Request processed in 629us (908us total) trans 81604378864 rc 0/0 00000100:00100000:1.0:1780997308.802187:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1565 00000020:00080000:1.0:1780997308.802193:0:63418:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1780997308.804582:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 269 00000100:00100000:2.0:1780997308.804621:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889fe5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+83:72961:x1867507110464640:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:2.0:1780997308.805223:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889fe5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+84:72961:x1867507110464640:12345-192.168.206.51@tcp:35:dd.0 Request processed in 623us (4270us total) trans 81604378865 rc 0/0 00000100:00100000:2.0:1780997308.805235:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 269 00000100:00100000:1.0:1780997308.807805:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.808329:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.808621:0:23856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110465152 00000100:00100000:3.0:1780997308.808632:0:23856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110465152 00002000:00010000:3.0:1780997308.808675:0:23856:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1575 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.808682:0:23856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adbb7480 with x1867507110465152 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.808695:0:23856:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689adbb7480. 00000100:00100000:1.0:1780997308.808787:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.808811:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.808870:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.808902:0:23856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1014 00000100:00100000:3.0:1780997308.808912:0:23856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+18:2394:x1867507110465152:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:3.0:1780997308.809080:0:23856:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x627:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780997308.809084:0:23856:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x627:0x0] updating lvb mtime from disk: 1780997298 -> 1780997308 00002000:00010000:3.0:1780997308.809087:0:23856:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x627:0x0] updating lvb atime from disk: 1780997298 -> 1780997298 00002000:00010000:3.0:1780997308.809090:0:23856:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x627:0x0] updating lvb ctime from disk: 1780997298 -> 1780997308 00002000:00010000:3.0:1780997308.809092:0:23856:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x627:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780997308.809104:0:23856:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb7480 x1867507110465152/t4294969484(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997308.809200:0:23856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+19:2394:x1867507110465152:12345-192.168.206.51@tcp:10:dd.0 Request processed in 289us (872us total) trans 4294969484 rc 0/0 00000100:00100000:3.0:1780997308.809209:0:23856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1014 00002000:00010000:3.0:1780997308.809213:0:23856:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1575 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.809216:0:23856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adbb7480 with x1867507110465152 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.809221:0:23856:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689adbb7480. 00000100:00100000:3.0:1780997308.809895:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110465280 00000100:00100000:3.0:1780997308.809905:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110465280 00000100:00100000:3.0:1780997308.809939:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110465536 00000100:00100000:3.0:1780997308.809942:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110465536 00000100:00100000:3.0:1780997308.809963:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1566 00000100:00100000:3.0:1780997308.809971:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+85:72964:x1867507110465280:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.809993:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.810015:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02800/0x30fd811c0305c1af lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90f5 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.810050:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c1b6 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.810069:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c1b6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.810096:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c1b6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.810241:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02800/0x30fd811c0305c1af lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90f5 expref: 87 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.810263:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03200/0x30fd811c0305c1b6 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90f5 expref: 86 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.810291:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x10:0x0].0x0 (ffff96898d864b00) 00010000:00010000:3.0:1780997308.810295:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780997308.810299:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff03200, rc 0) 00000100:00100000:2.0:1780997308.810951:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110465024 00000100:00100000:2.0:1780997308.810963:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110465024 00000100:00100000:3.0:1780997308.811058:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+86:72964:x1867507110465280:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1085us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997308.811066:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1566 00000100:00100000:3.0:1780997308.811097:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1567 00000100:00100000:3.0:1780997308.811105:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+85:72965:x1867507110465536:12345-192.168.206.51@tcp:101:dd.0 00000100:00100000:0.0:1780997308.811219:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110465664 00000100:00100000:0.0:1780997308.811225:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110465664 00000100:00100000:0.0:1780997308.811260:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6010 00000100:00100000:0.0:1780997308.811510:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+20:72962:x1867507110465024:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.811524:0:25172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.811548:0:25172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305c1bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x629:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90ee expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997308.811580:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x629:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:0.0:1780997308.811603:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.811606:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.811614:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305c1bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90ee expref: 21 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.811631:0:25172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305c1bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90ee expref: 21 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.811665:0:25172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2c00, rc 0) 00010000:00000080:0.0:1780997308.811673:0:25172:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb5f80 x1867507110465024/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997308.811714:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+21:72962:x1867507110465024:12345-192.168.206.51@tcp:101:dd.0 Request processed in 448us (3978us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.811722:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6010 00000100:00100000:0.0:1780997308.811737:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6011 00000100:00100000:0.0:1780997308.811743:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+20:72963:x1867507110465664:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.811806:0:25172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.811816:0:25172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305c1c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x62a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9103 expref: -99 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997308.812063:0:25172:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x62a:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:0.0:1780997308.812075:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.812077:0:25172:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.812082:0:25172:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305c1c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9103 expref: 21 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.812094:0:25172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305c1c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9103 expref: 21 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.812103:0:25172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3800, rc 0) 00010000:00000080:0.0:1780997308.812108:0:25172:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb6680 x1867507110465664/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1780997308.812335:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1780997308.815029:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+21:72963:x1867507110465664:12345-192.168.206.51@tcp:101:dd.0 Request processed in 3280us (6152us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.815038:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6011 00010000:00010000:3.0:1780997308.816520:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c1cb lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae90fc expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.816693:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c1d2 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.816709:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c1d2 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.816738:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c1d2 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.816832:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c1d9 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.816840:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c1d9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.816848:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c1d9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.816916:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305c1e0 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.816925:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305c1e0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.816932:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305c1e0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997308.816942:0:65272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x11:0x0]: returning size 0 00010000:00010000:3.0:1780997308.817031:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c1d2 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817038:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c1d2 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817044:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c1d2 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817050:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c1d2 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817062:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.817066:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c1d2 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817075:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c1d2 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817087:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898712da00) 00010000:00010000:3.0:1780997308.817089:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.817094:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c1d2 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817100:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c1d2 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817237:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c1d9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817246:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c1d9 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817252:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c1d9 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817265:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.817294:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c1d9 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817301:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c1d9 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817321:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xc8545ca3 (ffff96898712d200) 00010000:00010000:3.0:1780997308.817324:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.817327:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c1d9 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.817334:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c1d9 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.818448:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c1cb lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90fc expref: 88 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.818472:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305c1e0 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90fc expref: 87 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.818480:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x11:0x0].0x0 (ffff96898d864200) 00010000:00010000:3.0:1780997308.818483:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780997308.818486:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0800, rc 0) 00000100:00100000:3.0:1780997308.819622:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+87:72965:x1867507110465536:12345-192.168.206.51@tcp:101:dd.0 Request processed in 8503us (10794us total) trans 81604378866 rc 0/0 00000100:00100000:3.0:1780997308.819633:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1567 00000100:00100000:0.0:1780997308.820136:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.820385:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110465920 00000100:00100000:2.0:1780997308.820395:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110465920 00000100:00100000:2.0:1780997308.820438:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 270 00000100:00100000:2.0:1780997308.820447:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+87:72960:x1867507110465920:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:2.0:1780997308.820707:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+88:72960:x1867507110465920:12345-192.168.206.51@tcp:35:dd.0 Request processed in 260us (572us total) trans 81604378867 rc 0/0 00000100:00100000:2.0:1780997308.820714:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 270 00000100:00100000:0.0:1780997308.822690:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.822730:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.822826:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110466176 00000100:00100000:1.0:1780997308.822834:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110466176 00000100:00100000:1.0:1780997308.822882:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1568 00000100:00100000:1.0:1780997308.822891:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+88:72965:x1867507110466176:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1780997308.822911:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997308.822931:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305c1ee lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae910a expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.822965:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305c1f5 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.822980:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305c1f5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.823006:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305c1f5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.823104:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8a00/0x30fd811c0305c1ee lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae910a expref: 90 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.823133:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9c00/0x30fd811c0305c1f5 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae910a expref: 89 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.823142:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x11:0x0].0x0 (ffff96898d864200) 00010000:00010000:1.0:1780997308.823145:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780997308.823148:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9c00, rc 0) 00000100:00100000:1.0:1780997308.823203:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+89:72965:x1867507110466176:12345-192.168.206.51@tcp:101:dd.0 Request processed in 313us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997308.823209:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1568 00000100:00100000:1.0:1780997308.823949:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.824012:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110466048 00000100:00100000:3.0:1780997308.824020:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110466048 00002000:00010000:3.0:1780997308.824055:0:24155:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1578 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.824061:0:24155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689a5c47100 with x1867507110466048 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.824074:0:24155:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689a5c47100. 00000100:00100000:3.0:1780997308.824102:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110466304 00000100:00100000:3.0:1780997308.824106:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110466304 00002000:00010000:3.0:1780997308.824130:0:24155:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1577 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.824133:0:24155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adbb6300 with x1867507110466304 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.824139:0:24155:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689adbb6300. 00000100:00100000:3.0:1780997308.824168:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1015 00000100:00100000:3.0:1780997308.824177:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:2394:x1867507110466048:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:3.0:1780997308.824428:0:24155:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x62a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780997308.824432:0:24155:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x62a:0x0] updating lvb mtime from disk: 1780997299 -> 1780997308 00002000:00010000:3.0:1780997308.824435:0:24155:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x62a:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:3.0:1780997308.824437:0:24155:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x62a:0x0] updating lvb ctime from disk: 1780997299 -> 1780997308 00002000:00010000:3.0:1780997308.824440:0:24155:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x62a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780997308.824449:0:24155:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689a5c47100 x1867507110466048/t4294969485(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997308.824498:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+23:2394:x1867507110466048:12345-192.168.206.51@tcp:10:dd.0 Request processed in 322us (1815us total) trans 4294969485 rc 0/0 00000100:00100000:3.0:1780997308.824505:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1015 00002000:00010000:3.0:1780997308.824509:0:24155:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1578 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.824512:0:24155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689a5c47100 with x1867507110466048 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.824516:0:24155:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689a5c47100. 00000100:00100000:3.0:1780997308.824534:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1016 00000100:00100000:3.0:1780997308.824542:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:2394:x1867507110466304:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:3.0:1780997308.824597:0:24155:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x629:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780997308.824600:0:24155:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x629:0x0] updating lvb mtime from disk: 1780997299 -> 1780997308 00002000:00010000:3.0:1780997308.824602:0:24155:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x629:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:3.0:1780997308.824605:0:24155:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x629:0x0] updating lvb ctime from disk: 1780997299 -> 1780997308 00002000:00010000:3.0:1780997308.824608:0:24155:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x629:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780997308.824622:0:24155:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb6300 x1867507110466304/t4294969486(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997308.824648:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+23:2394:x1867507110466304:12345-192.168.206.51@tcp:10:dd.0 Request processed in 108us (705us total) trans 4294969486 rc 0/0 00000100:00100000:3.0:1780997308.824655:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1016 00002000:00010000:3.0:1780997308.824658:0:24155:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1577 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.824661:0:24155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adbb6300 with x1867507110466304 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.824665:0:24155:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689adbb6300. 00000100:00100000:3.0:1780997308.825987:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.826030:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.827155:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110466688 00000100:00100000:1.0:1780997308.827169:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110466688 00000100:00100000:1.0:1780997308.827217:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110466816 00000100:00100000:1.0:1780997308.827221:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110466816 00000100:00100000:1.0:1780997308.827244:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1569 00000100:00100000:1.0:1780997308.827254:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+90:72964:x1867507110466688:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:1.0:1780997308.827325:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997308.827366:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689c2054400/0x30fd811c0305c193 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90e0 expref: 90 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.827387:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x10:0x0].0x0 (ffff96898d864b00) 00010000:00010000:1.0:1780997308.827410:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780997308.827578:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305c1fc lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.827593:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305c1fc lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.827602:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305c1fc lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780997308.827643:0:63417:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378868 00000004:00010000:1.0:1780997308.827661:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000493bf30b reply state 0000000066e6c170 transno 81604378869 ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305c1fc lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.827672:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305c1fc lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.827677:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x10:0x0].0x0 (ffff96898d864b00) 00010000:00010000:1.0:1780997308.827680:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997308.827682:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780997308.827773:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+92:72964:x1867507110466688:12345-192.168.206.51@tcp:36:dd.0 Request processed in 520us (1792us total) trans 81604378869 rc 0/0 00000100:00100000:1.0:1780997308.827780:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1569 00000020:00080000:1.0:1780997308.827784:0:63417:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1780997308.827798:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1570 00000100:00100000:1.0:1780997308.827805:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+91:72967:x1867507110466816:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1780997308.827814:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997308.827835:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305c203 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9111 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.827922:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c20a lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.827937:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c20a lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.827945:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c20a lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.827960:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c211 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.827967:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c211 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.827973:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c211 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828014:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c218 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828021:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c218 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828028:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c218 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997308.828036:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x13:0x0]: returning size 0 00010000:00010000:1.0:1780997308.828082:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c20a lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828090:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c20a lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828097:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c20a lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828110:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c20a lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828115:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997308.828119:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c20a lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828127:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c20a lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828137:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96899634f900) 00010000:00010000:1.0:1780997308.828139:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997308.828143:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c20a lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828149:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c20a lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828164:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c211 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828171:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c211 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828176:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c211 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828181:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997308.828184:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c211 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828200:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c211 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828210:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x7bc65ca3 (ffff96899634f000) 00010000:00010000:1.0:1780997308.828212:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997308.828216:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c211 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828222:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c211 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828256:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305c203 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9111 expref: 94 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828299:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c218 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9111 expref: 93 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.828307:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x13:0x0].0x0 (ffff96898712dc00) 00010000:00010000:1.0:1780997308.828309:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997308.828312:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffdc00, rc 0) 00000100:00100000:1.0:1780997308.828342:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+93:72967:x1867507110466816:12345-192.168.206.51@tcp:101:dd.0 Request processed in 537us (2311us total) trans 81604378870 rc 0/0 00000100:00100000:1.0:1780997308.828348:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1570 00000100:00100000:3.0:1780997308.828603:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.828737:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110467072 00000100:00100000:2.0:1780997308.828759:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110467072 00000100:00100000:2.0:1780997308.828801:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1571 00000100:00100000:2.0:1780997308.828810:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+93:72965:x1867507110467072:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:2.0:1780997308.828848:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997308.828863:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305c1e0 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90fc expref: 93 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.828874:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x11:0x0].0x0 (ffff96898d864200) 00010000:00010000:2.0:1780997308.828878:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997308.828989:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305c226 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.828999:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305c226 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.829008:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305c226 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780997308.829047:0:63418:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378871 00000004:00010000:2.0:1780997308.829069:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000007428299 reply state 000000007b4c49f6 transno 81604378872 ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305c226 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.829079:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305c226 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.829086:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x11:0x0].0x0 (ffff96898d864200) 00010000:00010000:2.0:1780997308.829088:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997308.829090:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997308.829141:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+95:72965:x1867507110467072:12345-192.168.206.51@tcp:36:dd.0 Request processed in 333us (539us total) trans 81604378872 rc 0/0 00000100:00100000:2.0:1780997308.829147:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1571 00000020:00080000:2.0:1780997308.829161:0:63418:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1780997308.835103:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.835144:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.835201:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.835258:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110467328 00000100:00100000:3.0:1780997308.835295:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110467328 00000100:00100000:0.0:1780997308.835309:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110467456 00000100:00100000:0.0:1780997308.835316:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110467456 00000100:00100000:3.0:1780997308.835363:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 271 00000100:00100000:0.0:1780997308.835364:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6012 00000100:00100000:3.0:1780997308.835379:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+95:72963:x1867507110467328:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:0.0:1780997308.835380:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+23:72964:x1867507110467456:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.835403:0:25180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.835426:0:25180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305c22d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x62b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9118 expref: -99 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997308.835452:0:25180:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x62b:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:0.0:1780997308.835473:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.835475:0:25180:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.835484:0:25180:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305c22d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9118 expref: 24 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.835501:0:25180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305c22d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9118 expref: 24 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.835515:0:25180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2000, rc 0) 00010000:00000080:0.0:1780997308.835525:0:25180:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b1163800 x1867507110467456/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997308.835610:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+24:72964:x1867507110467456:12345-192.168.206.51@tcp:101:dd.0 Request processed in 236us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.835618:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6012 00000100:00100000:3.0:1780997308.835705:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+96:72963:x1867507110467328:12345-192.168.206.51@tcp:35:dd.0 Request processed in 331us (613us total) trans 81604378873 rc 0/0 00000100:00100000:3.0:1780997308.835713:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 271 00000100:00100000:1.0:1780997308.835800:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110467584 00000100:00100000:1.0:1780997308.835806:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110467584 00000100:00100000:1.0:1780997308.835857:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1572 00000100:00100000:1.0:1780997308.835866:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+96:72967:x1867507110467584:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1780997308.835890:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997308.835907:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305c234 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae911f expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.835933:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305c23b lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.835945:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305c23b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.835957:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305c23b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.836040:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305c234 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae911f expref: 98 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.836056:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffcc00/0x30fd811c0305c23b lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae911f expref: 97 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.836065:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x13:0x0].0x0 (ffff96898712dc00) 00010000:00010000:1.0:1780997308.836068:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780997308.836072:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffcc00, rc 0) 00000100:00100000:1.0:1780997308.836251:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+97:72967:x1867507110467584:12345-192.168.206.51@tcp:101:dd.0 Request processed in 386us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997308.836258:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1572 00000100:00100000:1.0:1780997308.840718:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adbb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127042816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997308.840794:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997308.841659:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127042816 00000100:00100000:3.0:1780997308.841668:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127042816 00000100:00100000:1.0:1780997308.841688:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127042944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780997308.841727:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180 00000100:00100000:3.0:1780997308.841738:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127042816:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997308.841759:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1780997308.841767:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997308.841831:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127042816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997308.841839:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180 00000100:00100000:3.0:1780997308.841863:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127042944 00000100:00100000:3.0:1780997308.841866:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127042944 00000100:00100000:2.0:1780997308.842194:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00100000:2.0:1780997308.842206:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127042944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780997308.842224:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000080:2.0:1780997308.842237:0:14235:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb4700 x1867507127042944/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:639/0 lens 224/368 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997308.842333:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.842369:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.842371:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110467840 00000100:00100000:3.0:1780997308.842377:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110467840 00000100:00100000:0.0:1780997308.842421:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.842422:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1573 00000100:00100000:0.0:1780997308.842451:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110468224 00000100:00100000:0.0:1780997308.842455:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110468224 00000100:00100000:0.0:1780997308.842489:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6013 00000100:00100000:0.0:1780997308.842497:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+24:72965:x1867507110468224:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.842509:0:25168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1780997308.842519:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+97:72966:x1867507110467840:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.842536:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.842539:0:25168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305c242 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x62c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae912d expref: -99 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.842555:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305c249 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9126 expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997308.842570:0:25168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x62c:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:0.0:1780997308.842591:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.842594:0:25168:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.842603:0:25168:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305c242 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae912d expref: 25 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.842621:0:25168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305c242 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae912d expref: 25 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.842636:0:25168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2600, rc 0) 00010000:00000080:0.0:1780997308.842642:0:25168:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1e680 x1867507110468224/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997308.842699:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:72965:x1867507110468224:12345-192.168.206.51@tcp:101:dd.0 Request processed in 203us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.842707:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6013 00010000:00010000:3.0:1780997308.842716:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c250 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.842731:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c250 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997308.842737:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110468096 00000100:00100000:0.0:1780997308.842742:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110468096 00010000:00010000:3.0:1780997308.842743:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c250 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.842757:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c257 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.842764:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c257 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.842770:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c257 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.842845:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c25e lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.842854:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c25e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.842870:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c25e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997308.842944:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 272 00000100:00100000:0.0:1780997308.842951:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+99:72962:x1867507110468096:12345-192.168.206.51@tcp:35:dd.0 00000004:00200000:3.0:1780997308.843114:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x12:0x0]: returning size 0 00000100:00100000:0.0:1780997308.843167:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+101:72962:x1867507110468096:12345-192.168.206.51@tcp:35:dd.0 Request processed in 215us (799us total) trans 81604378874 rc 0/0 00000100:00100000:0.0:1780997308.843175:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 272 00010000:00010000:3.0:1780997308.843176:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c250 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.843186:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c250 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.843192:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c250 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.843200:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c250 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.843206:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.843211:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c250 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.843220:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c250 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997308.843229:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1780997308.843240:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898712da00) 00010000:00010000:3.0:1780997308.843246:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.843250:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c250 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.843257:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c250 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997308.843266:0:23857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110468352 00000100:00100000:0.0:1780997308.843299:0:23857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110468352 00010000:00010000:3.0:1780997308.843313:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c257 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997308.843322:0:23857:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1579 (0->18446744073709551615) 00002000:00100000:0.0:1780997308.843329:0:23857:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb1e300 with x1867507110468352 ext(0->18446744073709551615) 00010000:00010000:3.0:1780997308.843332:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c257 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997308.843339:0:23857:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb1e300. 00010000:00010000:3.0:1780997308.843341:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c257 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.843349:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.843352:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c257 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.843359:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c257 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997308.843366:0:23857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1017 00010000:00010000:3.0:1780997308.843369:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x220d5ca3 (ffff96898712d200) 00010000:00010000:3.0:1780997308.843373:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.843378:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c257 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997308.843379:0:23857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2394:x1867507110468352:12345-192.168.206.51@tcp:10:dd.0 00010000:00010000:3.0:1780997308.843392:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c257 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997308.843493:0:23857:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x62b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1780997308.843497:0:23857:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x62b:0x0] updating lvb mtime from disk: 1780997299 -> 1780997308 00002000:00010000:0.0:1780997308.843500:0:23857:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x62b:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:0.0:1780997308.843502:0:23857:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x62b:0x0] updating lvb ctime from disk: 1780997299 -> 1780997308 00002000:00010000:0.0:1780997308.843504:0:23857:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x62b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1780997308.843512:0:23857:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1e300 x1867507110468352/t4294969487(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1780997308.843526:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305c249 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9126 expref: 101 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.843550:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c25e lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9126 expref: 100 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.843560:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x12:0x0].0x0 (ffff96898d864000) 00000100:00100000:0.0:1780997308.843560:0:23857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+26:2394:x1867507110468352:12345-192.168.206.51@tcp:10:dd.0 Request processed in 184us (332us total) trans 4294969487 rc 0/0 00010000:00010000:3.0:1780997308.843566:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:0.0:1780997308.843571:0:23857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1017 00010000:00010000:3.0:1780997308.843577:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c1c00, rc 0) 00002000:00010000:0.0:1780997308.843578:0:23857:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1579 (0->18446744073709551615) 00002000:00100000:0.0:1780997308.843584:0:23857:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb1e300 with x1867507110468352 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997308.843589:0:23857:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb1e300. 00000100:00100000:3.0:1780997308.843609:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+100:72966:x1867507110467840:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1177us (1277us total) trans 81604378875 rc 0/0 00000100:00100000:3.0:1780997308.843617:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1573 00000100:00100000:0.0:1780997308.843665:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.843811:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110468608 00000100:00100000:3.0:1780997308.843816:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110468608 00000100:00100000:3.0:1780997308.843853:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1574 00000100:00100000:3.0:1780997308.843860:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+100:72967:x1867507110468608:12345-192.168.206.51@tcp:36:dd.0 00000100:00100000:0.0:1780997308.844252:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adbb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127042816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997308.844534:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127042944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2328us (2783us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997308.844545:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00100000:1.0:1780997308.844706:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127042944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1780997308.849928:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997308.849973:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c218 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9111 expref: 100 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.849998:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x13:0x0].0x0 (ffff96898712dc00) 00010000:00010000:0.0:1780997308.850003:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997308.850217:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3a00/0x30fd811c0305c26c lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.850233:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3a00/0x30fd811c0305c26c lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.850244:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3a00/0x30fd811c0305c26c lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1780997308.850845:0:63584:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378876 00000004:00010000:0.0:1780997308.851018:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df75bdf4 reply state 000000004e1cf270 transno 81604378877 ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3a00/0x30fd811c0305c26c lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.851066:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3a00/0x30fd811c0305c26c lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.851075:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x13:0x0].0x0 (ffff96898712dc00) 00010000:00010000:0.0:1780997308.851078:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997308.851081:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997308.851306:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+102:72967:x1867507110468608:12345-192.168.206.51@tcp:36:dd.0 Request processed in 7443us (7638us total) trans 81604378877 rc 0/0 00000100:00100000:0.0:1780997308.851325:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1574 00000020:00080000:0.0:1780997308.851332:0:63584:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1780997308.851792:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.851946:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110468736 00000100:00100000:3.0:1780997308.851955:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110468736 00000100:00100000:3.0:1780997308.852009:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1575 00000100:00100000:3.0:1780997308.852019:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+102:72966:x1867507110468736:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.852037:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.852053:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c273 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9134 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.852087:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c27a lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.852099:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c27a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.852108:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c27a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.852214:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c273 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9134 expref: 104 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.852231:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0400/0x30fd811c0305c27a lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9134 expref: 103 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.852244:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x12:0x0].0x0 (ffff96898d864000) 00010000:00010000:3.0:1780997308.852247:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780997308.852250:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0400, rc 0) 00000100:00100000:3.0:1780997308.852317:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+103:72966:x1867507110468736:12345-192.168.206.51@tcp:101:dd.0 Request processed in 299us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997308.852324:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1575 00000100:00100000:1.0:1780997308.854989:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.855166:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.855201:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.855225:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110469376 00000100:00100000:1.0:1780997308.855234:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110469376 00000100:00100000:1.0:1780997308.855301:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 273 00000100:00100000:1.0:1780997308.855313:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+103:72964:x1867507110469376:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:1.0:1780997308.855919:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+104:72964:x1867507110469376:12345-192.168.206.51@tcp:35:dd.0 Request processed in 608us (715us total) trans 81604378878 rc 0/0 00000100:00100000:1.0:1780997308.855928:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 273 00000100:00100000:3.0:1780997308.857020:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110469120 00000100:00100000:3.0:1780997308.857031:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110469120 00000100:00100000:3.0:1780997308.857085:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1576 00000100:00100000:3.0:1780997308.857093:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+104:72968:x1867507110469120:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.857109:0:63419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.857146:0:63419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305c281 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae913b expref: -99 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.857306:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c288 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.857320:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c288 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.857330:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c288 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.857342:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c28f lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.857349:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c28f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.857377:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c28f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857706:0:63419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305c296 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857718:0:63419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305c296 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857727:0:63419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305c296 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997308.857737:0:63419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x14:0x0]: returning size 0 00010000:00010000:1.0:1780997308.857836:0:63419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c288 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857845:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c288 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857875:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c288 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857882:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c288 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857888:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997308.857893:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c288 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857902:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c288 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857914:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898712d200) 00010000:00010000:1.0:1780997308.857917:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997308.857923:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c288 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857929:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c288 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857943:0:63419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c28f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857948:0:63419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c28f lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857953:0:63419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c28f lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857958:0:63419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997308.857967:0:63419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c28f lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857974:0:63419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c28f lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857982:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xd57f5ca3 (ffff96898712d000) 00010000:00010000:1.0:1780997308.857985:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997308.857988:0:63419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c28f lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.857994:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c28f lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63419 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.858195:0:63419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305c281 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae913b expref: 107 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.858217:0:63419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305c296 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae913b expref: 106 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.858225:0:63419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x14:0x0].0x0 (ffff96898d864700) 00010000:00010000:1.0:1780997308.858227:0:63419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997308.858229:0:63419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9600, rc 0) 00000100:00100000:1.0:1780997308.858631:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+106:72968:x1867507110469120:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1536us (3462us total) trans 81604378879 rc 0/0 00000100:00100000:1.0:1780997308.858640:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1576 00000100:00100000:3.0:1780997308.859095:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.859910:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110469504 00000100:00100000:2.0:1780997308.859921:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110469504 00000100:00100000:2.0:1780997308.859989:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6014 00000100:00100000:2.0:1780997308.860000:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+26:72967:x1867507110469504:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997308.860016:0:8233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997308.860037:0:8233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305c2a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x62e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9142 expref: -99 pid: 8233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997308.860073:0:8233:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x62e:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:2.0:1780997308.860097:0:8233:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997308.860099:0:8233:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997308.860106:0:8233:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305c2a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9142 expref: 27 pid: 8233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.860122:0:8233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305c2a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9142 expref: 27 pid: 8233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.860151:0:8233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956ea00, rc 0) 00010000:00000080:2.0:1780997308.860159:0:8233:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689aebba680 x1867507110469504/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997308.860229:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:72967:x1867507110469504:12345-192.168.206.51@tcp:101:dd.0 Request processed in 232us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997308.860236:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6014 00000100:00100000:0.0:1780997308.861220:0:24143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110468864 00000100:00100000:0.0:1780997308.861240:0:24143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110468864 00002000:00010000:0.0:1780997308.861306:0:24143:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1580 (0->18446744073709551615) 00002000:00100000:0.0:1780997308.861311:0:24143:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adbb5180 with x1867507110468864 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997308.861332:0:24143:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689adbb5180. 00000100:00100000:0.0:1780997308.861361:0:24143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1018 00000100:00100000:0.0:1780997308.861369:0:24143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2395:x1867507110468864:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:0.0:1780997308.861536:0:24143:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x62c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1780997308.861540:0:24143:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x62c:0x0] updating lvb mtime from disk: 1780997299 -> 1780997308 00002000:00010000:0.0:1780997308.861543:0:24143:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x62c:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:0.0:1780997308.861545:0:24143:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x62c:0x0] updating lvb ctime from disk: 1780997299 -> 1780997308 00002000:00010000:0.0:1780997308.861548:0:24143:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x62c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1780997308.861556:0:24143:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb5180 x1867507110468864/t4294969488(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997308.861613:0:24143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+28:2395:x1867507110468864:12345-192.168.206.51@tcp:10:dd.0 Request processed in 245us (6635us total) trans 4294969488 rc 0/0 00000100:00100000:0.0:1780997308.861638:0:24143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1018 00002000:00010000:0.0:1780997308.861641:0:24143:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1580 (0->18446744073709551615) 00002000:00100000:0.0:1780997308.861644:0:24143:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adbb5180 with x1867507110468864 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997308.861649:0:24143:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689adbb5180. 00000100:00100000:2.0:1780997308.864499:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.864910:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110469760 00000100:00100000:3.0:1780997308.864923:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110469760 00000100:00100000:3.0:1780997308.864985:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1577 00000100:00100000:3.0:1780997308.864995:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+106:72966:x1867507110469760:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:3.0:1780997308.865245:0:80049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997308.865309:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c25e lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9126 expref: 106 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.865339:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x12:0x0].0x0 (ffff96898d864000) 00010000:00010000:3.0:1780997308.865344:0:80049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997308.865527:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c2ab lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.865541:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c2ab lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.865551:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c2ab lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1780997308.865594:0:80049:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378880 00000004:00010000:3.0:1780997308.865755:0:80049:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a630651 reply state 00000000b6a91a97 transno 81604378881 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c2ab lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.865768:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c2ab lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.865788:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x12:0x0].0x0 (ffff96898d864000) 00010000:00010000:3.0:1780997308.865791:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997308.865794:0:80049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780997308.865911:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+108:72966:x1867507110469760:12345-192.168.206.51@tcp:36:dd.0 Request processed in 915us (1422us total) trans 81604378881 rc 0/0 00000100:00100000:3.0:1780997308.865919:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1577 00000020:00080000:3.0:1780997308.865924:0:80049:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1780997308.866215:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.866369:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.866608:0:8236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110470016 00000100:00100000:2.0:1780997308.866617:0:8236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110470016 00002000:00010000:2.0:1780997308.866648:0:8236:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1582 (0->18446744073709551615) 00002000:00100000:2.0:1780997308.866653:0:8236:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adbb5500 with x1867507110470016 ext(0->18446744073709551615) 00002000:00010000:2.0:1780997308.866662:0:8236:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689adbb5500. 00000100:00100000:2.0:1780997308.866692:0:8236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1019 00000100:00100000:2.0:1780997308.866701:0:8236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+28:2394:x1867507110470016:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:2.0:1780997308.866831:0:8236:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x62e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1780997308.866835:0:8236:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x62e:0x0] updating lvb mtime from disk: 1780997299 -> 1780997308 00002000:00010000:2.0:1780997308.866837:0:8236:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x62e:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:2.0:1780997308.866839:0:8236:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x62e:0x0] updating lvb ctime from disk: 1780997299 -> 1780997308 00002000:00010000:2.0:1780997308.866841:0:8236:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x62e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1780997308.866849:0:8236:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb5500 x1867507110470016/t4294969489(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997308.866908:0:8236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2394:x1867507110470016:12345-192.168.206.51@tcp:10:dd.0 Request processed in 208us (539us total) trans 4294969489 rc 0/0 00000100:00100000:2.0:1780997308.866928:0:8236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1019 00002000:00010000:2.0:1780997308.866931:0:8236:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1582 (0->18446744073709551615) 00002000:00100000:2.0:1780997308.866934:0:8236:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adbb5500 with x1867507110470016 ext(0->18446744073709551615) 00002000:00010000:2.0:1780997308.866939:0:8236:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689adbb5500. 00000100:00100000:3.0:1780997308.868751:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110469888 00000100:00100000:3.0:1780997308.868770:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110469888 00000100:00100000:3.0:1780997308.868843:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1578 00000100:00100000:3.0:1780997308.868853:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+108:72968:x1867507110469888:12345-192.168.206.51@tcp:101:dd.0 00000100:00100000:1.0:1780997308.869609:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.869999:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110470272 00000100:00100000:2.0:1780997308.870007:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110470272 00000100:00100000:2.0:1780997308.870129:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1579 00000100:00100000:2.0:1780997308.870148:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+109:72969:x1867507110470272:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997308.870178:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997308.870201:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c2b2 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9150 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.871246:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305c2b9 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.871265:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305c2b9 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.871300:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305c2b9 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.871481:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.871493:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c2c7 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9149 expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.871515:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02800/0x30fd811c0305c2ce lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.871524:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02800/0x30fd811c0305c2ce lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.871532:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02800/0x30fd811c0305c2ce lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.871630:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c2c7 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9149 expref: 112 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.871649:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02800/0x30fd811c0305c2ce lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9149 expref: 111 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.871665:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x14:0x0].0x0 (ffff96898d864700) 00010000:00010000:3.0:1780997308.871668:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780997308.871672:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02800, rc 0) 00000100:00100000:3.0:1780997308.871740:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+111:72968:x1867507110469888:12345-192.168.206.51@tcp:101:dd.0 Request processed in 2889us (5525us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997308.871748:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1578 00010000:00010000:2.0:1780997308.872104:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305c2c0 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872119:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305c2c0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872128:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305c2c0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872210:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c2d5 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872218:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c2d5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872225:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c2d5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780997308.872235:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x15:0x0]: returning size 0 00010000:00010000:2.0:1780997308.872695:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305c2b9 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872704:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305c2b9 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872710:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305c2b9 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872718:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305c2b9 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872723:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997308.872727:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305c2b9 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872736:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305c2b9 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872747:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff968983653400) 00010000:00010000:2.0:1780997308.872750:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997308.872762:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305c2b9 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872769:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e600/0x30fd811c0305c2b9 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872782:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305c2c0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872788:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305c2c0 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872795:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305c2c0 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872800:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:2.0:1780997308.872803:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305c2c0 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872809:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305c2c0 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872817:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x2f385ca3 (ffff968983653a00) 00010000:00010000:2.0:1780997308.872829:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780997308.872832:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305c2c0 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.872838:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f200/0x30fd811c0305c2c0 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.873605:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c2b2 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9150 expref: 112 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.873642:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c2d5 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9150 expref: 111 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.873650:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x15:0x0].0x0 (ffff9689882bd000) 00010000:00010000:2.0:1780997308.873653:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780997308.873655:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956f400, rc 0) 00000100:00100000:2.0:1780997308.881123:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+111:72969:x1867507110470272:12345-192.168.206.51@tcp:101:dd.0 Request processed in 10973us (11503us total) trans 81604378882 rc 0/0 00000100:00100000:2.0:1780997308.881138:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1579 00000100:00100000:0.0:1780997308.883699:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.885065:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110470528 00000100:00100000:2.0:1780997308.885079:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110470528 00000100:00100000:2.0:1780997308.885163:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 274 00000100:00100000:2.0:1780997308.885174:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+111:72965:x1867507110470528:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:2.0:1780997308.885714:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+112:72965:x1867507110470528:12345-192.168.206.51@tcp:35:dd.0 Request processed in 541us (2026us total) trans 81604378883 rc 0/0 00000100:00100000:2.0:1780997308.885723:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 274 00000100:00100000:0.0:1780997308.886694:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.886737:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.886816:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.886852:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110471168 00000100:00100000:0.0:1780997308.886872:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110471168 00000100:00100000:0.0:1780997308.886922:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1580 00000100:00100000:0.0:1780997308.886931:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+112:72968:x1867507110471168:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:0.0:1780997308.886979:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997308.887006:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305c296 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae913b expref: 112 pid: 63419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.887027:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x14:0x0].0x0 (ffff96898d864700) 00010000:00010000:0.0:1780997308.887032:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780997308.887764:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2200/0x30fd811c0305c2e3 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.887781:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2200/0x30fd811c0305c2e3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.887792:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2200/0x30fd811c0305c2e3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1780997308.887847:0:63584:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378884 00000004:00010000:0.0:1780997308.887902:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d589db2 reply state 00000000c884189a transno 81604378885 ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2200/0x30fd811c0305c2e3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.887915:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2200/0x30fd811c0305c2e3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.887922:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x14:0x0].0x0 (ffff96898d864700) 00010000:00010000:0.0:1780997308.887924:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780997308.887927:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780997308.888017:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+114:72968:x1867507110471168:12345-192.168.206.51@tcp:36:dd.0 Request processed in 1085us (1198us total) trans 81604378885 rc 0/0 00000100:00100000:0.0:1780997308.888025:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1580 00000020:00080000:0.0:1780997308.888031:0:63584:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1780997308.888671:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110470656 00000100:00100000:2.0:1780997308.888683:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110470656 00000100:00100000:2.0:1780997308.888742:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6015 00000100:00100000:2.0:1780997308.888764:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:72966:x1867507110470656:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997308.888779:0:25169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997308.888798:0:25169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305c2ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x62d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9157 expref: -99 pid: 25169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997308.888834:0:25169:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x62d:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:2.0:1780997308.888866:0:25169:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997308.888868:0:25169:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997308.888875:0:25169:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305c2ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9157 expref: 30 pid: 25169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.888891:0:25169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305c2ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9157 expref: 30 pid: 25169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.888902:0:25169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956fa00, rc 0) 00010000:00000080:2.0:1780997308.888908:0:25169:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1c700 x1867507110470656/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997308.888952:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+30:72966:x1867507110470656:12345-192.168.206.51@tcp:101:dd.0 Request processed in 190us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997308.888958:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6015 00000100:00100000:3.0:1780997308.889930:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110470912 00000100:00100000:3.0:1780997308.889941:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110470912 00000100:00100000:3.0:1780997308.889982:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 275 00000100:00100000:3.0:1780997308.889990:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+114:72967:x1867507110470912:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:3.0:1780997308.890266:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+115:72967:x1867507110470912:12345-192.168.206.51@tcp:35:dd.0 Request processed in 275us (3526us total) trans 81604378886 rc 0/0 00000100:00100000:3.0:1780997308.890312:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 275 00000100:00100000:3.0:1780997308.890449:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.891072:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110471552 00000100:00100000:0.0:1780997308.891081:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110471552 00000100:00100000:0.0:1780997308.891128:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1581 00000100:00100000:0.0:1780997308.891138:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+115:72970:x1867507110471552:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.891157:0:63417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.891179:0:63417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3200/0x30fd811c0305c2f1 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9165 expref: -99 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891371:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305c2f8 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891392:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305c2f8 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891405:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305c2f8 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891418:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2a00/0x30fd811c0305c2ff lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891433:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2a00/0x30fd811c0305c2ff lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891440:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2a00/0x30fd811c0305c2ff lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891497:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3c00/0x30fd811c0305c306 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891506:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3c00/0x30fd811c0305c306 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891513:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3c00/0x30fd811c0305c306 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780997308.891524:0:63417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x16:0x0]: returning size 0 00010000:00010000:0.0:1780997308.891603:0:63417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305c2f8 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891610:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305c2f8 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891616:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305c2f8 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891622:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305c2f8 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891628:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997308.891633:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305c2f8 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891650:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305c2f8 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891663:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff9689896ffe00) 00010000:00010000:0.0:1780997308.891666:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997308.891671:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305c2f8 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891677:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2e00/0x30fd811c0305c2f8 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891694:0:63417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2a00/0x30fd811c0305c2ff lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891701:0:63417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2a00/0x30fd811c0305c2ff lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891706:0:63417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2a00/0x30fd811c0305c2ff lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891711:0:63417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:0.0:1780997308.891714:0:63417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2a00/0x30fd811c0305c2ff lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891720:0:63417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2a00/0x30fd811c0305c2ff lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891726:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x88f15ca3 (ffff9689896ffa00) 00010000:00010000:0.0:1780997308.891729:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780997308.891731:0:63417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2a00/0x30fd811c0305c2ff lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891747:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2a00/0x30fd811c0305c2ff lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891789:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3200/0x30fd811c0305c2f1 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9165 expref: 118 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891803:0:63417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3c00/0x30fd811c0305c306 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9165 expref: 117 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.891811:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x16:0x0].0x0 (ffff96898712de00) 00010000:00010000:0.0:1780997308.891814:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780997308.891816:0:63417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce3c00, rc 0) 00000100:00100000:0.0:1780997308.891894:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+117:72970:x1867507110471552:12345-192.168.206.51@tcp:101:dd.0 Request processed in 757us (1445us total) trans 81604378887 rc 0/0 00000100:00100000:0.0:1780997308.891902:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1581 00000100:00100000:3.0:1780997308.892379:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.892408:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110471296 00000100:00100000:3.0:1780997308.892415:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110471296 00000100:00100000:3.0:1780997308.892449:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1582 00000100:00100000:3.0:1780997308.892457:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+117:72969:x1867507110471296:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.892473:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.892488:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c314 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae915e expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.892519:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c31b lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.892542:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c31b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.892549:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c31b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.892643:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c314 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae915e expref: 119 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.892662:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02a00/0x30fd811c0305c31b lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae915e expref: 118 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.892670:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x15:0x0].0x0 (ffff9689882bd000) 00010000:00010000:3.0:1780997308.892673:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780997308.892676:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bff02a00, rc 0) 00000100:00100000:3.0:1780997308.892711:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+118:72969:x1867507110471296:12345-192.168.206.51@tcp:101:dd.0 Request processed in 254us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997308.892718:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1582 00000100:00100000:3.0:1780997308.896710:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.896987:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110471680 00000100:00100000:1.0:1780997308.896998:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110471680 00000100:00100000:1.0:1780997308.897104:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6016 00000100:00100000:1.0:1780997308.897115:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+30:72968:x1867507110471680:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1780997308.897148:0:25181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997308.897176:0:25181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc303d24/0x30fd811c0305c322 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x62f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae916c expref: -99 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997308.897206:0:25181:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x62f:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:1.0:1780997308.897232:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997308.897234:0:25181:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997308.897242:0:25181:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc303d24/0x30fd811c0305c322 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae916c expref: 31 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.897262:0:25181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc303d24/0x30fd811c0305c322 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae916c expref: 31 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.897336:0:25181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c8a00, rc 0) 00010000:00000080:1.0:1780997308.897345:0:25181:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689aebb8a80 x1867507110471680/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997308.897410:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+31:72968:x1867507110471680:12345-192.168.206.51@tcp:101:dd.0 Request processed in 297us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997308.897417:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6016 00000100:00100000:3.0:1780997308.900524:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.900619:0:23856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110471808 00000100:00100000:0.0:1780997308.900630:0:23856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110471808 00002000:00010000:0.0:1780997308.900675:0:23856:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1581 (0->18446744073709551615) 00002000:00100000:0.0:1780997308.900681:0:23856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689aebb8700 with x1867507110471808 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997308.900692:0:23856:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689aebb8700. 00000100:00100000:0.0:1780997308.900728:0:23856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1020 00000100:00100000:0.0:1780997308.900738:0:23856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+31:2397:x1867507110471808:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:0.0:1780997308.900942:0:23856:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x62d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1780997308.900946:0:23856:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x62d:0x0] updating lvb mtime from disk: 1780997299 -> 1780997308 00002000:00010000:0.0:1780997308.900949:0:23856:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x62d:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:0.0:1780997308.900952:0:23856:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x62d:0x0] updating lvb ctime from disk: 1780997299 -> 1780997308 00002000:00010000:0.0:1780997308.900968:0:23856:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x62d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1780997308.900978:0:23856:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689aebb8700 x1867507110471808/t4294969490(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997308.901050:0:23856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+32:2397:x1867507110471808:12345-192.168.206.51@tcp:10:dd.0 Request processed in 312us (540us total) trans 4294969490 rc 0/0 00000100:00100000:0.0:1780997308.901060:0:23856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1020 00002000:00010000:0.0:1780997308.901064:0:23856:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1581 (0->18446744073709551615) 00002000:00100000:0.0:1780997308.901067:0:23856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689aebb8700 with x1867507110471808 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997308.901071:0:23856:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689aebb8700. 00000100:00100000:2.0:1780997308.905466:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.905915:0:24144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110471936 00000100:00100000:0.0:1780997308.905927:0:24144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110471936 00002000:00010000:0.0:1780997308.905974:0:24144:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1583 (0->18446744073709551615) 00002000:00100000:0.0:1780997308.905979:0:24144:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b1163100 with x1867507110471936 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997308.905992:0:24144:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b1163100. 00000100:00100000:0.0:1780997308.906033:0:24144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1021 00000100:00100000:0.0:1780997308.906045:0:24144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+32:2394:x1867507110471936:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:0.0:1780997308.906994:0:24144:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x62f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1780997308.907000:0:24144:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x62f:0x0] updating lvb mtime from disk: 1780997299 -> 1780997308 00002000:00010000:0.0:1780997308.907003:0:24144:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x62f:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:0.0:1780997308.907005:0:24144:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x62f:0x0] updating lvb ctime from disk: 1780997299 -> 1780997308 00002000:00010000:0.0:1780997308.907007:0:24144:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x62f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1780997308.907020:0:24144:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b1163100 x1867507110471936/t4294969491(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997308.907109:0:24144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+33:2394:x1867507110471936:12345-192.168.206.51@tcp:10:dd.0 Request processed in 1065us (1652us total) trans 4294969491 rc 0/0 00000100:00100000:0.0:1780997308.907152:0:24144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1021 00002000:00010000:0.0:1780997308.907158:0:24144:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1583 (0->18446744073709551615) 00002000:00100000:0.0:1780997308.907161:0:24144:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b1163100 with x1867507110471936 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997308.907167:0:24144:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b1163100. 00000100:00100000:3.0:1780997308.909393:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.910488:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110472192 00000100:00100000:1.0:1780997308.910505:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110472192 00000100:00100000:1.0:1780997308.910581:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 276 00000100:00100000:1.0:1780997308.910593:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+118:72966:x1867507110472192:12345-192.168.206.51@tcp:35:dd.0 00000001:00080000:1.0:1780997308.911096:0:63420:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378888 00000100:00100000:1.0:1780997308.911232:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+120:72966:x1867507110472192:12345-192.168.206.51@tcp:35:dd.0 Request processed in 640us (1847us total) trans 81604378889 rc 0/0 00000100:00100000:1.0:1780997308.911240:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 276 00000020:00080000:1.0:1780997308.911245:0:63420:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1780997308.914888:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.914940:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.915106:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110472320 00000100:00100000:1.0:1780997308.915116:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110472320 00000100:00100000:1.0:1780997308.915168:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110472576 00000100:00100000:1.0:1780997308.915171:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110472576 00000100:00100000:1.0:1780997308.915193:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1583 00000100:00100000:1.0:1780997308.915201:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+121:72970:x1867507110472320:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1780997308.915222:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997308.915243:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c329 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9173 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.915303:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305c330 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.915328:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305c330 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.915340:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305c330 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.915463:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c329 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9173 expref: 123 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.915485:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9600/0x30fd811c0305c330 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9173 expref: 122 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.915505:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x16:0x0].0x0 (ffff96898712de00) 00010000:00010000:1.0:1780997308.915508:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780997308.915512:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a56c9600, rc 0) 00000100:00100000:3.0:1780997308.915551:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1584 00000100:00100000:3.0:1780997308.915566:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+122:72972:x1867507110472576:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.915576:0:65272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1780997308.915582:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+122:72970:x1867507110472320:12345-192.168.206.51@tcp:101:dd.0 Request processed in 379us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997308.915590:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1583 00010000:00010000:3.0:1780997308.915591:0:65272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c337 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae917a expref: -99 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.915735:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c33e lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.915745:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c33e lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.915752:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c33e lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.915765:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c345 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.915772:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c345 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.915779:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c345 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.915842:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305c34c lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.915850:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305c34c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.915859:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305c34c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997308.915868:0:65272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x18:0x0]: returning size 0 00010000:00010000:3.0:1780997308.915969:0:65272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c33e lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.915977:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c33e lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.915990:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c33e lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.915996:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c33e lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.916002:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03400 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.916006:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c33e lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.916014:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c33e lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.916025:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898712da00) 00010000:00010000:3.0:1780997308.916029:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.916033:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c33e lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.916039:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03400/0x30fd811c0305c33e lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.916052:0:65272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c345 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.916058:0:65272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c345 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.916064:0:65272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c345 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.916069:0:65272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c1c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.916079:0:65272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c345 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.916086:0:65272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c345 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.916094:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x3c635ca3 (ffff96898712db00) 00010000:00010000:3.0:1780997308.916096:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.916099:0:65272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c345 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.916105:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c1c00/0x30fd811c0305c345 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.918595:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff02200/0x30fd811c0305c337 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae917a expref: 124 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.918625:0:65272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305c34c lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae917a expref: 123 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.918634:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x18:0x0].0x0 (ffff96898712d900) 00010000:00010000:3.0:1780997308.918637:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780997308.918640:0:65272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0800, rc 0) 00000100:00100000:3.0:1780997308.918728:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+123:72972:x1867507110472576:12345-192.168.206.51@tcp:101:dd.0 Request processed in 3165us (3786us total) trans 81604378890 rc 0/0 00000100:00100000:3.0:1780997308.918738:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1584 00000100:00100000:0.0:1780997308.923725:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.923813:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.923868:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.923924:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110473088 00000100:00100000:3.0:1780997308.923934:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110473088 00000100:00100000:3.0:1780997308.923998:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 277 00000100:00100000:3.0:1780997308.924009:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+123:72968:x1867507110473088:12345-192.168.206.51@tcp:35:dd.0 00000001:00080000:3.0:1780997308.924719:0:63420:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378891 00000100:00100000:3.0:1780997308.924838:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+125:72968:x1867507110473088:12345-192.168.206.51@tcp:35:dd.0 Request processed in 830us (1024us total) trans 81604378892 rc 0/0 00000100:00100000:3.0:1780997308.924847:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 277 00000020:00080000:3.0:1780997308.924852:0:63420:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1780997308.930174:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.933236:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110472832 00000100:00100000:1.0:1780997308.933251:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110472832 00000100:00100000:3.0:1780997308.933722:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110473216 00000100:00100000:3.0:1780997308.933729:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110473216 00000100:00100000:3.0:1780997308.933798:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1585 00000100:00100000:3.0:1780997308.933808:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+126:72972:x1867507110473216:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.933838:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.933864:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c35a lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9181 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.933987:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305c361 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.934007:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305c361 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.934019:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305c361 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.934136:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0e00/0x30fd811c0305c35a lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9181 expref: 128 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.934155:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0000/0x30fd811c0305c361 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9181 expref: 127 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.934163:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x18:0x0].0x0 (ffff96898712d900) 00010000:00010000:3.0:1780997308.934175:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780997308.934179:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bc4c0000, rc 0) 00000100:00100000:3.0:1780997308.934262:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+127:72972:x1867507110473216:12345-192.168.206.51@tcp:101:dd.0 Request processed in 455us (10402us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997308.934293:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1585 00000100:00100000:3.0:1780997308.934313:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110473472 00000100:00100000:3.0:1780997308.934318:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110473472 00000100:00100000:3.0:1780997308.934347:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1586 00000100:00100000:3.0:1780997308.934355:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+127:72973:x1867507110473472:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.934364:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.934378:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305c368 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9188 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.934563:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c36f lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.934573:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c36f lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.934582:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c36f lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.934594:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffda00/0x30fd811c0305c376 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.934601:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffda00/0x30fd811c0305c376 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.934608:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffda00/0x30fd811c0305c376 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935155:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305c37d lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935165:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305c37d lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935173:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305c37d lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780997308.935182:0:63418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x19:0x0]: returning size 0 00010000:00010000:3.0:1780997308.935265:0:63418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c36f lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935292:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c36f lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935299:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c36f lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935306:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c36f lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935312:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffdc00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.935316:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c36f lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935323:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c36f lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935334:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96898712d800) 00010000:00010000:3.0:1780997308.935337:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.935348:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c36f lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935355:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffdc00/0x30fd811c0305c36f lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935367:0:63418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffda00/0x30fd811c0305c376 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935374:0:63418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffda00/0x30fd811c0305c376 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935379:0:63418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffda00/0x30fd811c0305c376 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935385:0:63418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffda00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:3.0:1780997308.935388:0:63418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffda00/0x30fd811c0305c376 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935394:0:63418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffda00/0x30fd811c0305c376 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935402:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x961c5ca3 (ffff96898712d200) 00010000:00010000:3.0:1780997308.935404:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780997308.935407:0:63418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffda00/0x30fd811c0305c376 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935413:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffda00/0x30fd811c0305c376 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935531:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffc000/0x30fd811c0305c368 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9188 expref: 130 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935611:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305c37d lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9188 expref: 129 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.935621:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x19:0x0].0x0 (ffff9689896fed00) 00010000:00010000:3.0:1780997308.935624:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780997308.935626:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968889ffd400, rc 0) 00000100:00100000:3.0:1780997308.935682:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+129:72973:x1867507110473472:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1327us (5518us total) trans 81604378893 rc 0/0 00000100:00100000:3.0:1780997308.935728:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1586 00000100:00100000:0.0:1780997308.936057:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.936106:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110473728 00000100:00100000:3.0:1780997308.936114:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110473728 00000100:00100000:3.0:1780997308.936151:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1587 00000100:00100000:3.0:1780997308.936159:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+129:72970:x1867507110473728:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:3.0:1780997308.936213:0:65272:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997308.936231:0:65272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3c00/0x30fd811c0305c306 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9165 expref: 129 pid: 63417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.936244:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x16:0x0].0x0 (ffff96898712de00) 00010000:00010000:3.0:1780997308.936248:0:65272:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780997308.936413:0:65272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6da000/0x30fd811c0305c38b lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.936425:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6da000/0x30fd811c0305c38b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.936514:0:65272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6da000/0x30fd811c0305c38b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1780997308.936572:0:65272:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378894 00000004:00010000:3.0:1780997308.936597:0:65272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000abc67818 reply state 0000000073f6f36f transno 81604378895 ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6da000/0x30fd811c0305c38b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.936610:0:65272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6da000/0x30fd811c0305c38b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.936616:0:65272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x16:0x0].0x0 (ffff96898712de00) 00010000:00010000:3.0:1780997308.936618:0:65272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997308.936621:0:65272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780997308.939862:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1588 00000100:00100000:1.0:1780997308.939882:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+131:72969:x1867507110472832:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:1.0:1780997308.940066:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780997308.940097:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f400/0x30fd811c0305c2d5 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9150 expref: 131 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.940116:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x15:0x0].0x0 (ffff9689882bd000) 00010000:00010000:1.0:1780997308.940121:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780997308.940329:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c392 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.940343:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c392 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.940354:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c392 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780997308.940399:0:63584:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378896 00000004:00010000:1.0:1780997308.940424:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026447dc2 reply state 0000000071d02b65 transno 81604378897 ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c392 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.940450:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c392 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.940457:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x15:0x0].0x0 (ffff9689882bd000) 00010000:00010000:1.0:1780997308.940459:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780997308.940462:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780997308.943923:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+133:72969:x1867507110472832:12345-192.168.206.51@tcp:36:dd.0 Request processed in 4035us (20195us total) trans 81604378897 rc 0/0 00000100:00100000:1.0:1780997308.944095:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1588 00000020:00080000:1.0:1780997308.944103:0:63584:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1780997308.947649:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+132:72970:x1867507110473728:12345-192.168.206.51@tcp:36:dd.0 Request processed in 11478us (11581us total) trans 81604378895 rc 0/0 00000100:00100000:3.0:1780997308.947663:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1587 00000020:00080000:3.0:1780997308.948112:0:65272:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1780997308.950994:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.951097:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.954370:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997308.954689:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110473856 00000100:00100000:0.0:1780997308.954701:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110473856 00000100:00100000:1.0:1780997308.954737:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110474112 00000100:00100000:1.0:1780997308.954744:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110474112 00000100:00100000:1.0:1780997308.954858:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1589 00000100:00100000:1.0:1780997308.954869:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+133:72971:x1867507110474112:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1780997308.954893:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997308.954924:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42400/0x30fd811c0305c399 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae9196 expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955100:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43200/0x30fd811c0305c3a0 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955116:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43200/0x30fd811c0305c3a0 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955127:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43200/0x30fd811c0305c3a0 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955140:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42a00/0x30fd811c0305c3a7 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955169:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42a00/0x30fd811c0305c3a7 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955175:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42a00/0x30fd811c0305c3a7 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955253:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43600/0x30fd811c0305c3ae lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955262:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43600/0x30fd811c0305c3ae lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955299:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43600/0x30fd811c0305c3ae lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997308.955310:0:63584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x17:0x0]: returning size 0 00010000:00010000:1.0:1780997308.955396:0:63584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43200/0x30fd811c0305c3a0 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955404:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43200/0x30fd811c0305c3a0 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955411:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43200/0x30fd811c0305c3a0 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955419:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43200/0x30fd811c0305c3a0 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955425:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a5a43200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997308.955430:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43200/0x30fd811c0305c3a0 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955448:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43200/0x30fd811c0305c3a0 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955461:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96899634fc00) 00010000:00010000:1.0:1780997308.955562:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997308.955568:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43200/0x30fd811c0305c3a0 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955575:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43200/0x30fd811c0305c3a0 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955591:0:63584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42a00/0x30fd811c0305c3a7 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955675:0:63584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42a00/0x30fd811c0305c3a7 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955681:0:63584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42a00/0x30fd811c0305c3a7 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955686:0:63584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a5a42a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997308.955689:0:63584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42a00/0x30fd811c0305c3a7 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955695:0:63584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42a00/0x30fd811c0305c3a7 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955703:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xe2aa5ca3 (ffff96899634f800) 00010000:00010000:1.0:1780997308.955706:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997308.955709:0:63584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42a00/0x30fd811c0305c3a7 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955725:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42a00/0x30fd811c0305c3a7 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955777:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42400/0x30fd811c0305c399 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9196 expref: 136 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955795:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43600/0x30fd811c0305c3ae lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9196 expref: 135 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.955803:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x17:0x0].0x0 (ffff9689896fee00) 00010000:00010000:1.0:1780997308.955805:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997308.955808:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a5a43600, rc 0) 00000100:00100000:1.0:1780997308.955893:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+135:72971:x1867507110474112:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1026us (4794us total) trans 81604378898 rc 0/0 00000100:00100000:1.0:1780997308.955900:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1589 00000100:00100000:2.0:1780997308.957541:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.957571:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110474496 00000100:00100000:2.0:1780997308.957579:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110474496 00000100:00100000:2.0:1780997308.957632:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6017 00000100:00100000:2.0:1780997308.957643:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+33:72970:x1867507110474496:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997308.957663:0:25171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997308.957684:0:25171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305c3bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x631:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae919d expref: -99 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997308.957731:0:25171:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x631:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:2.0:1780997308.957759:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997308.957761:0:25171:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780997308.957768:0:25171:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305c3bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae919d expref: 34 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.957797:0:25171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305c3bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae919d expref: 34 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.957810:0:25171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96888956e600, rc 0) 00010000:00000080:2.0:1780997308.957817:0:25171:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b1160e00 x1867507110474496/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997308.957877:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+34:72970:x1867507110474496:12345-192.168.206.51@tcp:101:dd.0 Request processed in 236us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997308.957884:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6017 00000100:00100000:2.0:1780997308.957936:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.958445:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110474368 00000100:00100000:1.0:1780997308.958451:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110474368 00000100:00100000:1.0:1780997308.958480:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1590 00000100:00100000:1.0:1780997308.958486:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+135:72973:x1867507110473856:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1780997308.958498:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997308.958513:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43a00/0x30fd811c0305c3c3 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae918f expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.958539:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42c00/0x30fd811c0305c3ca lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.958552:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42c00/0x30fd811c0305c3ca lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.958570:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42c00/0x30fd811c0305c3ca lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997308.959441:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1591 00000100:00100000:2.0:1780997308.959454:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+136:72972:x1867507110474368:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:2.0:1780997308.959489:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997308.959510:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0800/0x30fd811c0305c34c lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae917a expref: 136 pid: 65272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.959527:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x18:0x0].0x0 (ffff96898712d900) 00010000:00010000:2.0:1780997308.959533:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997308.959712:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110474624 00010000:00010000:2.0:1780997308.959717:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c3d1 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780997308.959720:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110474624 00010000:00010000:2.0:1780997308.959732:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c3d1 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.959743:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c3d1 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.959892:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43a00/0x30fd811c0305c3c3 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae918f expref: 137 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.959912:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42c00/0x30fd811c0305c3ca lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae918f expref: 136 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.959920:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x19:0x0].0x0 (ffff9689896fed00) 00010000:00010000:1.0:1780997308.959923:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780997308.959926:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a5a42c00, rc 0) 00000100:00100000:3.0:1780997308.960094:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6018 00000100:00100000:3.0:1780997308.960106:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd01b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+34:72969:x1867507110474624:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.960116:0:25179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.960136:0:25179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c0305c3d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x630:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae91a4 expref: -99 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780997308.960158:0:25179:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x630:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:3.0:1780997308.960173:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997308.960175:0:25179:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997308.960183:0:25179:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c0305c3d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91a4 expref: 35 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.960210:0:25179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c0305c3d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91a4 expref: 35 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.960220:0:25179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96898d6da600, rc 0) 00010000:00000080:3.0:1780997308.960226:0:25179:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bd01b450 x1867507110474624/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997308.960324:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd01b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+35:72969:x1867507110474624:12345-192.168.206.51@tcp:101:dd.0 Request processed in 222us (2387us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997308.960332:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6018 00000100:00100000:1.0:1780997308.960583:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+136:72973:x1867507110473856:12345-192.168.206.51@tcp:101:dd.0 Request processed in 2096us (9600us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997308.960590:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1590 00000001:00080000:2.0:1780997308.960697:0:63418:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378899 00000004:00010000:2.0:1780997308.960733:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f1b92d9 reply state 00000000e591026c transno 81604378900 ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c3d1 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.960747:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c3d1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.960755:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x18:0x0].0x0 (ffff96898712d900) 00010000:00010000:2.0:1780997308.960757:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997308.960760:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997308.960918:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+137:72972:x1867507110474368:12345-192.168.206.51@tcp:36:dd.0 Request processed in 1467us (6561us total) trans 81604378900 rc 0/0 00000100:00100000:2.0:1780997308.960925:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1591 00000020:00080000:2.0:1780997308.960929:0:63418:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1780997308.962730:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.962784:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.962808:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.963265:0:24142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110474880 00000100:00100000:3.0:1780997308.963305:0:24142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110474880 00002000:00010000:3.0:1780997308.963347:0:24142:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1585 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.963352:0:24142:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b1161500 with x1867507110474880 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.963363:0:24142:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b1161500. 00000100:00100000:3.0:1780997308.963393:0:24142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1022 00000100:00100000:3.0:1780997308.963403:0:24142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+35:2395:x1867507110474880:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:3.0:1780997308.963565:0:24142:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x631:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780997308.963569:0:24142:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x631:0x0] updating lvb mtime from disk: 1780997299 -> 1780997309 00002000:00010000:3.0:1780997308.963572:0:24142:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x631:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:3.0:1780997308.963575:0:24142:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x631:0x0] updating lvb ctime from disk: 1780997299 -> 1780997309 00002000:00010000:3.0:1780997308.963577:0:24142:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x631:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780997308.963587:0:24142:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b1161500 x1867507110474880/t4294969492(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997308.963897:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997308.964033:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110474752 00000100:00100000:2.0:1780997308.964040:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110474752 00000100:00100000:2.0:1780997308.964081:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110475136 00000100:00100000:2.0:1780997308.964084:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110475136 00000100:00100000:2.0:1780997308.964097:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110475392 00000100:00100000:2.0:1780997308.964099:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110475392 00000100:00100000:2.0:1780997308.964140:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1592 00000100:00100000:2.0:1780997308.964147:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+139:72971:x1867507110474752:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1780997308.964167:0:63584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780997308.964186:0:63584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305c3df lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae91ab expref: -99 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.964219:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c3e6 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.964231:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c3e6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.964243:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c3e6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997308.964360:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1593 00010000:00010000:2.0:1780997308.964367:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee800/0x30fd811c0305c3df lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91ab expref: 141 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997308.964374:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+141:72974:x1867507110475136:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1780997308.964387:0:80049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997308.964403:0:80049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43e00/0x30fd811c0305c3ed lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae91b2 expref: -99 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.964525:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42e00/0x30fd811c0305c3f4 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.964534:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42e00/0x30fd811c0305c3f4 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.964554:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42e00/0x30fd811c0305c3f4 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.964566:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42200/0x30fd811c0305c3fb lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.964573:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42200/0x30fd811c0305c3fb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.964580:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42200/0x30fd811c0305c3fb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.964608:0:63584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4ee600/0x30fd811c0305c3e6 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91ab expref: 141 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.964617:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x17:0x0].0x0 (ffff9689896fee00) 00010000:00010000:2.0:1780997308.964620:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780997308.964623:0:63584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bb4ee600, rc 0) 00000100:00100000:2.0:1780997308.964690:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+141:72971:x1867507110474752:12345-192.168.206.51@tcp:101:dd.0 Request processed in 543us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997308.964697:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1592 00000100:00100000:2.0:1780997308.964716:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1594 00000100:00100000:2.0:1780997308.964722:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+140:72973:x1867507110475392:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:2.0:1780997308.964752:0:63584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997308.964768:0:63584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968889ffd400/0x30fd811c0305c37d lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9188 expref: 140 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.964794:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x19:0x0].0x0 (ffff9689896fed00) 00010000:00010000:2.0:1780997308.964797:0:63584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997308.964940:0:63584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305c402 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.964949:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305c402 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.964957:0:63584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305c402 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780997308.965003:0:63584:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378901 00000004:00010000:2.0:1780997308.965025:0:63584:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001110dcae reply state 00000000b87d4b45 transno 81604378902 ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305c402 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.965036:0:63584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305c402 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997308.965043:0:63584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x19:0x0].0x0 (ffff9689896fed00) 00010000:00010000:2.0:1780997308.965045:0:63584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997308.965048:0:63584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997308.965102:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+142:72973:x1867507110475392:12345-192.168.206.51@tcp:36:dd.0 Request processed in 379us (1205us total) trans 81604378902 rc 0/0 00010000:00010000:1.0:1780997308.965109:0:80049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42600/0x30fd811c0305c409 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965120:0:80049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42600/0x30fd811c0305c409 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997308.965122:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1594 00000020:00080000:2.0:1780997308.965130:0:63584:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1780997308.965133:0:80049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42600/0x30fd811c0305c409 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780997308.965144:0:80049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x1a:0x0]: returning size 0 00010000:00010000:1.0:1780997308.965199:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42e00/0x30fd811c0305c3f4 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965206:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42e00/0x30fd811c0305c3f4 lrc: 2/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965214:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42e00/0x30fd811c0305c3f4 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965219:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a5a42e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997308.965230:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42e00/0x30fd811c0305c3f4 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965238:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42e00/0x30fd811c0305c3f4 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965248:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff96899634fb00) 00010000:00010000:1.0:1780997308.965252:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997308.965256:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42e00/0x30fd811c0305c3f4 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965262:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42e00/0x30fd811c0305c3f4 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965299:0:80049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42200/0x30fd811c0305c3fb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965306:0:80049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42200/0x30fd811c0305c3fb lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965312:0:80049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42200/0x30fd811c0305c3fb lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965317:0:80049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a5a42200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997308.965320:0:80049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42200/0x30fd811c0305c3fb lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965325:0:80049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42200/0x30fd811c0305c3fb lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965333:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xb6f515a3 (ffff96899634f500) 00010000:00010000:1.0:1780997308.965335:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997308.965352:0:80049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42200/0x30fd811c0305c3fb lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965358:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42200/0x30fd811c0305c3fb lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965394:0:80049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43e00/0x30fd811c0305c3ed lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91b2 expref: 143 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965411:0:80049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42600/0x30fd811c0305c409 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91b2 expref: 142 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997308.965418:0:80049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1a:0x0].0x0 (ffff96898712d500) 00010000:00010000:1.0:1780997308.965421:0:80049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780997308.965423:0:80049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a5a42600, rc 0) 00000100:00100000:1.0:1780997308.965455:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+142:72974:x1867507110475136:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1087us (2645us total) trans 81604378903 rc 0/0 00000100:00100000:1.0:1780997308.965463:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1593 00000100:00100000:3.0:1780997308.965755:0:24142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+36:2395:x1867507110474880:12345-192.168.206.51@tcp:10:dd.0 Request processed in 2353us (3034us total) trans 4294969492 rc 0/0 00000100:00100000:3.0:1780997308.965764:0:24142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1022 00002000:00010000:3.0:1780997308.965769:0:24142:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1585 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.965772:0:24142:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b1161500 with x1867507110474880 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.965782:0:24142:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b1161500. 00000100:00100000:2.0:1780997308.966059:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.968866:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.969025:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.969489:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110475648 00000100:00100000:3.0:1780997308.969501:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110475648 00000100:00100000:0.0:1780997308.969555:0:23854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110475520 00000100:00100000:3.0:1780997308.969558:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110475776 00000100:00100000:0.0:1780997308.969562:0:23854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110475520 00000100:00100000:3.0:1780997308.969564:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110475776 00000100:00100000:3.0:1780997308.969598:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6019 00002000:00010000:0.0:1780997308.969604:0:23854:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1584 (0->18446744073709551615) 00002000:00100000:0.0:1780997308.969612:0:23854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b1161880 with x1867507110475520 ext(0->18446744073709551615) 00000100:00100000:3.0:1780997308.969613:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+38:72972:x1867507110475648:12345-192.168.206.51@tcp:101:dd.0 00002000:00010000:0.0:1780997308.969629:0:23854:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b1161880. 00010000:00010000:3.0:1780997308.969633:0:25173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.969653:0:25173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c0305c417 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x633:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae91b9 expref: -99 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997308.969653:0:23854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1023 00000100:00100000:0.0:1780997308.969666:0:23854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+38:2394:x1867507110475520:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:3.0:1780997308.969683:0:25173:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x633:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:3.0:1780997308.969706:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997308.969708:0:25173:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780997308.969717:0:25173:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c0305c417 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91b9 expref: 39 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.969734:0:25173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c0305c417 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91b9 expref: 39 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997308.969852:0:23854:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x630:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1780997308.969855:0:23854:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x630:0x0] updating lvb mtime from disk: 1780997299 -> 1780997309 00002000:00010000:0.0:1780997308.969858:0:23854:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x630:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:0.0:1780997308.969860:0:23854:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x630:0x0] updating lvb ctime from disk: 1780997299 -> 1780997309 00002000:00010000:0.0:1780997308.969862:0:23854:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x630:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1780997308.969871:0:23854:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b1161880 x1867507110475520/t4294969493(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997308.969961:0:23854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+40:2394:x1867507110475520:12345-192.168.206.51@tcp:10:dd.0 Request processed in 298us (3902us total) trans 4294969493 rc 0/0 00000100:00100000:0.0:1780997308.969969:0:23854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1023 00002000:00010000:0.0:1780997308.969973:0:23854:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1584 (0->18446744073709551615) 00002000:00100000:0.0:1780997308.969976:0:23854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b1161880 with x1867507110475520 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997308.969981:0:23854:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b1161880. 00000100:00100000:0.0:1780997308.970010:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6020 00000100:00100000:0.0:1780997308.970018:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+39:72973:x1867507110475776:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997308.970028:0:25175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997308.970038:0:25175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305c41e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x634:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae91c0 expref: -99 pid: 25175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997308.970051:0:25175:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x634:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:0.0:1780997308.970061:0:25175:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.970063:0:25175:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997308.970067:0:25175:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305c41e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91c0 expref: 40 pid: 25175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.970080:0:25175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305c41e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91c0 expref: 40 pid: 25175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997308.970091:0:25175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2400, rc 0) 00010000:00000080:0.0:1780997308.970097:0:25175:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb5f80 x1867507110475776/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997308.970132:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+40:72973:x1867507110475776:12345-192.168.206.51@tcp:101:dd.0 Request processed in 116us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997308.970138:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6020 00010000:00010000:3.0:1780997308.970734:0:25173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96898d6db200, rc 0) 00010000:00000080:3.0:1780997308.970867:0:25173:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb5880 x1867507110475648/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997308.970902:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+39:72972:x1867507110475648:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1295us (2973us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997308.970909:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6019 00000100:00100000:1.0:1780997308.973403:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997308.973449:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.973549:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110476416 00000100:00100000:3.0:1780997308.973560:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110476416 00000100:00100000:3.0:1780997308.973619:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1595 00000100:00100000:0.0:1780997308.973628:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110476160 00000100:00100000:3.0:1780997308.973630:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+142:72971:x1867507110476416:12345-192.168.206.51@tcp:36:dd.0 00000100:00100000:0.0:1780997308.973635:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110476160 00000100:00100000:0.0:1780997308.973671:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 278 00000100:00100000:0.0:1780997308.973680:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+143:72970:x1867507110476160:12345-192.168.206.51@tcp:35:dd.0 00010000:00010000:3.0:1780997308.973694:0:63418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997308.973727:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a43600/0x30fd811c0305c3ae lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9196 expref: 143 pid: 63584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.973876:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x17:0x0].0x0 (ffff9689896fee00) 00010000:00010000:3.0:1780997308.973883:0:63418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997308.973948:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+143:72970:x1867507110476160:12345-192.168.206.51@tcp:35:dd.0 Request processed in 268us (565us total) trans 81604378904 rc 0/0 00000100:00100000:0.0:1780997308.973956:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 278 00000100:00100000:0.0:1780997308.974374:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1780997308.974439:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dbe00/0x30fd811c0305c425 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.974455:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dbe00/0x30fd811c0305c425 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.974465:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dbe00/0x30fd811c0305c425 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1780997308.974508:0:63418:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378905 00000004:00010000:3.0:1780997308.974530:0:63418:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5bbac4e reply state 00000000a9df9bd1 transno 81604378906 ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dbe00/0x30fd811c0305c425 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.974543:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dbe00/0x30fd811c0305c425 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.974614:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x17:0x0].0x0 (ffff9689896fee00) 00010000:00010000:3.0:1780997308.974617:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780997308.974620:0:63418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780997308.974688:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+145:72971:x1867507110476416:12345-192.168.206.51@tcp:36:dd.0 Request processed in 1060us (1238us total) trans 81604378906 rc 0/0 00000100:00100000:3.0:1780997308.974694:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1595 00000020:00080000:3.0:1780997308.974699:0:63418:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1780997308.974715:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110475904 00000100:00100000:3.0:1780997308.974719:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110475904 00000100:00100000:3.0:1780997308.978063:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1596 00000100:00100000:3.0:1780997308.978089:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+145:72974:x1867507110475904:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1780997308.978114:0:63418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780997308.978137:0:63418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6daa00/0x30fd811c0305c42c lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae91c7 expref: -99 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.978175:0:63418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dba00/0x30fd811c0305c433 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.978187:0:63418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dba00/0x30fd811c0305c433 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.978199:0:63418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dba00/0x30fd811c0305c433 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.978375:0:63418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6daa00/0x30fd811c0305c42c lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91c7 expref: 147 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.978394:0:63418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dba00/0x30fd811c0305c433 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91c7 expref: 146 pid: 63418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997308.978410:0:63418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1a:0x0].0x0 (ffff96898712d500) 00010000:00010000:3.0:1780997308.978413:0:63418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780997308.978416:0:63418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96898d6dba00, rc 0) 00000100:00100000:3.0:1780997308.978565:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+146:72974:x1867507110475904:12345-192.168.206.51@tcp:101:dd.0 Request processed in 487us (4191us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997308.978573:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1596 00000100:00100000:3.0:1780997308.995663:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.995749:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.995803:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.995840:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.995882:0:8236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110476544 00000100:00100000:3.0:1780997308.995892:0:8236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110476544 00002000:00010000:3.0:1780997308.995937:0:8236:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1588 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.995943:0:8236:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689aebbad80 with x1867507110476544 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.996576:0:8236:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689aebbad80. 00000100:00100000:3.0:1780997308.996609:0:8236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110477056 00000100:00100000:3.0:1780997308.996614:0:8236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110477056 00002000:00010000:3.0:1780997308.996633:0:8236:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1587 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.996636:0:8236:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689aebb8a80 with x1867507110477056 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.996642:0:8236:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689aebb8a80. 00000100:00100000:3.0:1780997308.996664:0:8236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1024 00000100:00100000:3.0:1780997308.996675:0:8236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+40:2395:x1867507110476544:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:3.0:1780997308.996847:0:8236:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x634:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780997308.996850:0:8236:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x634:0x0] updating lvb mtime from disk: 1780997299 -> 1780997309 00002000:00010000:3.0:1780997308.996853:0:8236:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x634:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:3.0:1780997308.996872:0:8236:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x634:0x0] updating lvb ctime from disk: 1780997299 -> 1780997309 00002000:00010000:3.0:1780997308.996874:0:8236:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x634:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780997308.996885:0:8236:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689aebbad80 x1867507110476544/t4294969494(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997308.996946:0:8236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+41:2395:x1867507110476544:12345-192.168.206.51@tcp:10:dd.0 Request processed in 272us (1296us total) trans 4294969494 rc 0/0 00000100:00100000:3.0:1780997308.999059:0:8236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1024 00002000:00010000:3.0:1780997308.999072:0:8236:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1588 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.999077:0:8236:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689aebbad80 with x1867507110476544 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.999090:0:8236:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689aebbad80. 00000100:00100000:3.0:1780997308.999131:0:8236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1025 00000100:00100000:3.0:1780997308.999146:0:8236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+40:2397:x1867507110477056:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:3.0:1780997308.999341:0:8236:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x633:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780997308.999344:0:8236:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x633:0x0] updating lvb mtime from disk: 1780997299 -> 1780997309 00002000:00010000:3.0:1780997308.999347:0:8236:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x633:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:3.0:1780997308.999349:0:8236:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x633:0x0] updating lvb ctime from disk: 1780997299 -> 1780997309 00002000:00010000:3.0:1780997308.999351:0:8236:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x633:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780997308.999362:0:8236:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689aebb8a80 x1867507110477056/t4294969495(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 440/432 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997308.999430:0:8236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+41:2397:x1867507110477056:12345-192.168.206.51@tcp:10:dd.0 Request processed in 290us (3588us total) trans 4294969495 rc 0/0 00000100:00100000:3.0:1780997308.999437:0:8236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1025 00002000:00010000:3.0:1780997308.999440:0:8236:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1587 (0->18446744073709551615) 00002000:00100000:3.0:1780997308.999442:0:8236:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689aebb8a80 with x1867507110477056 ext(0->18446744073709551615) 00002000:00010000:3.0:1780997308.999447:0:8236:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689aebb8a80. 00000100:00100000:3.0:1780997308.999538:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997308.999579:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110477312 00000100:00100000:3.0:1780997308.999588:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110477312 00000100:00100000:3.0:1780997308.999622:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 279 00000100:00100000:3.0:1780997308.999630:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+146:72969:x1867507110477312:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:3.0:1780997308.999921:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+147:72969:x1867507110477312:12345-192.168.206.51@tcp:35:dd.0 Request processed in 291us (382us total) trans 81604378907 rc 0/0 00000100:00100000:3.0:1780997308.999928:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 279 00000100:00100000:2.0:1780997309.000377:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110476800 00000100:00100000:2.0:1780997309.000401:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110476800 00000100:00100000:2.0:1780997309.000449:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1597 00000100:00100000:2.0:1780997309.000459:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+147:72974:x1867507110476800:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:2.0:1780997309.000496:0:63417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997309.000530:0:63417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a5a42600/0x30fd811c0305c409 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91b2 expref: 147 pid: 80049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997309.000555:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1a:0x0].0x0 (ffff96898712d500) 00010000:00010000:2.0:1780997309.000562:0:63417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780997309.000674:0:63417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305c43a lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997309.000689:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305c43a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997309.000700:0:63417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305c43a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780997309.000746:0:63417:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378908 00000004:00010000:2.0:1780997309.000783:0:63417:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e1af251 reply state 00000000023448a7 transno 81604378909 ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305c43a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997309.000797:0:63417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305c43a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997309.000804:0:63417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1a:0x0].0x0 (ffff96898712d500) 00010000:00010000:2.0:1780997309.000807:0:63417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780997309.000809:0:63417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780997309.000893:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+149:72974:x1867507110476800:12345-192.168.206.51@tcp:36:dd.0 Request processed in 435us (5142us total) trans 81604378909 rc 0/0 00000100:00100000:2.0:1780997309.000912:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1597 00000020:00080000:2.0:1780997309.000917:0:63417:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1780997309.004708:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110476928 00000100:00100000:0.0:1780997309.004725:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110476928 00000100:00100000:0.0:1780997309.004799:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6021 00000100:00100000:0.0:1780997309.004809:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+41:72971:x1867507110476928:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1780997309.004838:0:25182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780997309.004859:0:25182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305c441 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x632:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae91ce expref: -99 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780997309.004886:0:25182:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x632:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:0.0:1780997309.004914:0:25182:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997309.004917:0:25182:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780997309.004926:0:25182:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305c441 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91ce expref: 42 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997309.004966:0:25182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305c441 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91ce expref: 42 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997309.004980:0:25182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff968983ce2a00, rc 0) 00010000:00000080:0.0:1780997309.004988:0:25182:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689aebba680 x1867507110476928/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:639/0 lens 328/400 e 0 to 0 dl 1780997319 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997309.005060:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+42:72971:x1867507110476928:12345-192.168.206.51@tcp:101:dd.0 Request processed in 253us (9256us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997309.005069:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6021 00000100:00100000:3.0:1780997309.008097:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.008198:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997309.008309:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110477696 00000100:00100000:1.0:1780997309.008320:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110477696 00000100:00100000:1.0:1780997309.008378:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 280 00000100:00100000:1.0:1780997309.008389:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+149:72973:x1867507110477696:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:1.0:1780997309.008692:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+150:72973:x1867507110477696:12345-192.168.206.51@tcp:35:dd.0 Request processed in 305us (494us total) trans 81604378910 rc 0/0 00000100:00100000:1.0:1780997309.008721:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 280 00000100:00100000:3.0:1780997309.009556:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997309.009797:0:63420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110477952 00000100:00100000:1.0:1780997309.009804:0:63420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110477952 00000100:00100000:1.0:1780997309.009854:0:63420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 281 00000100:00100000:1.0:1780997309.009864:0:63420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968889fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+150:72972:x1867507110477952:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:1.0:1780997309.010067:0:63420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968889fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+151:72972:x1867507110477952:12345-192.168.206.51@tcp:35:dd.0 Request processed in 204us (514us total) trans 81604378911 rc 0/0 00000100:00100000:1.0:1780997309.010075:0:63420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 281 00000100:00100000:0.0:1780997309.011100:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110477440 00000100:00100000:0.0:1780997309.011109:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110477440 00000100:00100000:1.0:1780997309.011265:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6022 00000100:00100000:1.0:1780997309.011296:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+42:72974:x1867507110477440:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1780997309.011310:0:25177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780997309.011399:0:25177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000111c6c12/0x30fd811c0305c448 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x635:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae91d5 expref: -99 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780997309.011553:0:25177:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x635:0x0] initial LVB size: 0, mtime: 0x6a27dcb3, atime: 0x6a27dcb3, ctime: 0x6a27dcb3, blocks: 0x0 00010000:00010000:1.0:1780997309.011573:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997309.011576:0:25177:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780997309.011584:0:25177:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000111c6c12/0x30fd811c0305c448 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91d5 expref: 43 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997309.011601:0:25177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000111c6c12/0x30fd811c0305c448 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91d5 expref: 43 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997309.011682:0:25177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a5a43e00, rc 0) 00010000:00000080:1.0:1780997309.011693:0:25177:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689ba185500 x1867507110477440/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 328/400 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.011770:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+43:72974:x1867507110477440:12345-192.168.206.51@tcp:101:dd.0 Request processed in 476us (3681us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997309.011777:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6022 00000100:00100000:2.0:1780997309.011843:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997309.012042:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110478080 00000100:00100000:0.0:1780997309.012048:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110478080 00002000:00010000:0.0:1780997309.012074:0:24155:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1586 (0->18446744073709551615) 00002000:00100000:0.0:1780997309.012079:0:24155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b1161f80 with x1867507110478080 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997309.012087:0:24155:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b1161f80. 00000100:00100000:0.0:1780997309.012114:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1026 00000100:00100000:0.0:1780997309.012123:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+43:2395:x1867507110478080:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:0.0:1780997309.012259:0:24155:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x632:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1780997309.012263:0:24155:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x632:0x0] updating lvb mtime from disk: 1780997299 -> 1780997309 00002000:00010000:0.0:1780997309.012266:0:24155:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x632:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:0.0:1780997309.012295:0:24155:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x632:0x0] updating lvb ctime from disk: 1780997299 -> 1780997309 00002000:00010000:0.0:1780997309.012298:0:24155:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x632:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1780997309.012307:0:24155:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b1161f80 x1867507110478080/t4294969496(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997309.013592:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+44:2395:x1867507110478080:12345-192.168.206.51@tcp:10:dd.0 Request processed in 1464us (1743us total) trans 4294969496 rc 0/0 00000100:00100000:0.0:1780997309.013603:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1026 00002000:00010000:0.0:1780997309.013608:0:24155:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1586 (0->18446744073709551615) 00002000:00100000:0.0:1780997309.013611:0:24155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b1161f80 with x1867507110478080 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997309.013749:0:24155:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b1161f80. 00000100:00100000:2.0:1780997309.021659:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997309.022064:0:24144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110478208 00000100:00100000:0.0:1780997309.022076:0:24144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110478208 00002000:00010000:0.0:1780997309.022126:0:24144:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1589 (0->18446744073709551615) 00002000:00100000:0.0:1780997309.022132:0:24144:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b1163480 with x1867507110478208 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997309.022144:0:24144:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b1163480. 00000100:00100000:0.0:1780997309.022180:0:24144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1027 00000100:00100000:0.0:1780997309.022193:0:24144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+44:2395:x1867507110478208:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:0.0:1780997309.022458:0:24144:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x635:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1780997309.022463:0:24144:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x635:0x0] updating lvb mtime from disk: 1780997299 -> 1780997309 00002000:00010000:0.0:1780997309.022468:0:24144:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x635:0x0] updating lvb atime from disk: 1780997299 -> 1780997299 00002000:00010000:0.0:1780997309.022470:0:24144:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x635:0x0] updating lvb ctime from disk: 1780997299 -> 1780997309 00002000:00010000:0.0:1780997309.022473:0:24144:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x635:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1780997309.022485:0:24144:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b1163480 x1867507110478208/t4294969497(0) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997309.022585:0:24144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+45:2395:x1867507110478208:12345-192.168.206.51@tcp:10:dd.0 Request processed in 394us (937us total) trans 4294969497 rc 0/0 00000100:00100000:0.0:1780997309.022595:0:24144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1027 00002000:00010000:0.0:1780997309.022599:0:24144:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1589 (0->18446744073709551615) 00002000:00100000:0.0:1780997309.022623:0:24144:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b1163480 with x1867507110478208 ext(0->18446744073709551615) 00002000:00010000:0.0:1780997309.022628:0:24144:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b1163480. 00000100:00100000:3.0:1780997309.026041:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997309.026131:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110478464 00000100:00100000:2.0:1780997309.026141:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110478464 00000100:00100000:2.0:1780997309.026206:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 282 00000100:00100000:2.0:1780997309.026216:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+151:72971:x1867507110478464:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:2.0:1780997309.026733:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+152:72971:x1867507110478464:12345-192.168.206.51@tcp:35:dd.0 Request processed in 516us (699us total) trans 81604378912 rc 0/0 00000100:00100000:2.0:1780997309.026743:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 282 00000100:00100000:3.0:1780997309.043354:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997309.043497:0:63421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110478720 00000100:00100000:2.0:1780997309.043508:0:63421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110478720 00000100:00100000:2.0:1780997309.043589:0:63421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 283 00000100:00100000:2.0:1780997309.043603:0:63421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+152:72974:x1867507110478720:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:2.0:1780997309.043966:0:63421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+153:72974:x1867507110478720:12345-192.168.206.51@tcp:35:dd.0 Request processed in 365us (623us total) trans 81604378913 rc 0/0 00000100:00100000:2.0:1780997309.043976:0:63421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 283 00010000:00010000:3.0:1780997309.157666:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997309.188840:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.188896:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.188941:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997309.189028:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110478848 00000100:00100000:0.0:1780997309.189041:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110478848 00000100:00100000:0.0:1780997309.189099:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 178 00000100:00100000:0.0:1780997309.189109:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2396:x1867507110478848:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997309.189191:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2396:x1867507110478848:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 82us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997309.189198:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 178 00000100:00100000:1.0:1780997309.189489:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110479104 00000100:00100000:1.0:1780997309.189494:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110479104 00000100:00100000:1.0:1780997309.189548:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2713 00000100:00100000:1.0:1780997309.189556:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110479104:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997309.189589:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110479104:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 34us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997309.189596:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2713 00000100:00100000:1.0:1780997309.189619:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110478976 00000100:00100000:1.0:1780997309.189622:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110478976 00000100:00100000:1.0:1780997309.189655:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1438 00000100:00100000:1.0:1780997309.189663:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2396:x1867507110478976:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997309.189694:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2396:x1867507110478976:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997309.189700:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1438 00000100:00080000:0.0:1780997309.189766:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997309.192528:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.192579:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.192616:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110479360 00000100:00100000:3.0:1780997309.192625:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110479360 00000100:00100000:3.0:1780997309.192685:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6023 00000100:00100000:3.0:1780997309.192695:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+45:2397:x1867507110479360:12345-192.168.206.51@tcp:16:kworker.0 00000001:00080000:3.0:1780997309.192996:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969497 is committed 00010000:00000080:3.0:1780997309.193069:0:25174:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adb8a680 x1867507110479360/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997309.193126:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2397:x1867507110479360:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 432us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997309.193140:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6023 00000100:00100000:1.0:1780997309.194498:0:24142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110479232 00000100:00100000:1.0:1780997309.194510:0:24142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110479232 00002000:00100000:1.0:1780997309.194551:0:24142:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x622:0x0] (0->1023) req@ffff968888df9c00 x1867507110479232/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997309.194561:0:24142:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff968888df9c00 with x1867507110479232 ext(0->1023) 00002000:00010000:1.0:1780997309.194566:0:24142:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff968888df9c00 00000100:00100000:1.0:1780997309.194598:0:24142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1028 00000100:00100000:1.0:1780997309.194607:0:24142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2397:x1867507110479232:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:1.0:1780997309.195027:0:24142:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff968888df9c00 x1867507110479232/t4294969498(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.195090:0:24142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2397:x1867507110479232:12345-192.168.206.51@tcp:4:dd.0 Request processed in 485us (2573us total) trans 4294969498 rc 0/0 00000100:00100000:1.0:1780997309.195098:0:24142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1028 00002000:00100000:1.0:1780997309.195104:0:24142:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x622:0x0] (0->1023) req@ffff968888df9c00 x1867507110479232/t4294969498(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997309.195124:0:24142:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff968888df9c00 with x1867507110479232 ext(0->1023) 00002000:00010000:1.0:1780997309.195127:0:24142:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff968888df9c00 00000100:00100000:3.0:1780997309.212485:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997309.212587:0:24143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110479488 00000100:00100000:0.0:1780997309.212609:0:24143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110479488 00002000:00100000:0.0:1780997309.212667:0:24143:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x623:0x0] (0->1023) req@ffff9689b7a4dc00 x1867507110479488/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997309.212679:0:24143:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b7a4dc00 with x1867507110479488 ext(0->1023) 00002000:00010000:0.0:1780997309.212686:0:24143:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b7a4dc00 00000100:00100000:0.0:1780997309.212726:0:24143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1029 00000100:00100000:0.0:1780997309.212736:0:24143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2394:x1867507110479488:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:0.0:1780997309.213181:0:24143:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b7a4dc00 x1867507110479488/t4294969499(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997309.213294:0:24143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2394:x1867507110479488:12345-192.168.206.51@tcp:4:dd.0 Request processed in 534us (799us total) trans 4294969499 rc 0/0 00000100:00100000:0.0:1780997309.213303:0:24143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1029 00002000:00100000:0.0:1780997309.213312:0:24143:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x623:0x0] (0->1023) req@ffff9689b7a4dc00 x1867507110479488/t4294969499(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997309.213334:0:24143:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b7a4dc00 with x1867507110479488 ext(0->1023) 00002000:00010000:0.0:1780997309.213338:0:24143:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b7a4dc00 00000100:00100000:0.0:1780997309.228242:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.228332:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110479616 00000100:00100000:3.0:1780997309.228343:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110479616 00000100:00100000:3.0:1780997309.228402:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6024 00000100:00100000:3.0:1780997309.228412:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2394:x1867507110479616:12345-192.168.206.51@tcp:16:kworker.0 00000001:00080000:1.0:1780997309.232699:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969499 is committed 00010000:00000080:1.0:1780997309.232944:0:8232:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1df80 x1867507110479616/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.233057:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2394:x1867507110479616:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 4646us (4828us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997309.233068:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6024 00000100:00100000:2.0:1780997309.243390:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.246806:0:8237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110479744 00000100:00100000:3.0:1780997309.246834:0:8237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110479744 00002000:00100000:3.0:1780997309.246908:0:8237:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x624:0x0] (0->1023) req@ffff9689b1161c00 x1867507110479744/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780997309.246921:0:8237:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b1161c00 with x1867507110479744 ext(0->1023) 00002000:00010000:3.0:1780997309.246927:0:8237:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b1161c00 00000100:00100000:3.0:1780997309.246967:0:8237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1030 00000100:00100000:3.0:1780997309.246979:0:8237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2396:x1867507110479744:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1780997309.247607:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997309.248178:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110479872 00000100:00100000:0.0:1780997309.248197:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110479872 00000100:00100000:0.0:1780997309.248312:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6025 00000100:00100000:1.0:1780997309.248419:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+26:2396:x1867507110479872:12345-192.168.206.51@tcp:16:kworker.0 00010000:00000080:1.0:1780997309.248464:0:25181:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb6680 x1867507110479872/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00010000:00000080:3.0:1780997309.248499:0:8237:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b1161c00 x1867507110479744/t4294969500(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997309.248531:0:8237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+28:2396:x1867507110479744:12345-192.168.206.51@tcp:4:dd.0 Request processed in 1554us (5151us total) trans 4294969500 rc 0/0 00000100:00100000:1.0:1780997309.248531:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+28:2396:x1867507110479872:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 210us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997309.248540:0:8237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1030 00000100:00100000:1.0:1780997309.248540:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6025 00002000:00100000:3.0:1780997309.248547:0:8237:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x624:0x0] (0->1023) req@ffff9689b1161c00 x1867507110479744/t4294969500(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780997309.248556:0:8237:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689b1161c00 with x1867507110479744 ext(0->1023) 00002000:00010000:3.0:1780997309.248560:0:8237:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689b1161c00 00000100:00100000:1.0:1780997309.254367:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997309.255469:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.255647:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110480128 00000100:00100000:3.0:1780997309.255658:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110480128 00000100:00100000:3.0:1780997309.255761:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6026 00000100:00100000:3.0:1780997309.255772:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2397:x1867507110480128:12345-192.168.206.51@tcp:16:kworker.0 00010000:00000080:3.0:1780997309.255845:0:25179:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b1163b80 x1867507110480128/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997309.255920:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2397:x1867507110480128:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 150us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997309.255927:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6026 00000100:00100000:1.0:1780997309.266871:0:8238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110480000 00000100:00100000:1.0:1780997309.266888:0:8238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110480000 00002000:00100000:1.0:1780997309.266945:0:8238:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x625:0x0] (0->1023) req@ffff9689adbb7800 x1867507110480000/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997309.266957:0:8238:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adbb7800 with x1867507110480000 ext(0->1023) 00002000:00010000:1.0:1780997309.266963:0:8238:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689adbb7800 00000100:00100000:1.0:1780997309.267014:0:8238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1031 00000100:00100000:1.0:1780997309.267023:0:8238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2396:x1867507110480000:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:1.0:1780997309.267477:0:8238:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb7800 x1867507110480000/t4294969501(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.267549:0:8238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2396:x1867507110480000:12345-192.168.206.51@tcp:4:dd.0 Request processed in 527us (13190us total) trans 4294969501 rc 0/0 00000100:00100000:1.0:1780997309.267557:0:8238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1031 00002000:00100000:1.0:1780997309.267563:0:8238:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x625:0x0] (0->1023) req@ffff9689adbb7800 x1867507110480000/t4294969501(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997309.267571:0:8238:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adbb7800 with x1867507110480000 ext(0->1023) 00002000:00010000:1.0:1780997309.267574:0:8238:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689adbb7800 00000100:00100000:0.0:1780997309.272083:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997309.272139:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.272305:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110480256 00000100:00100000:3.0:1780997309.272389:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110480256 00000100:00100000:1.0:1780997309.272395:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110480384 00000100:00100000:1.0:1780997309.272399:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110480384 00002000:00100000:3.0:1780997309.272447:0:24155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x626:0x0] (0->1023) req@ffff9689bfb1f480 x1867507110480256/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.272456:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6027 00002000:00100000:3.0:1780997309.272459:0:24155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb1f480 with x1867507110480256 ext(0->1023) 00002000:00010000:3.0:1780997309.272467:0:24155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb1f480 00000100:00100000:1.0:1780997309.272470:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+30:2395:x1867507110480384:12345-192.168.206.51@tcp:16:kworker.0 00000100:00100000:3.0:1780997309.272485:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1032 00000100:00100000:3.0:1780997309.272490:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+30:2397:x1867507110480256:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:1.0:1780997309.272531:0:25178:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1dc00 x1867507110480384/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.272728:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+30:2395:x1867507110480384:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 124us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997309.272862:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6027 00010000:00000080:3.0:1780997309.272923:0:24155:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1f480 x1867507110480256/t4294969502(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997309.272951:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+31:2397:x1867507110480256:12345-192.168.206.51@tcp:4:dd.0 Request processed in 461us (884us total) trans 4294969502 rc 0/0 00000100:00100000:3.0:1780997309.272959:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1032 00002000:00100000:3.0:1780997309.272964:0:24155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x626:0x0] (0->1023) req@ffff9689bfb1f480 x1867507110480256/t4294969502(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780997309.272984:0:24155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb1f480 with x1867507110480256 ext(0->1023) 00002000:00010000:3.0:1780997309.272988:0:24155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb1f480 00000100:00100000:0.0:1780997309.279128:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997309.279173:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997309.279247:0:23857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110480512 00000100:00100000:2.0:1780997309.279258:0:23857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110480512 00002000:00100000:2.0:1780997309.279336:0:23857:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x627:0x0] (0->1023) req@ffff9689bfb1fb80 x1867507110480512/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780997309.279347:0:23857:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb1fb80 with x1867507110480512 ext(0->1023) 00002000:00010000:2.0:1780997309.279360:0:23857:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb1fb80 00000100:00100000:2.0:1780997309.279395:0:23857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1033 00000100:00100000:2.0:1780997309.279405:0:23857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+31:2394:x1867507110480512:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:2.0:1780997309.280013:0:23857:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1fb80 x1867507110480512/t4294969503(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997309.280113:0:23857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+33:2394:x1867507110480512:12345-192.168.206.51@tcp:4:dd.0 Request processed in 709us (1004us total) trans 4294969503 rc 0/0 00000100:00100000:2.0:1780997309.280121:0:23857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1033 00002000:00100000:2.0:1780997309.280129:0:23857:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x627:0x0] (0->1023) req@ffff9689bfb1fb80 x1867507110480512/t4294969503(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780997309.280137:0:23857:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb1fb80 with x1867507110480512 ext(0->1023) 00002000:00010000:2.0:1780997309.280140:0:23857:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb1fb80 00000100:00100000:2.0:1780997309.280369:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110480640 00000100:00100000:2.0:1780997309.280376:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110480640 00000100:00100000:2.0:1780997309.280409:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6028 00000100:00100000:2.0:1780997309.280417:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+33:2394:x1867507110480640:12345-192.168.206.51@tcp:16:kworker.0 00000001:00080000:0.0:1780997309.282706:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969503 is committed 00010000:00000080:2.0:1780997309.283308:0:25173:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1ce00 x1867507110480640/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997309.283501:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2394:x1867507110480640:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 3084us (4325us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997309.283511:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6028 00000100:00100000:0.0:1780997309.301476:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997309.301659:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.301725:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110480896 00000100:00100000:3.0:1780997309.301738:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110480896 00000100:00100000:3.0:1780997309.301810:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6029 00000100:00100000:3.0:1780997309.301831:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2395:x1867507110480896:12345-192.168.206.51@tcp:16:kworker.0 00010000:00000080:3.0:1780997309.301890:0:25172:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1c700 x1867507110480896/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997309.301947:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2395:x1867507110480896:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 129us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997309.301955:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6029 00000100:00100000:1.0:1780997309.302123:0:23854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110480768 00000100:00100000:1.0:1780997309.302128:0:23854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110480768 00002000:00100000:1.0:1780997309.302156:0:23854:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x628:0x0] (0->1023) req@ffff9689bfb1e680 x1867507110480768/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997309.302166:0:23854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb1e680 with x1867507110480768 ext(0->1023) 00002000:00010000:1.0:1780997309.302172:0:23854:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb1e680 00000100:00100000:1.0:1780997309.302197:0:23854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1034 00000100:00100000:1.0:1780997309.302205:0:23854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2395:x1867507110480768:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:1.0:1780997309.302877:0:23854:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1e680 x1867507110480768/t4294969504(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.302924:0:23854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2395:x1867507110480768:12345-192.168.206.51@tcp:4:dd.0 Request processed in 721us (1459us total) trans 4294969504 rc 0/0 00000100:00100000:1.0:1780997309.302932:0:23854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1034 00002000:00100000:1.0:1780997309.302939:0:23854:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x628:0x0] (0->1023) req@ffff9689bfb1e680 x1867507110480768/t4294969504(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997309.302948:0:23854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb1e680 with x1867507110480768 ext(0->1023) 00002000:00010000:1.0:1780997309.302952:0:23854:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb1e680 00000100:00100000:3.0:1780997309.316170:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.316214:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.316244:0:8236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110481024 00000100:00100000:3.0:1780997309.316254:0:8236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110481024 00002000:00100000:3.0:1780997309.316587:0:8236:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x629:0x0] (0->1023) req@ffff9689bd327050 x1867507110481024/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780997309.316599:0:8236:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bd327050 with x1867507110481024 ext(0->1023) 00002000:00010000:3.0:1780997309.316605:0:8236:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bd327050 00000100:00100000:3.0:1780997309.316642:0:8236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1035 00000100:00100000:3.0:1780997309.316657:0:8236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2394:x1867507110481024:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:3.0:1780997309.317107:0:8236:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bd327050 x1867507110481024/t4294969505(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997309.317188:0:8236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2394:x1867507110481024:12345-192.168.206.51@tcp:4:dd.0 Request processed in 534us (1028us total) trans 4294969505 rc 0/0 00000100:00100000:3.0:1780997309.317195:0:8236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1035 00002000:00100000:3.0:1780997309.317201:0:8236:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x629:0x0] (0->1023) req@ffff9689bd327050 x1867507110481024/t4294969505(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780997309.317208:0:8236:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bd327050 with x1867507110481024 ext(0->1023) 00002000:00010000:3.0:1780997309.317212:0:8236:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bd327050 00000100:00100000:0.0:1780997309.318009:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110481152 00000100:00100000:0.0:1780997309.318019:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110481152 00000100:00100000:0.0:1780997309.318066:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6030 00000100:00100000:0.0:1780997309.318075:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2394:x1867507110481152:12345-192.168.206.51@tcp:16:kworker.0 00000001:00080000:0.0:1780997309.319474:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969505 is committed 00010000:00000080:0.0:1780997309.319549:0:25180:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc960000 x1867507110481152/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997309.319618:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2394:x1867507110481152:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 1544us (3401us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997309.319627:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6030 00000100:00100000:3.0:1780997309.324918:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997309.325097:0:8237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110481280 00000100:00100000:0.0:1780997309.325111:0:8237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110481280 00002000:00100000:0.0:1780997309.325171:0:8237:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x62a:0x0] (0->1023) req@ffff9689bc963480 x1867507110481280/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997309.325199:0:8237:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc963480 with x1867507110481280 ext(0->1023) 00002000:00010000:0.0:1780997309.325206:0:8237:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc963480 00000100:00100000:0.0:1780997309.325246:0:8237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1036 00000100:00100000:0.0:1780997309.325257:0:8237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2394:x1867507110481280:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:0.0:1780997309.325804:0:8237:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc963480 x1867507110481280/t4294969506(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997309.325878:0:8237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2394:x1867507110481280:12345-192.168.206.51@tcp:4:dd.0 Request processed in 622us (970us total) trans 4294969506 rc 0/0 00000100:00100000:0.0:1780997309.325887:0:8237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1036 00002000:00100000:0.0:1780997309.325894:0:8237:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x62a:0x0] (0->1023) req@ffff9689bc963480 x1867507110481280/t4294969506(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997309.325902:0:8237:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc963480 with x1867507110481280 ext(0->1023) 00002000:00010000:0.0:1780997309.325906:0:8237:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc963480 00000100:00100000:0.0:1780997309.327017:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.330566:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110481408 00000100:00100000:3.0:1780997309.330586:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110481408 00000100:00100000:2.0:1780997309.333993:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6031 00000100:00100000:2.0:1780997309.334008:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2394:x1867507110481408:12345-192.168.206.51@tcp:16:kworker.0 00000001:00080000:3.0:1780997309.335657:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969506 is committed 00010000:00000080:2.0:1780997309.336389:0:25177:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1ca80 x1867507110481408/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997309.336471:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2394:x1867507110481408:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 2466us (9458us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997309.336480:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6031 00000100:00100000:0.0:1780997309.342063:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997309.342167:0:8238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110481536 00000100:00100000:1.0:1780997309.342178:0:8238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110481536 00002000:00100000:1.0:1780997309.342236:0:8238:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x62b:0x0] (0->1023) req@ffff9689bfb1e300 x1867507110481536/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997309.342246:0:8238:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb1e300 with x1867507110481536 ext(0->1023) 00002000:00010000:1.0:1780997309.342252:0:8238:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb1e300 00000100:00100000:1.0:1780997309.342328:0:8238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1037 00000100:00100000:1.0:1780997309.342339:0:8238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2396:x1867507110481536:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:1.0:1780997309.342756:0:8238:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1e300 x1867507110481536/t4294969507(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.342825:0:8238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2396:x1867507110481536:12345-192.168.206.51@tcp:4:dd.0 Request processed in 479us (764us total) trans 4294969507 rc 0/0 00000100:00100000:1.0:1780997309.342834:0:8238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1037 00002000:00100000:1.0:1780997309.342841:0:8238:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x62b:0x0] (0->1023) req@ffff9689bfb1e300 x1867507110481536/t4294969507(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997309.342848:0:8238:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb1e300 with x1867507110481536 ext(0->1023) 00002000:00010000:1.0:1780997309.342851:0:8238:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb1e300 00000100:00100000:3.0:1780997309.349264:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997309.349700:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110481664 00000100:00100000:1.0:1780997309.349712:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110481664 00000100:00100000:1.0:1780997309.349786:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6032 00000100:00100000:1.0:1780997309.349797:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2396:x1867507110481664:12345-192.168.206.51@tcp:16:kworker.0 00000001:00080000:1.0:1780997309.350135:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969507 is committed 00010000:00000080:1.0:1780997309.350187:0:8233:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc963100 x1867507110481664/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.351925:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2396:x1867507110481664:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 2117us (2662us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997309.351941:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6032 00000100:00100000:3.0:1780997309.391364:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997309.392933:0:24144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110481792 00000100:00100000:1.0:1780997309.392949:0:24144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110481792 00002000:00100000:1.0:1780997309.393007:0:24144:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x62c:0x0] (0->1023) req@ffff9689bc960700 x1867507110481792/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997309.393251:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00002000:00100000:1.0:1780997309.393368:0:24144:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc960700 with x1867507110481792 ext(0->1023) 00002000:00010000:1.0:1780997309.393376:0:24144:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc960700 00000100:00100000:1.0:1780997309.393404:0:24144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1038 00000100:00100000:1.0:1780997309.393415:0:24144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2396:x1867507110481792:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1780997309.393468:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110481920 00000100:00100000:2.0:1780997309.393475:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110481920 00000100:00100000:2.0:1780997309.393515:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6033 00000100:00100000:2.0:1780997309.393525:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+26:2396:x1867507110481920:12345-192.168.206.51@tcp:16:kworker.0 00010000:00000080:2.0:1780997309.393629:0:25174:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc961180 x1867507110481920/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997309.393706:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+26:2396:x1867507110481920:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 181us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997309.393714:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6033 00010000:00000080:1.0:1780997309.395644:0:24144:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc960700 x1867507110481792/t4294969508(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.395709:0:24144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2396:x1867507110481792:12345-192.168.206.51@tcp:4:dd.0 Request processed in 2296us (4356us total) trans 4294969508 rc 0/0 00000100:00100000:1.0:1780997309.395720:0:24144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1038 00002000:00100000:1.0:1780997309.395730:0:24144:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x62c:0x0] (0->1023) req@ffff9689bc960700 x1867507110481792/t4294969508(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997309.395740:0:24144:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc960700 with x1867507110481792 ext(0->1023) 00002000:00010000:1.0:1780997309.395746:0:24144:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc960700 00000100:00100000:3.0:1780997309.402035:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997309.404294:0:23857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110482048 00000100:00100000:2.0:1780997309.404310:0:23857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110482048 00002000:00100000:2.0:1780997309.404375:0:23857:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x62d:0x0] (0->1023) req@ffff9689bc962680 x1867507110482048/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780997309.404386:0:23857:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc962680 with x1867507110482048 ext(0->1023) 00002000:00010000:2.0:1780997309.404393:0:23857:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc962680 00000100:00100000:2.0:1780997309.404438:0:23857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1039 00000100:00100000:2.0:1780997309.404450:0:23857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2395:x1867507110482048:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:2.0:1780997309.404948:0:23857:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc962680 x1867507110482048/t4294969509(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997309.405025:0:23857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2395:x1867507110482048:12345-192.168.206.51@tcp:4:dd.0 Request processed in 578us (3001us total) trans 4294969509 rc 0/0 00000100:00100000:2.0:1780997309.406889:0:23857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1039 00002000:00100000:2.0:1780997309.406914:0:23857:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x62d:0x0] (0->1023) req@ffff9689bc962680 x1867507110482048/t4294969509(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780997309.406927:0:23857:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc962680 with x1867507110482048 ext(0->1023) 00002000:00010000:2.0:1780997309.406934:0:23857:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc962680 00000100:00100000:3.0:1780997309.407828:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997309.408338:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110482176 00000100:00100000:1.0:1780997309.408347:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110482176 00000100:00100000:1.0:1780997309.408403:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6034 00000100:00100000:1.0:1780997309.408412:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2395:x1867507110482176:12345-192.168.206.51@tcp:16:kworker.0 00000001:00080000:0.0:1780997309.411196:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969509 is committed 00010000:00000080:1.0:1780997309.411967:0:8232:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc960380 x1867507110482176/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.412072:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2395:x1867507110482176:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 3660us (4255us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997309.412082:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6034 00000100:00100000:1.0:1780997309.421590:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997309.421665:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997309.421706:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110482432 00000100:00100000:1.0:1780997309.421720:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110482432 00000100:00100000:1.0:1780997309.421807:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6035 00000100:00100000:1.0:1780997309.421837:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2394:x1867507110482432:12345-192.168.206.51@tcp:16:kworker.0 00010000:00000080:1.0:1780997309.421933:0:25181:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb6300 x1867507110482432/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.422005:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2394:x1867507110482432:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 188us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997309.422013:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6035 00000100:00100000:3.0:1780997309.422326:0:23854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110482304 00000100:00100000:3.0:1780997309.422333:0:23854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110482304 00002000:00100000:3.0:1780997309.422363:0:23854:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x62e:0x0] (0->1023) req@ffff9689adbb7480 x1867507110482304/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780997309.422372:0:23854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adbb7480 with x1867507110482304 ext(0->1023) 00002000:00010000:3.0:1780997309.422378:0:23854:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689adbb7480 00000100:00100000:3.0:1780997309.422396:0:23854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1040 00000100:00100000:3.0:1780997309.422403:0:23854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2394:x1867507110482304:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:3.0:1780997309.422969:0:23854:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689adbb7480 x1867507110482304/t4294969510(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997309.423014:0:23854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2394:x1867507110482304:12345-192.168.206.51@tcp:4:dd.0 Request processed in 612us (1437us total) trans 4294969510 rc 0/0 00000100:00100000:3.0:1780997309.423021:0:23854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1040 00002000:00100000:3.0:1780997309.423028:0:23854:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x62e:0x0] (0->1023) req@ffff9689adbb7480 x1867507110482304/t4294969510(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780997309.423037:0:23854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689adbb7480 with x1867507110482304 ext(0->1023) 00002000:00010000:3.0:1780997309.424180:0:23854:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689adbb7480 00000100:00100000:3.0:1780997309.438422:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.438463:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.438499:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110482688 00000100:00100000:3.0:1780997309.438512:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110482688 00000100:00100000:3.0:1780997309.438579:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6036 00000100:00100000:3.0:1780997309.438591:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2396:x1867507110482688:12345-192.168.206.51@tcp:16:kworker.0 00010000:00000080:3.0:1780997309.438658:0:25179:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc963b80 x1867507110482688/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997309.438735:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2396:x1867507110482688:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 146us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997309.438750:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6036 00000100:00100000:3.0:1780997309.438778:0:8236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110482560 00000100:00100000:3.0:1780997309.438782:0:8236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110482560 00002000:00100000:3.0:1780997309.438809:0:8236:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x62f:0x0] (0->1023) req@ffff9689bc962300 x1867507110482560/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780997309.438829:0:8236:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc962300 with x1867507110482560 ext(0->1023) 00002000:00010000:3.0:1780997309.438837:0:8236:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc962300 00000100:00100000:3.0:1780997309.438940:0:8236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1041 00000100:00100000:3.0:1780997309.438949:0:8236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2396:x1867507110482560:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:3.0:1780997309.439396:0:8236:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc962300 x1867507110482560/t4294969511(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997309.439438:0:8236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2396:x1867507110482560:12345-192.168.206.51@tcp:4:dd.0 Request processed in 491us (1028us total) trans 4294969511 rc 0/0 00000100:00100000:3.0:1780997309.439446:0:8236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1041 00002000:00100000:3.0:1780997309.439453:0:8236:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x62f:0x0] (0->1023) req@ffff9689bc962300 x1867507110482560/t4294969511(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780997309.439460:0:8236:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc962300 with x1867507110482560 ext(0->1023) 00002000:00010000:3.0:1780997309.439463:0:8236:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc962300 00000100:00100000:3.0:1780997309.446936:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.446984:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997309.447189:0:23858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110482816 00000100:00100000:1.0:1780997309.447200:0:23858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110482816 00002000:00100000:1.0:1780997309.447251:0:23858:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x630:0x0] (0->1023) req@ffff9689bc961f80 x1867507110482816/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997309.447263:0:23858:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc961f80 with x1867507110482816 ext(0->1023) 00002000:00010000:1.0:1780997309.447297:0:23858:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc961f80 00000100:00100000:1.0:1780997309.447336:0:23858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1042 00000100:00100000:1.0:1780997309.447345:0:23858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2396:x1867507110482816:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:1.0:1780997309.447721:0:23858:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc961f80 x1867507110482816/t4294969512(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.447785:0:23858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+31:2396:x1867507110482816:12345-192.168.206.51@tcp:4:dd.0 Request processed in 441us (862us total) trans 4294969512 rc 0/0 00000100:00100000:1.0:1780997309.447794:0:23858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1042 00002000:00100000:1.0:1780997309.447801:0:23858:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x630:0x0] (0->1023) req@ffff9689bc961f80 x1867507110482816/t4294969512(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997309.447830:0:23858:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc961f80 with x1867507110482816 ext(0->1023) 00002000:00010000:1.0:1780997309.447834:0:23858:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc961f80 00000100:00100000:0.0:1780997309.448383:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110482944 00000100:00100000:0.0:1780997309.448393:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110482944 00000100:00100000:0.0:1780997309.448450:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6037 00000100:00100000:0.0:1780997309.448459:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+31:2397:x1867507110482944:12345-192.168.206.51@tcp:16:kworker.0 00000001:00080000:0.0:1780997309.448693:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969512 is committed 00010000:00000080:0.0:1780997309.448731:0:25175:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc962d80 x1867507110482944/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997309.448799:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2397:x1867507110482944:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 337us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997309.448806:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6037 00000100:00100000:0.0:1780997309.457583:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997309.457636:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997309.457735:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110483200 00000100:00100000:2.0:1780997309.457755:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110483200 00000100:00100000:2.0:1780997309.457848:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6038 00000100:00100000:2.0:1780997309.457869:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2395:x1867507110483200:12345-192.168.206.51@tcp:16:kworker.0 00010000:00000080:2.0:1780997309.457946:0:25173:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1fb80 x1867507110483200/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997309.458002:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2395:x1867507110483200:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 139us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997309.458011:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6038 00000100:00100000:3.0:1780997309.460392:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110483072 00000100:00100000:3.0:1780997309.460407:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110483072 00002000:00100000:3.0:1780997309.460462:0:24155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x631:0x0] (0->1023) req@ffff9689bfb1f480 x1867507110483072/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780997309.460475:0:24155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb1f480 with x1867507110483072 ext(0->1023) 00002000:00010000:3.0:1780997309.460481:0:24155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb1f480 00000100:00100000:3.0:1780997309.460514:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1043 00000100:00100000:3.0:1780997309.460523:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2394:x1867507110483072:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:3.0:1780997309.463388:0:24155:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1f480 x1867507110483072/t4294969513(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997309.463483:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2394:x1867507110483072:12345-192.168.206.51@tcp:4:dd.0 Request processed in 2961us (5914us total) trans 4294969513 rc 0/0 00000100:00100000:3.0:1780997309.463505:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1043 00002000:00100000:3.0:1780997309.463517:0:24155:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x631:0x0] (0->1023) req@ffff9689bfb1f480 x1867507110483072/t4294969513(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780997309.463526:0:24155:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfb1f480 with x1867507110483072 ext(0->1023) 00002000:00010000:3.0:1780997309.463532:0:24155:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfb1f480 00000100:00100000:0.0:1780997309.467657:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997309.467713:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997309.467994:0:25182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110483456 00000100:00100000:2.0:1780997309.468006:0:25182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110483456 00000100:00100000:2.0:1780997309.468077:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6039 00000100:00100000:2.0:1780997309.468088:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2394:x1867507110483456:12345-192.168.206.51@tcp:16:kworker.0 00010000:00000080:2.0:1780997309.468154:0:25182:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfb1e680 x1867507110483456/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997309.468217:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2394:x1867507110483456:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 130us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997309.468226:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6039 00000100:00100000:0.0:1780997309.470529:0:24144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110483328 00000100:00100000:0.0:1780997309.470543:0:24144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110483328 00002000:00100000:0.0:1780997309.470599:0:24144:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x632:0x0] (0->1023) req@ffff9689bfaa9880 x1867507110483328/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997309.470612:0:24144:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfaa9880 with x1867507110483328 ext(0->1023) 00002000:00010000:0.0:1780997309.470619:0:24144:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfaa9880 00000100:00100000:0.0:1780997309.470775:0:24144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1044 00000100:00100000:0.0:1780997309.470795:0:24144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2394:x1867507110483328:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:0.0:1780997309.472422:0:24144:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bfaa9880 x1867507110483328/t4294969514(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997309.472530:0:24144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2394:x1867507110483328:12345-192.168.206.51@tcp:4:dd.0 Request processed in 1738us (4816us total) trans 4294969514 rc 0/0 00000100:00100000:0.0:1780997309.472542:0:24144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1044 00002000:00100000:0.0:1780997309.472552:0:24144:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x632:0x0] (0->1023) req@ffff9689bfaa9880 x1867507110483328/t4294969514(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997309.472562:0:24144:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bfaa9880 with x1867507110483328 ext(0->1023) 00002000:00010000:0.0:1780997309.472567:0:24144:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bfaa9880 00000100:00100000:3.0:1780997309.477096:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997309.477143:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997309.478020:0:23857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110483584 00000100:00100000:2.0:1780997309.478045:0:23857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110483584 00002000:00100000:2.0:1780997309.478096:0:23857:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x633:0x0] (0->1023) req@ffff9689bc963800 x1867507110483584/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780997309.478108:0:23857:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc963800 with x1867507110483584 ext(0->1023) 00002000:00010000:2.0:1780997309.478114:0:23857:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc963800 00000100:00100000:2.0:1780997309.478143:0:23857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1045 00000100:00100000:2.0:1780997309.478153:0:23857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2395:x1867507110483584:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:2.0:1780997309.478799:0:23857:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc963800 x1867507110483584/t4294969515(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997309.478876:0:23857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+31:2395:x1867507110483584:12345-192.168.206.51@tcp:4:dd.0 Request processed in 724us (1792us total) trans 4294969515 rc 0/0 00000100:00100000:2.0:1780997309.478885:0:23857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1045 00002000:00100000:2.0:1780997309.478892:0:23857:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x633:0x0] (0->1023) req@ffff9689bc963800 x1867507110483584/t4294969515(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780997309.478900:0:23857:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc963800 with x1867507110483584 ext(0->1023) 00002000:00010000:2.0:1780997309.478904:0:23857:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc963800 00000100:00100000:2.0:1780997309.479397:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110483712 00000100:00100000:2.0:1780997309.479404:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110483712 00000100:00100000:2.0:1780997309.479434:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6040 00000100:00100000:2.0:1780997309.479442:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+31:2395:x1867507110483712:12345-192.168.206.51@tcp:16:kworker.0 00000001:00080000:1.0:1780997309.483440:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969515 is committed 00010000:00000080:1.0:1780997309.483516:0:25180:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc960e00 x1867507110483712/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.483602:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2395:x1867507110483712:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 4160us (6458us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997309.483612:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6040 00000100:00100000:3.0:1780997309.490468:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997309.490595:0:23856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110483840 00000100:00100000:0.0:1780997309.490610:0:23856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110483840 00002000:00100000:0.0:1780997309.490678:0:23856:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x634:0x0] (0->1023) req@ffff9689bc961880 x1867507110483840/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997309.490691:0:23856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc961880 with x1867507110483840 ext(0->1023) 00002000:00010000:0.0:1780997309.490698:0:23856:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc961880 00000100:00100000:0.0:1780997309.490734:0:23856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1046 00000100:00100000:0.0:1780997309.490756:0:23856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2395:x1867507110483840:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:0.0:1780997309.496024:0:23856:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc961880 x1867507110483840/t4294969516(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997309.496120:0:23856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2395:x1867507110483840:12345-192.168.206.51@tcp:4:dd.0 Request processed in 5376us (5662us total) trans 4294969516 rc 0/0 00000100:00100000:0.0:1780997309.496132:0:23856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1046 00002000:00100000:0.0:1780997309.496143:0:23856:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x634:0x0] (0->1023) req@ffff9689bc961880 x1867507110483840/t4294969516(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780997309.496153:0:23856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc961880 with x1867507110483840 ext(0->1023) 00002000:00010000:0.0:1780997309.496161:0:23856:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc961880 00000100:00100000:2.0:1780997309.497247:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997309.497329:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110483968 00000100:00100000:1.0:1780997309.497340:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110483968 00000100:00100000:1.0:1780997309.497385:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6041 00000100:00100000:1.0:1780997309.497394:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2395:x1867507110483968:12345-192.168.206.51@tcp:16:kworker.0 00000001:00080000:1.0:1780997309.497623:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969516 is committed 00010000:00000080:1.0:1780997309.497653:0:25177:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b1163100 x1867507110483968/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.497699:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2395:x1867507110483968:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 307us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997309.497706:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6041 00000100:00100000:3.0:1780997309.502232:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997309.504113:0:8237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110484096 00000100:00100000:0.0:1780997309.504133:0:8237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110484096 00002000:00100000:1.0:1780997309.504300:0:8237:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x635:0x0] (0->1023) req@ffff9689bc960a80 x1867507110484096/t0(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/0 e 0 to 0 dl 1780997320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997309.504313:0:8237:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc960a80 with x1867507110484096 ext(0->1023) 00002000:00010000:1.0:1780997309.504321:0:8237:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc960a80 00000100:00100000:1.0:1780997309.504354:0:8237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1047 00000100:00100000:1.0:1780997309.504364:0:8237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2395:x1867507110484096:12345-192.168.206.51@tcp:4:dd.0 00010000:00000080:1.0:1780997309.505152:0:8237:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bc960a80 x1867507110484096/t4294969517(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997309.505237:0:8237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2395:x1867507110484096:12345-192.168.206.51@tcp:4:dd.0 Request processed in 874us (3023us total) trans 4294969517 rc 0/0 00000100:00100000:1.0:1780997309.505247:0:8237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1047 00002000:00100000:1.0:1780997309.505255:0:8237:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x635:0x0] (0->1023) req@ffff9689bc960a80 x1867507110484096/t4294969517(0) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 1512/448 e 0 to 0 dl 1780997320 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780997309.505265:0:8237:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9689bc960a80 with x1867507110484096 ext(0->1023) 00002000:00010000:1.0:1780997309.505296:0:8237:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9689bc960a80 00000100:00100000:3.0:1780997309.507320:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997309.507481:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110484224 00000100:00100000:2.0:1780997309.507491:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110484224 00000100:00100000:2.0:1780997309.507544:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6042 00000100:00100000:2.0:1780997309.507555:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2394:x1867507110484224:12345-192.168.206.51@tcp:16:kworker.0 00000001:00080000:0.0:1780997309.508355:0:8226:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969517 is committed 00010000:00000080:2.0:1780997309.508469:0:8233:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689bb55dc00 x1867507110484224/t0(0) o16->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:640/0 lens 440/432 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997309.508554:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2394:x1867507110484224:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 1001us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997309.508562:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6042 00000100:00100000:1.0:1780997309.862453:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780997309.862478:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adbb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127043072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997309.862552:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997309.862606:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127043072 00000100:00100000:1.0:1780997309.862616:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127043072 00000100:00100000:1.0:1780997309.862673:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182 00000100:00100000:1.0:1780997309.862683:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127043072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997309.862708:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997309.862756:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127043072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997309.862764:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182 00000100:00100000:1.0:1780997309.862834:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adbb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127043072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780997309.868071:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997309.868099:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adbb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127043200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780997309.868174:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997309.869912:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127043200 00000100:00100000:0.0:1780997309.869925:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127043200 00000100:00100000:0.0:1780997309.869986:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183 00000100:00100000:0.0:1780997309.869995:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127043200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780997309.870022:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 176828736 pending 0 free 3922481152 avail 3690385408 00010000:00000080:0.0:1780997309.870046:0:8234:0:(ldlm_lib.c:3286:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9689b1161500 x1867507127043200/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:640/0 lens 224/368 e 0 to 0 dl 1780997320 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997309.870111:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127043200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997309.870118:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183 00000100:00100000:2.0:1780997309.870230:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adbb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127043200:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1780997310.185527:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1780997310.813685:0:91763:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1780997310.813753:0:91763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.813766:0:91763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.813773:0:91763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.813781:0:91763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.813805:0:91763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1780997310.813820:0:91763:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1780997310.813838:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780997310.813848:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1780997310.813850:0:91763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1780997310.813856:0:91763:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1780997310.813863:0:91763:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1780997310.813866:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba454e00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:3.0:1780997310.813871:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997310.813881:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780997310.813890:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1780997310.813892:0:91763:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:3.0:1780997310.813909:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1780997310.813912:0:14480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1780997310.813927:0:14480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1780997310.813934:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507127043328:0@lo:39:umount.0 00010000:00010000:3.0:1780997310.813966:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997310.813975:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780997310.813998:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997310.814006:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba454e00/0x30fd811c0305ba46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305ba4d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997310.814013:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1780997310.814029:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997310.814032:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997310.814036:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997310.814052:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127043456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997310.814095:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997310.814187:0:8261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127043456 00000100:00100000:0.0:1780997310.814195:0:8261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127043456 00000100:00100000:0.0:1780997310.814306:0:8261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1780997310.814325:0:8261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507127043456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997310.814341:0:8261:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780997310.814356:0:8261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a56c8600/0x30fd811c0305ba4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305ba46 expref: 23 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.814374:0:8261:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780997310.814414:0:8261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3498:x1867507127043456:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997310.814422:0:8261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1780997310.814521:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127043456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997310.814893:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127043328 00000100:00100000:2.0:1780997310.814900:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127043328 00000100:00100000:2.0:1780997310.814961:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:2.0:1780997310.814971:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3495:x1867507127043328:12345-0@lo:39:umount.0 00000020:00000080:2.0:1780997310.814997:0:63419:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305b680 00000100:00080000:2.0:1780997310.815034:0:63419:0:(import.c:65:import_set_state_nolock()) ffff9689bfab4000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1780997310.815100:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+1:3495:x1867507127043328:12345-0@lo:39:umount.0 Request processed in 132us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997310.815108:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000020:00000080:2.0:1780997310.815115:0:63419:0:(genops.c:906:class_export_put()) final put ffff9689bfab0800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1780997310.815171:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780997310.816159:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780997310.816170:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9688858f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1780997310.816197:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507127043328:0@lo:39:umount.0 00000100:00080000:0.0:1780997310.816215:0:91763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1780997310.816221:0:91763:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1780997310.816226:0:91763:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1780997310.817177:0:91763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1780997310.817183:0:91763:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1780997310.817190:0:91763:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1780997310.817220:0:91763:0:(import.c:65:import_set_state_nolock()) ffff968885ce5800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1780997310.817332:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3495:1867507127043584:0@lo:39:umount.0 00000100:00100000:3.0:1780997310.817408:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997310.817774:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127043584 00000100:00100000:0.0:1780997310.817781:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127043584 00000100:00100000:0.0:1780997310.817862:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:0.0:1780997310.817873:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3495:x1867507127043584:12345-0@lo:39:umount.0 00000100:00080000:3.0:1780997310.817895:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:0.0:1780997310.817899:0:63584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03055417 00000100:00080000:0.0:1780997310.817911:0:63584:0:(import.c:65:import_set_state_nolock()) ffff968983336000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1780997310.818305:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997310.819075:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+1:3495:x1867507127043584:12345-0@lo:39:umount.0 Request processed in 1203us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997310.819085:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000020:00000080:0.0:1780997310.819097:0:63584:0:(genops.c:906:class_export_put()) final put ffff968983330000/lustre-MDT0001-lwp-OST0000_UUID 00000100:00080000:3.0:1780997310.819252:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968885ce5800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1780997310.819300:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3495:1867507127043584:0@lo:39:umount.0 00000100:00080000:0.0:1780997310.820322:0:91763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1780997310.820338:0:91763:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1780997310.820343:0:91763:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1780997310.821318:0:91763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.821332:0:91763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.821340:0:91763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.821348:0:91763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.821374:0:91763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780997310.821381:0:91763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.821388:0:91763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.821395:0:91763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.821401:0:91763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.821420:0:91763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1780997310.821425:0:91763:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1780997310.821470:0:91763:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1780997310.821474:0:91763:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:0.0:1780997310.821485:0:91763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1780997310.821492:0:91763:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:2.0:1780997310.821802:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780997310.821822:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997310.821842:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689ba455800 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997310.821847:0:6339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997310.821855:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997310.821862:0:6339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997310.821868:0:6339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1780997310.821871:0:6339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1780997310.821873:0:6339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1780997310.821910:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997310.821917:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997310.821936:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997310.821943:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689ba455800/0x30fd811c0305ba54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305ba5b expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997310.821954:0:6339:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780997310.821957:0:6339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997310.821963:0:6339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff02000 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:2.0:1780997310.821966:0:6339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997310.821979:0:6339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780997310.821985:0:6339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780997310.821990:0:6339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1780997310.821992:0:6339:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1780997310.821994:0:6339:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1780997310.822011:0:6339:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997310.822018:0:6339:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780997310.822036:0:6339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997310.822043:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bff02000/0x30fd811c0305b656 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x30fd811c0305b65d expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997310.822053:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997310.822055:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997310.822058:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997310.822618:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127043840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997310.822690:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997310.822791:0:25183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127043840 00000100:00100000:2.0:1780997310.822799:0:25183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127043840 00000100:00100000:2.0:1780997310.822865:0:25183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1780997310.822877:0:25183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1163480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:3496:x1867507127043840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780997310.822891:0:25183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780997310.822919:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff968889ffc200/0x30fd811c0305b65d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305b656 expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997310.822934:0:25183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780997310.822979:0:25183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1163480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3496:x1867507127043840:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997310.822989:0:25183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00010000:00010000:3.0:1780997310.823001:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997310.823017:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780997310.823030:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127043712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780997310.823076:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127043840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780997310.823081:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997310.823138:0:18812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127043712 00000100:00100000:3.0:1780997310.823143:0:18812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127043712 00000100:00100000:3.0:1780997310.823186:0:18812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1780997310.823197:0:18812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:3498:x1867507127043712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780997310.823206:0:18812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780997310.823219:0:18812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba454600/0x30fd811c0305ba5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x30fd811c0305ba54 expref: 21 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997310.823232:0:18812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780997310.823267:0:18812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3498:x1867507127043712:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997310.823303:0:18812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1780997310.823341:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127043712:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1780997310.823452:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bfab0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1780997310.823511:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff968983330000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1780997310.823534:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689bfab4000 for lustre-MDT0000 00000020:00000080:1.0:1780997310.823546:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968983336000 for lustre-MDT0001 00002000:00000080:0.0:1780997310.826544:0:91763:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:0.0:1780997310.826680:0:91763:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000020:00000080:0.0:1780997310.826822:0:91763:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:0.0:1780997310.826832:0:91763:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9689b11b8000 e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 192.168.206.51@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294969517 stale:0 00000020:00080000:0.0:1780997310.826840:0:91763:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9689891ae800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969456 stale:0 00000020:00080000:0.0:1780997310.826844:0:91763:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9689a69f5000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969473 stale:0 00000020:00080000:0.0:1780997310.826849:0:91763:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9689b6280000) has exports, disconnecting them 00000020:00080000:0.0:1780997310.826853:0:91763:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.206.51@tcp (ffff9689b11b8000), last request at 1780997309 00000020:00000080:0.0:1780997310.826860:0:91763:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305b894 00000020:00010000:0.0:1780997310.826867:0:91763:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9689b11b8000: total 0 00000100:00080000:0.0:1780997310.826872:0:91763:0:(import.c:65:import_set_state_nolock()) ffff9689b1066000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780997310.826899:0:91763:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.206.51@tcp (ffff9689b11b8000): rc 0 00000020:00080000:0.0:1780997310.826902:0:91763:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9689891ae800), last request at 1780997308 00000020:00000080:0.0:1780997310.826904:0:91763:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0305b53e 00000100:00080000:0.0:1780997310.826908:0:91763:0:(import.c:65:import_set_state_nolock()) ffff9689891ab000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780997310.826927:0:91763:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689891ae800): rc 0 00000020:00000080:0.0:1780997310.826929:0:91763:0:(genops.c:906:class_export_put()) final put ffff9689891ae800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:0.0:1780997310.826943:0:91763:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9689a69f5000), last request at 1780997309 00000020:00000080:0.0:1780997310.826946:0:91763:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c03055399 00000100:00080000:0.0:1780997310.826950:0:91763:0:(import.c:65:import_set_state_nolock()) ffff9689a69f0800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780997310.826957:0:91763:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9689a69f5000): rc 0 00000020:00000080:0.0:1780997310.826959:0:91763:0:(genops.c:906:class_export_put()) final put ffff9689a69f5000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1780997310.826983:0:91763:0:(genops.c:1579:class_disconnect_exports()) OBD device 19 (ffff9689b6280000) has no exports 00000020:00010000:2.0:1780997310.827048:0:6339:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9689b11b8000: total 2 00010000:00010000:2.0:1780997310.827097:0:6339:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9689b11b8000, canceled 0 locks, left on hash table 20. 00002000:00010000:2.0:1780997310.827132:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x625:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827137:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x625:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.827166:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc33734e/0x30fd811c0305c0ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae909a expref: 21 pid: 8232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.827198:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x62b:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827201:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x62b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.827212:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003b87a17/0x30fd811c0305c22d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9118 expref: 20 pid: 25180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.827233:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x62d:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827236:0:6339:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x62d:0x0] updating lvb mtime from disk: 1780997308 -> 1780997309 00002000:00010000:2.0:1780997310.827239:0:6339:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x62d:0x0] updating lvb ctime from disk: 1780997308 -> 1780997309 00002000:00010000:2.0:1780997310.827241:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x62d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.827250:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000999b8e9b/0x30fd811c0305c2ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9157 expref: 19 pid: 25169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.827317:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x627:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827321:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x627:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.827331:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6b4fbdb/0x30fd811c0305c1a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90e7 expref: 18 pid: 23044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.827349:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x633:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827351:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x633:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.827359:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a17f6ec/0x30fd811c0305c417 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91b9 expref: 17 pid: 25173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.827378:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x622:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827381:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x622:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.827389:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005015db48/0x30fd811c0305c06d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9085 expref: 16 pid: 25174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.827406:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x628:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827408:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x628:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.827416:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000794d842d/0x30fd811c0305c11c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90c4 expref: 15 pid: 25178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.827437:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x62a:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827439:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x62a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.827447:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019c49a87/0x30fd811c0305c1c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9103 expref: 14 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.827480:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x635:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827483:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x635:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.827492:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000111c6c12/0x30fd811c0305c448 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91d5 expref: 13 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.827509:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x630:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827512:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x630:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.827520:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e859a75/0x30fd811c0305c3d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91a4 expref: 12 pid: 25179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.827540:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x623:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827545:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x623:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1780997310.827545:0:91763:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305c02e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9070 expref: 11 pid: 8230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.827558:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x62e:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827561:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x62e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.827574:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000330b343b/0x30fd811c0305c2a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9142 expref: 11 pid: 8233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.827579:0:91763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000191c0b65/0x30fd811c0305c02e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x623:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9070 expref: 11 pid: 8230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.827597:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x634:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827601:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x634:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.827610:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2134fa8/0x30fd811c0305c41e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91c0 expref: 9 pid: 25175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.827625:0:91763:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c0305c004 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x624:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9062 expref: 8 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.827630:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x624:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.827637:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x624:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1780997310.827971:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997310.829548:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1780997310.830001:0:90819:0:(genops.c:865:class_export_destroy()) destroying export ffff9689891ae800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1780997310.830094:0:90819:0:(genops.c:865:class_export_destroy()) destroying export ffff9689a69f5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1780997310.830112:0:90819:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689891ab000 for lustre-OST0000 00000020:00000080:3.0:1780997310.830116:0:90819:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689a69f0800 for lustre-OST0000 00010000:00010000:2.0:1780997310.830615:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a578e3/0x30fd811c0305c004 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae9062 expref: 8 pid: 25177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.830733:0:91763:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305c0eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x626:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90af expref: 7 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.830748:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x632:0x0] updating lvb size from disk: 0 -> 1024 00010000:00010000:0.0:1780997310.830753:0:91763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077df01a4/0x30fd811c0305c0eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x626:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90af expref: 7 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.830755:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x632:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.830776:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8d099cc/0x30fd811c0305c441 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91ce expref: 6 pid: 25182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.830884:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x631:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.830888:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x631:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1780997310.830907:0:91763:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305c1bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x629:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90ee expref: 5 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.830921:0:91763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da0cc4d/0x30fd811c0305c1bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x629:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae90ee expref: 5 pid: 25172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997310.830970:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb6eb3e6/0x30fd811c0305c3bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae919d expref: 4 pid: 25171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.830974:0:91763:0:(ldlm_resource.c:1152:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305c242 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x62c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae912d expref: 4 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997310.830997:0:91763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d4180e4/0x30fd811c0305c242 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x62c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae912d expref: 3 pid: 25168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780997310.831014:0:6339:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x62f:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780997310.831018:0:6339:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x62f:0x0] updating lvb mtime from disk: 1780997308 -> 1780997309 00002000:00010000:2.0:1780997310.831028:0:6339:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x62f:0x0] updating lvb ctime from disk: 1780997308 -> 1780997309 00002000:00010000:2.0:1780997310.831034:0:6339:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x62f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780997310.831050:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc303d24/0x30fd811c0305c322 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae916c expref: 2 pid: 25181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997310.831076:0:6339:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9689b11b8000, canceled 17 locks, left on hash table 0. 00000020:00000080:2.0:1780997310.833198:0:6339:0:(genops.c:906:class_export_put()) final put ffff9689b11b8000/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 00010000:00010000:2.0:1780997310.833893:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997310.833897:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997310.833900:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1780997310.836429:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9689b11b8000/e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 for lustre-OST0000 00000020:00000080:1.0:1780997310.836489:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9689b1066000 for lustre-OST0000 00000020:01000000:0.0:1780997310.836643:0:91763:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968886aa3ae0 - data ffff968990b20bd0/ffff9689bfacb000 00000020:01000000:0.0:1780997310.836850:0:91763:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff968885ab3900 - data ffff9689aee81ca8/ffff9689bcc1e800 00100000:10000000:0.0:1780997310.854935:0:91763:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1780997310.862721:0:91763:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0300e8da 00000020:00000080:1.0:1780997310.862737:0:91763:0:(genops.c:906:class_export_put()) final put ffff9689bca5c800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1780997310.862751:0:91763:0:(tgt_mount.c:187:server_put_mount()) put mount ffff968990f90000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1780997310.862755:0:91763:0:(obd_mount.c:701:lustre_put_lsi()) put ffff968990f90000 2 00000020:01000004:1.0:1780997310.862759:0:91763:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff968990f90000 from lustre-OST0000 00000020:00000080:1.0:1780997310.862785:0:91763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780997310.862802:0:91763:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1780997310.862805:0:91763:0:(genops.c:906:class_export_put()) final put ffff9689bca5a000/lustre-OST0000_UUID 00000020:00000080:3.0:1780997310.863022:0:90819:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bca5c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1780997310.863333:0:91763:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bca5a000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1780997310.863340:0:91763:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1780997310.863405:0:91763:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1780997310.863408:0:91763:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1780997310.863411:0:91763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780997310.863417:0:91763:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1780997310.863423:0:91763:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9688858f3800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780997310.863428:0:91763:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff9688858c4d40) has exports, disconnecting them 00000020:00080000:1.0:1780997310.863432:0:91763:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9688858f3800), last request at 1780993693 00000020:00000080:1.0:1780997310.863435:0:91763:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0300e919 00000020:00080000:1.0:1780997310.863444:0:91763:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9688858f3800): rc 0 00000020:00000080:1.0:1780997310.863448:0:91763:0:(genops.c:906:class_export_put()) final put ffff9688858f3800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1780997310.863850:0:90819:0:(genops.c:865:class_export_destroy()) destroying export ffff9688858f3800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1780997310.868357:0:91763:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1780997310.868365:0:91763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1780997310.868533:0:91763:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1780997310.868540:0:91763:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780997310.868732:0:91763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780997310.868749:0:91763:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1780997310.868755:0:91763:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1780997310.868759:0:91763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780997310.868764:0:91763:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1780997310.868770:0:91763:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff968885ce1000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780997310.868776:0:91763:0:(genops.c:1574:class_disconnect_exports()) OBD device 21 (ffff9688858c3380) has exports, disconnecting them 00000020:00080000:2.0:1780997310.868780:0:91763:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff968885ce1000), last request at 1780993693 00000020:00000080:2.0:1780997310.868783:0:91763:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0300e92e 00000020:00080000:2.0:1780997310.868797:0:91763:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff968885ce1000): rc 0 00000020:00000080:2.0:1780997310.868802:0:91763:0:(genops.c:906:class_export_put()) final put ffff968885ce1000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1780997310.869538:0:90819:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9688858f6800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1780997310.869548:0:90819:0:(genops.c:906:class_export_put()) final put ffff9688858f1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1780997310.869551:0:90819:0:(genops.c:865:class_export_destroy()) destroying export ffff9688858f1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1780997310.869558:0:90819:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1780997310.869652:0:90819:0:(genops.c:865:class_export_destroy()) destroying export ffff968885ce1000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1780997310.872483:0:91763:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1780997310.872499:0:91763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1780997310.872514:0:91763:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1780997310.872521:0:91763:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1780997310.872650:0:91763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780997310.872661:0:91763:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1780997310.872668:0:91763:0:(obd_mount.c:701:lustre_put_lsi()) put ffff968990f90000 1 00000020:00000080:3.0:1780997310.872673:0:91763:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x30fd811c0300e886 00000020:00000080:3.0:1780997310.872679:0:91763:0:(genops.c:906:class_export_put()) final put ffff9689bc9e6000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1780997310.872695:0:91763:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1780997310.872699:0:91763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780997310.872704:0:91763:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1780997310.872707:0:91763:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9689ba4e3380) has no exports 00000020:00000080:1.0:1780997310.872910:0:90819:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff968885ce5800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1780997310.872918:0:90819:0:(genops.c:906:class_export_put()) final put ffff9688858f4000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1780997310.872921:0:90819:0:(genops.c:865:class_export_destroy()) destroying export ffff9688858f4000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1780997310.872938:0:90819:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1780997310.873026:0:90819:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc9e6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1780997310.915408:0:91763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780997310.915427:0:91763:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1780997310.915432:0:91763:0:(genops.c:906:class_export_put()) final put ffff9689bc858800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1780997310.915437:0:91763:0:(genops.c:865:class_export_destroy()) destroying export ffff9689bc858800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1780997310.915449:0:91763:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1780997310.915597:0:91763:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9689bc85d000 00000020:02000400:3.0:1780997310.915671:0:91763:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1780997311.205534:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997312.230556:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997313.253759:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997313.445605:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507127044096:0@lo:400:kworker.0 00000100:00100000:0.0:1780997313.445699:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997313.445939:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127043968:0@lo:400:kworker.0 00000100:00100000:0.0:1780997313.445996:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127044608:0@lo:400:kworker.0 00000100:00100000:3.0:1780997313.446972:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127044352:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.453086:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507127044224:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.453169:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997313.453226:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507127044736:0@lo:400:kworker.0 00000100:00100000:2.0:1780997313.453249:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127044096 00000100:00100000:2.0:1780997313.453258:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127044096 00000100:00100000:2.0:1780997313.453339:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127044224 00000100:00100000:2.0:1780997313.453343:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127044224 00000100:00100000:1.0:1780997313.453357:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997313.453637:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507127045248:0@lo:400:kworker.0 00000100:00100000:2.0:1780997313.453980:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127044736 00000100:00100000:2.0:1780997313.453986:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127044736 00000100:00100000:2.0:1780997313.454022:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1780997313.454031:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507127044096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997313.458667:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:0.0:1780997313.458708:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507127044224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997313.458931:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507127044224:12345-0@lo:400:kworker.0 Request processed in 238us (5761us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997313.458939:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:0.0:1780997313.458966:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1780997313.458974:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507127044736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997313.459010:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507127044736:12345-0@lo:400:kworker.0 Request processed in 37us (5654us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997313.459015:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00080000:3.0:1780997313.459130:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997313.459136:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780997313.460014:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997313.460058:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127044608 00000100:00100000:0.0:1780997313.460068:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127044608 00000100:00100000:0.0:1780997313.460124:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714 00000100:00100000:0.0:1780997313.460133:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127044608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997313.460173:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127044608:12345-0@lo:400:kworker.0 Request processed in 43us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997313.460198:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714 00000100:00080000:0.0:1780997313.460215:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997313.460258:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127044608:0@lo:400:kworker.0 00000100:00100000:0.0:1780997313.460294:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127045120:0@lo:400:kworker.0 00000100:00100000:0.0:1780997313.460327:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997313.460351:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127045120 00000100:00100000:0.0:1780997313.460354:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127045120 00000100:00100000:0.0:1780997313.460388:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715 00000100:00100000:0.0:1780997313.460394:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127045120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997313.460423:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127045120:12345-0@lo:400:kworker.0 Request processed in 30us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997313.460429:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715 00000100:00080000:0.0:1780997313.460443:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997313.460461:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127045120:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.465874:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997313.465957:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507127044224:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.465973:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507127044736:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.466007:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127045248 00000100:00100000:1.0:1780997313.466013:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127045248 00000100:00100000:1.0:1780997313.466058:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1780997313.466067:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507127045248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.466132:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507127045248:12345-0@lo:400:kworker.0 Request processed in 66us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997313.466139:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1780997313.466173:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507127045248:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.466214:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997313.466238:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127043968 00000100:00100000:1.0:1780997313.466242:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127043968 00000100:00100000:1.0:1780997313.466282:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1780997313.466289:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3497:x1867507127043968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.466321:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3497:x1867507127043968:12345-0@lo:400:kworker.0 Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997313.466338:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1780997313.466394:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127043968:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.466407:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127044480:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.466442:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997313.466466:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127044480 00000100:00100000:1.0:1780997313.466470:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127044480 00000100:00100000:1.0:1780997313.466496:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6043 00000100:00100000:1.0:1780997313.466501:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3497:x1867507127044480:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780997313.466507:0:23044:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780997313.466534:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3497:x1867507127044480:12345-0@lo:400:kworker.0 Request processed in 32us (92us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780997313.466540:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6043 00000100:00080000:1.0:1780997313.466565:0:3497:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1780997313.466571:0:3497:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1780997313.466574:0:3497:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1780997313.466586:0:3497:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000100:00080000:1.0:1780997313.466589:0:3497:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997313.466593:0:3497:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2925 00000100:00080000:1.0:1780997313.466600:0:3497:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff968990cc0800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997313.466640:0:3497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689aebbad80 x1867507127045632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997313.466662:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127044480:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.466673:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aebbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127045632:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1780997313.466698:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997313.468896:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127045632 00000100:00100000:1.0:1780997313.468908:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127045632 00000100:00100000:1.0:1780997313.468953:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6044 00000100:00100000:1.0:1780997313.468960:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3495:x1867507127045632:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:1.0:1780997313.468987:0:25178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997313.469057:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3495:x1867507127045632:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 96us (2357us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997313.469065:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6044 00000100:00080000:1.0:1780997313.469102:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997313.469108:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997313.469111:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aebbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127045632:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1780997313.469134:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127044992:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.469169:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997313.469198:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127044992 00000100:00100000:1.0:1780997313.469201:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127044992 00000100:00100000:1.0:1780997313.469229:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6045 00000100:00100000:1.0:1780997313.469234:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3497:x1867507127044992:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780997313.469240:0:25170:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780997313.469264:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3497:x1867507127044992:12345-0@lo:400:kworker.0 Request processed in 30us (95us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780997313.469288:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6045 00000100:00080000:1.0:1780997313.469313:0:3497:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1780997313.469317:0:3497:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1780997313.469320:0:3497:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1780997313.469333:0:3497:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000100:00080000:1.0:1780997313.469335:0:3497:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997313.469350:0:3497:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3794 00000100:00080000:1.0:1780997313.469356:0:3497:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96888a815000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1780997313.469380:0:3497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689aebbb100 x1867507127045760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997313.469399:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127044992:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.469422:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aebbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507127045760:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1780997313.469447:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997313.469476:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127045504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997313.469508:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507127044096:12345-0@lo:400:kworker.0 Request processed in 15475us (23805us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997313.469511:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997313.469523:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1780997313.469543:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127045504 00000100:00100000:1.0:1780997313.469547:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127045504 00000100:00100000:2.0:1780997313.469573:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997313.469597:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127044864:0@lo:400:kworker.0 00000100:00100000:2.0:1780997313.469626:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997313.469704:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127045760 00000100:00100000:3.0:1780997313.469709:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127045760 00000100:00100000:3.0:1780997313.470842:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6046 00000100:00100000:3.0:1780997313.470850:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3495:x1867507127045760:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:3.0:1780997313.470871:0:25175:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997313.470926:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3495:x1867507127045760:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 75us (1477us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997313.470933:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6046 00000100:00100000:1.0:1780997313.471105:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127044352 00000100:00100000:1.0:1780997313.471112:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127044352 00000100:00100000:1.0:1780997313.471148:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4141 00000100:00100000:1.0:1780997313.471154:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3497:x1867507127045504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780997313.471188:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:1.0:1780997313.471231:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3497:x1867507127045504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997313.471238:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4141 00000100:00100000:1.0:1780997313.471255:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4142 00000100:00100000:1.0:1780997313.471260:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127044352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.471309:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127044352:12345-0@lo:400:kworker.0 Request processed in 49us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997313.471316:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4142 00000100:00080000:1.0:1780997313.471358:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997313.471372:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780997313.471377:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aebbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507127045760:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1780997313.471439:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127045504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780997313.471452:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780997313.471461:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127045376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997313.473374:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127044352:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.474975:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127044864 00000100:00100000:1.0:1780997313.474991:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127044864 00000100:00100000:1.0:1780997313.475042:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4143 00000100:00100000:1.0:1780997313.475054:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127044864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.475153:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127044864:12345-0@lo:400:kworker.0 Request processed in 102us (5526us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997313.475160:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4143 00000100:00100000:1.0:1780997313.475201:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997313.475230:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127045376 00000100:00100000:1.0:1780997313.475234:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127045376 00000100:00100000:1.0:1780997313.475256:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4144 00000100:00100000:1.0:1780997313.475263:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127045376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780997313.475308:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:1.0:1780997313.475345:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127045376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997313.475352:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4144 00000100:00100000:1.0:1780997313.475401:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127045376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780997313.475440:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127044864:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.480886:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507127044096:0@lo:400:kworker.0 00000100:00100000:1.0:1780997313.961148:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127045888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997313.961219:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997313.961305:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127045888 00000100:00100000:1.0:1780997313.961312:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127045888 00000100:00100000:1.0:1780997313.961358:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184 00000100:00100000:1.0:1780997313.961367:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127045888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780997313.961400:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780997313.961444:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127045888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997313.961451:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184 00000100:00100000:1.0:1780997313.961501:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127045888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1780997314.277848:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780997314.307780:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997314.307836:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997314.307867:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997314.307891:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997314.307916:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997314.307951:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110484864 00000100:00100000:0.0:1780997314.307960:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110484864 00000100:00100000:0.0:1780997314.308022:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110484736 00000100:00100000:0.0:1780997314.308025:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110484736 00000100:00100000:0.0:1780997314.308043:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2716 00000100:00100000:0.0:1780997314.308054:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110484864:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997314.308137:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110484864:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997314.308155:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2716 00000100:00100000:0.0:1780997314.308172:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6047 00000100:00100000:0.0:1780997314.308176:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2396:x1867507110484736:12345-192.168.206.51@tcp:400:kworker.0 00000020:00080000:0.0:1780997314.308183:0:25168:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.206.51@tcp 00000100:00100000:0.0:1780997314.308210:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2396:x1867507110484736:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (293us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780997314.308216:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6047 00000100:00100000:0.0:1780997314.308235:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110484608 00000100:00100000:0.0:1780997314.308238:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110484608 00000100:00100000:0.0:1780997314.308266:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110484480 00000100:00100000:0.0:1780997314.308300:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110484480 00000100:00100000:0.0:1780997314.308326:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1443 00000100:00100000:0.0:1780997314.308332:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+153:2396:x1867507110484608:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997314.308366:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+153:2396:x1867507110484608:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 34us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997314.308373:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1443 00000100:00100000:0.0:1780997314.308384:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1444 00000100:00100000:0.0:1780997314.308389:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2396:x1867507110484480:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997314.308411:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2396:x1867507110484480:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 21us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997314.308417:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1444 00000100:00100000:3.0:1780997314.308815:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110484352 00000100:00100000:3.0:1780997314.308820:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110484352 00000100:00100000:3.0:1780997314.308859:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00100000:3.0:1780997314.308866:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2396:x1867507110484352:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997314.308892:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2396:x1867507110484352:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997314.308897:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00080000:0.0:1780997314.309405:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780997314.309411:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780997314.309413:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780997314.317833:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997314.317892:0:25169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110484992 00000100:00100000:1.0:1780997314.317905:0:25169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110484992 00000100:00100000:1.0:1780997314.317951:0:25169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6048 00000100:00100000:1.0:1780997314.317959:0:25169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2393:x1867507110484992:12345-192.168.206.51@tcp:8:ptlrpcd_01_00.0 00010000:00020000:1.0:1780997314.317987:0:25169:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780997314.319731:0:25169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2393:x1867507110484992:12345-192.168.206.51@tcp:8:ptlrpcd_01_00.0 Request processed in 1752us (1899us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997314.319745:0:25169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6048 00000001:00080000:0.0:1780997314.478803:0:72364:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378913 is committed 00010000:00010000:1.0:1780997314.479085:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bfe8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479101:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bfe8 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479111:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bfe8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479125:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968888955a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.479131:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bfe8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479140:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bfe8 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479162:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff9689896fe500) 00010000:00010000:1.0:1780997314.479165:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.479172:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bfe8 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479179:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968888955a00/0x30fd811c0305bfe8 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479208:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfef lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479215:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfef lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479221:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfef lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479226:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bc4c0200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.479229:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfef lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479236:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfef lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479256:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff968983653e00) 00010000:00010000:1.0:1780997314.479259:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.479263:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfef lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479297:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bc4c0200/0x30fd811c0305bfef lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479312:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305c035 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479318:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305c035 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479324:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305c035 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479330:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f600 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.479332:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305c035 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479338:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305c035 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479344:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff968983653b00) 00010000:00010000:1.0:1780997314.479346:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.479349:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305c035 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479353:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f600/0x30fd811c0305c035 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479375:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305c082 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479381:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305c082 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479387:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305c082 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479393:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c8c00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.479396:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305c082 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479402:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305c082 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479409:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff968983653c00) 00010000:00010000:1.0:1780997314.479412:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.479414:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305c082 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479419:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c8c00/0x30fd811c0305c082 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479433:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c0b3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479438:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c0b3 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479444:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c0b3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479454:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956ee00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.479458:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c0b3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479464:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c0b3 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479476:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff968983653700) 00010000:00010000:1.0:1780997314.479478:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.479481:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c0b3 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479486:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956ee00/0x30fd811c0305c0b3 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479498:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c0f2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479503:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c0f2 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479508:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c0f2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479512:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.479514:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c0f2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479520:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c0f2 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479537:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff968983653200) 00010000:00010000:1.0:1780997314.479539:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.479543:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c0f2 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479548:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f000/0x30fd811c0305c0f2 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479559:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305c162 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479564:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305c162 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479568:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305c162 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479572:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956f800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.479575:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305c162 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479580:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305c162 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479586:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff968983653d00) 00010000:00010000:1.0:1780997314.479588:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.479591:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305c162 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479596:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956f800/0x30fd811c0305c162 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479614:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c169 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479620:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c169 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479625:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c169 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479629:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bb4eee00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.479631:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c169 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479637:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c169 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479644:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xe:0x0].0x0 (ffff96898d864f00) 00010000:00010000:1.0:1780997314.479646:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.479649:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c169 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479654:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bb4eee00/0x30fd811c0305c169 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479664:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305c1a8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479670:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305c1a8 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479675:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305c1a8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479685:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.479688:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305c1a8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479694:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305c1a8 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479702:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xf:0x0].0x0 (ffff968983653300) 00010000:00010000:1.0:1780997314.479704:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.479707:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305c1a8 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479712:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9200/0x30fd811c0305c1a8 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479727:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305c1fc lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479733:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305c1fc lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479738:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305c1fc lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479743:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.479746:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305c1fc lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479752:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305c1fc lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479768:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x10:0x0].0x0 (ffff96898d864b00) 00010000:00010000:1.0:1780997314.479771:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.479774:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305c1fc lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479780:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9000/0x30fd811c0305c1fc lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479816:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305c226 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479823:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305c226 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479828:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305c226 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479832:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.479835:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305c226 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479840:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305c226 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479847:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x11:0x0].0x0 (ffff96898d864200) 00010000:00010000:1.0:1780997314.479849:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.479852:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305c226 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479856:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e200/0x30fd811c0305c226 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479876:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3a00/0x30fd811c0305c26c lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479882:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3a00/0x30fd811c0305c26c lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479887:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3a00/0x30fd811c0305c26c lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479892:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce3a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.479895:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3a00/0x30fd811c0305c26c lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479900:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3a00/0x30fd811c0305c26c lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479907:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x13:0x0].0x0 (ffff96898712dc00) 00010000:00010000:1.0:1780997314.479909:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.479911:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3a00/0x30fd811c0305c26c lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479916:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce3a00/0x30fd811c0305c26c lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479925:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c2ab lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479930:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c2ab lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479935:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c2ab lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479945:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bff03000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.479947:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c2ab lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479952:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c2ab lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479959:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x12:0x0].0x0 (ffff96898d864000) 00010000:00010000:1.0:1780997314.479961:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.479964:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c2ab lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479970:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bff03000/0x30fd811c0305c2ab lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80049 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479980:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2200/0x30fd811c0305c2e3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479987:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2200/0x30fd811c0305c2e3 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479993:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2200/0x30fd811c0305c2e3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.479998:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968983ce2200 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.480000:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2200/0x30fd811c0305c2e3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480006:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2200/0x30fd811c0305c2e3 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480024:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x14:0x0].0x0 (ffff96898d864700) 00010000:00010000:1.0:1780997314.480027:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.480030:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2200/0x30fd811c0305c2e3 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480035:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968983ce2200/0x30fd811c0305c2e3 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480050:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6da000/0x30fd811c0305c38b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480057:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6da000/0x30fd811c0305c38b lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480063:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6da000/0x30fd811c0305c38b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480068:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6da000 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.480071:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6da000/0x30fd811c0305c38b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480077:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6da000/0x30fd811c0305c38b lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480084:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x16:0x0].0x0 (ffff96898712de00) 00010000:00010000:1.0:1780997314.480086:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.480089:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6da000/0x30fd811c0305c38b lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480094:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6da000/0x30fd811c0305c38b lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65272 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480116:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c392 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480121:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c392 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480127:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c392 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480132:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a56c9e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.480135:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c392 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480142:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c392 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480149:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x15:0x0].0x0 (ffff9689882bd000) 00010000:00010000:1.0:1780997314.480151:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.480153:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c392 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480159:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689a56c9e00/0x30fd811c0305c392 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480169:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c3d1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480174:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c3d1 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480180:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c3d1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480190:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96888956e800 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.480193:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c3d1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480200:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c3d1 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480208:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x18:0x0].0x0 (ffff96898712d900) 00010000:00010000:1.0:1780997314.480210:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.480214:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c3d1 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480219:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96888956e800/0x30fd811c0305c3d1 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480231:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305c402 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480238:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305c402 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480243:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305c402 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480248:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968980031a00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.480250:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305c402 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480256:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305c402 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480293:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x19:0x0].0x0 (ffff9689896fed00) 00010000:00010000:1.0:1780997314.480295:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.480298:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305c402 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480304:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff968980031a00/0x30fd811c0305c402 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480317:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dbe00/0x30fd811c0305c425 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480324:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dbe00/0x30fd811c0305c425 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480329:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dbe00/0x30fd811c0305c425 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480334:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96898d6dbe00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.480337:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dbe00/0x30fd811c0305c425 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480342:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dbe00/0x30fd811c0305c425 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480349:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x17:0x0].0x0 (ffff9689896fee00) 00010000:00010000:1.0:1780997314.480351:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.480354:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dbe00/0x30fd811c0305c425 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480359:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96898d6dbe00/0x30fd811c0305c425 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480380:0:3482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305c43a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480386:0:3482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305c43a lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480391:0:3482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305c43a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480396:0:3482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb3e00 already unused, calling callback (ffffffffc1b364f0) 00010000:00010000:1.0:1780997314.480399:0:3482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305c43a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480405:0:3482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305c43a lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480412:0:3482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1a:0x0].0x0 (ffff96898712d500) 00010000:00010000:1.0:1780997314.480415:0:3482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780997314.480417:0:3482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305c43a lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997314.480422:0:3482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9689bcbb3e00/0x30fd811c0305c43a lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63417 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780997314.985472:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127046016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997314.985556:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997314.985701:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127046016 00000100:00100000:0.0:1780997314.985710:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127046016 00000100:00100000:0.0:1780997314.985767:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185 00000100:00100000:0.0:1780997314.985777:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127046016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997314.985813:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997314.985859:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127046016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997314.985866:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185 00000100:00100000:1.0:1780997314.986187:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127046016:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780997315.303324:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997316.332059:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780997317.350629:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1780997317.675113:0:92091:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00010000:00010000:2.0:1780997318.385858:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997318.566242:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780997318.566263:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127046144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780997318.569966:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997318.570836:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127046272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997318.570899:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997318.570947:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127046144 00000100:00100000:2.0:1780997318.570956:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127046144 00000100:00100000:2.0:1780997318.571079:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127046272 00000100:00100000:2.0:1780997318.571083:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127046272 00000100:00100000:2.0:1780997318.571106:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4145 00000100:00100000:2.0:1780997318.571115:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127046144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780997318.571154:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:2.0:1780997318.571202:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127046144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997318.571225:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4145 00000100:00080000:0.0:1780997318.571257:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1780997318.571258:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4146 00000100:00080000:0.0:1780997318.571265:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1780997318.571288:0:36:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997318.571294:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3841 00000100:00080000:0.0:1780997318.571299:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1780997318.571305:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff968990cc0800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1780997318.571308:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3497:x1867507127046272:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997318.571328:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfaa8700 x1867507127046784/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780997318.571359:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997318.571362:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1780997318.571364:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780997318.571368:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3841 00000004:00000024:2.0:1780997318.571372:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00080000:0.0:1780997318.571372:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1780997318.571378:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96888a815000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1780997318.571793:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfaa9f80 x1867507127047168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997318.571833:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127046400:0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.571876:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997318.571904:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3497:x1867507127046272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 635us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997318.571912:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4146 00000100:00100000:0.0:1780997318.571940:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507127047040:0@lo:400:kworker.0 00000100:00100000:2.0:1780997318.571956:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127046912:0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.571972:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997318.571999:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1780997318.572005:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507127046528:0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.572031:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997318.572047:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127047296:0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.572069:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997318.572097:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507127046656:0@lo:400:kworker.0 00000100:00100000:2.0:1780997318.572118:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997318.572141:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997318.572169:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507127047424:0@lo:400:kworker.0 00000100:00100000:2.0:1780997318.572178:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127046272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780997318.572197:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997318.572200:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127046144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780997318.572233:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127046784:0@lo:8:kworker.0 00000100:00100000:0.0:1780997318.572260:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997318.572295:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507127047168:0@lo:8:kworker.0 00000100:00100000:0.0:1780997318.572319:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997318.572348:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127046400 00000100:00100000:0.0:1780997318.572353:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127046400 00000100:00100000:0.0:1780997318.572400:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1780997318.572408:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc4cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3498:x1867507127046400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.572450:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc4cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3498:x1867507127046400:12345-0@lo:400:kworker.0 Request processed in 42us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997318.572457:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1780997318.572487:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127047040 00000100:00100000:0.0:1780997318.572491:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127047040 00000100:00100000:0.0:1780997318.572523:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127046528 00000100:00100000:0.0:1780997318.572527:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127046528 00000100:00100000:0.0:1780997318.572556:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127046656 00000100:00100000:0.0:1780997318.572559:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127046656 00000100:00100000:2.0:1780997318.572563:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127047424 00000100:00100000:2.0:1780997318.572569:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127047424 00000100:00100000:0.0:1780997318.572576:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1780997318.572585:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507127047040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997318.572598:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1780997318.572607:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507127046528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.572623:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3498:x1867507127047040:12345-0@lo:400:kworker.0 Request processed in 39us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997318.572630:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1780997318.572651:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507127046528:12345-0@lo:400:kworker.0 Request processed in 45us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997318.572658:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1780997318.572693:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1780997318.572701:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507127046656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997318.572737:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507127046656:12345-0@lo:400:kworker.0 Request processed in 38us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997318.572743:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1780997318.572756:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1780997318.572772:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507127047424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997318.572804:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507127047424:12345-0@lo:400:kworker.0 Request processed in 42us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997318.572810:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:0.0:1780997318.573123:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127047296 00000100:00100000:0.0:1780997318.573128:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127047296 00000100:00100000:0.0:1780997318.573167:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127046912 00000100:00100000:0.0:1780997318.573171:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127046912 00000100:00100000:0.0:1780997318.573192:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127046784 00000100:00100000:0.0:1780997318.573195:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127046784 00000100:00100000:0.0:1780997318.573208:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127047168 00000100:00100000:0.0:1780997318.573211:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127047168 00000100:00100000:0.0:1780997318.573225:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717 00000100:00100000:0.0:1780997318.573231:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127047296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.573264:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127047296:12345-0@lo:400:kworker.0 Request processed in 33us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997318.573286:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717 00000100:00100000:0.0:1780997318.573298:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:0.0:1780997318.573304:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127046912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.573336:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127046912:12345-0@lo:400:kworker.0 Request processed in 32us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997318.573342:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:0.0:1780997318.573353:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6049 00000100:00100000:0.0:1780997318.573357:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3495:x1867507127046784:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1780997318.573381:0:25174:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997318.573426:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3495:x1867507127046784:12345-0@lo:8:kworker.0 Request processed in 67us (1166us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997318.573433:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6049 00000100:00100000:0.0:1780997318.573445:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6050 00000100:00100000:0.0:1780997318.573449:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3495:x1867507127047168:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1780997318.573457:0:25174:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780997318.573478:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3495:x1867507127047168:12345-0@lo:8:kworker.0 Request processed in 28us (1158us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997318.573483:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6050 00000100:00080000:0.0:1780997318.573524:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780997318.573528:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780997318.573529:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780997318.573565:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997318.573571:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997318.573575:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127046784:0@lo:8:kworker.0 00000100:00080000:0.0:1780997318.573582:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997318.573586:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780997318.573589:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507127047168:0@lo:8:kworker.0 00000100:00100000:0.0:1780997318.573621:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507127046656:0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.573635:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507127047424:0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.573676:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507127046528:0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.573690:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127047296:0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.573711:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127046400:0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.573722:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3498:1867507127047040:0@lo:400:kworker.0 00000100:00100000:0.0:1780997318.573752:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127046912:0@lo:400:kworker.0 00000100:00100000:2.0:1780997319.077501:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780997319.077525:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b11a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127047552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997319.077602:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997319.082087:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127047552 00000100:00100000:3.0:1780997319.082103:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127047552 00000100:00100000:2.0:1780997319.085193:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186 00000100:00100000:2.0:1780997319.085209:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127047552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780997319.085246:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780997319.085369:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127047552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (7766us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997319.085377:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186 00000100:00100000:3.0:1780997319.085481:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b11a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127047552:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1780997319.397554:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997319.436674:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997319.436814:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997319.436852:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997319.436905:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110485504 00000100:00100000:1.0:1780997319.436929:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110485504 00000100:00100000:3.0:1780997319.436939:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997319.436996:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6051 00000100:00100000:1.0:1780997319.437008:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2393:x1867507110485504:12345-192.168.206.51@tcp:8:kworker.0 00000100:00100000:3.0:1780997319.437020:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00020000:1.0:1780997319.437043:0:25170:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780997319.437089:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110485376 00000100:00100000:3.0:1780997319.437102:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110485376 00000100:00100000:1.0:1780997319.437158:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2393:x1867507110485504:12345-192.168.206.51@tcp:8:kworker.0 Request processed in 144us (336us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997319.437169:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6051 00000100:00100000:3.0:1780997319.437191:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110485248 00000100:00100000:1.0:1780997319.437195:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110485632 00000100:00100000:3.0:1780997319.437198:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110485248 00000100:00100000:1.0:1780997319.437205:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110485632 00000100:00100000:3.0:1780997319.437245:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1449 00000100:00100000:3.0:1780997319.437262:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2397:x1867507110485376:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997319.437318:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2719 00000100:00100000:1.0:1780997319.437339:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110485632:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997319.437386:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2397:x1867507110485376:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 127us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997319.437404:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1449 00000100:00100000:1.0:1780997319.437406:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2396:x1867507110485632:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 62us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997319.437421:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2719 00000100:00100000:3.0:1780997319.437450:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1450 00000100:00100000:3.0:1780997319.437463:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2397:x1867507110485248:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997319.437506:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2397:x1867507110485248:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997319.437514:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1450 00000100:00080000:3.0:1780997319.437565:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780997319.437574:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780997319.437577:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780997319.443616:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110485120 00000100:00100000:0.0:1780997319.443631:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110485120 00000100:00100000:0.0:1780997319.443697:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 182 00000100:00100000:0.0:1780997319.443711:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2397:x1867507110485120:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997319.443809:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2397:x1867507110485120:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 100us (7148us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997319.443819:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 182 00000020:00000040:0.0:1780997320.109313:0:72375:0:(genops.c:1231:class_import_get()) import ffff9689a69f7000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1780997320.109364:0:72375:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e7f8a350] to pc [ptlrpcd_00_02+2] req@ffff9689a5c47800 x1867507127047680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997320.110419:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689a5c47800 x1867507127047680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997320.110439:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127047680:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1780997320.110477:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689a5c47800 x1867507127047680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997336 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997320.110487:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997320.110525:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689b1163b80 x1867507127047680 msgsize 224 00000100:00100000:2.0:1780997320.110530:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780997320.110550:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689a5c47800 x1867507127047680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997336 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997320.110564:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5891 usecs (6 jiffies) 00000100:00100000:0.0:1780997320.110864:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127047680 00000100:00100000:0.0:1780997320.110872:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127047680 00000020:00000040:0.0:1780997320.110875:0:8234:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c030553a7 00000020:00000040:0.0:1780997320.110879:0:8234:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689ae564000 refcount=5 00000020:00000040:0.0:1780997320.110892:0:8234:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:0.0:1780997320.110923:0:8234:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1780997320.110957:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00000040:0.0:1780997320.110961:0:8234:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689ae564000 : new rpc_count 1 00000100:00000040:0.0:1780997320.110967:0:8234:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b1163b80 x1867507127047680/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:651/0 lens 224/0 e 0 to 0 dl 1780997331 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997320.110981:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127047680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780997320.111004:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:0.0:1780997320.111034:0:8234:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1867507127047680 00000100:00000040:0.0:1780997320.111045:0:8234:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:0.0:1780997320.111051:0:8234:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997320.111075:0:8234:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9689a5c47800 x1867507127047680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997336 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997320.111103:0:8234:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:0.0:1780997320.111109:0:8234:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1163b80 x1867507127047680/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:651/0 lens 224/368 e 0 to 0 dl 1780997331 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997320.111118:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127047680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997320.111126:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00000100:00000040:0.0:1780997320.111130:0:8234:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689ae564000 : new rpc_count 0 00000020:00000040:0.0:1780997320.111142:0:8234:0:(genops.c:900:class_export_put()) PUTting export ffff9689ae564000 : new refcount 4 00000100:00000040:0.0:1780997320.111172:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:0.0:1780997320.111178:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689a5c47800 x1867507127047680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1780997320.111189:0:3498:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:0.0:1780997320.111193:0:3498:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1780997320.111201:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a5c47800 x1867507127047680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997336 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997320.111209:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127047680:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1780997320.111216:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689a5c47800 x1867507127047680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997336 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997320.111226:0:3498:0:(genops.c:1244:class_import_put()) import ffff9689a69f7000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00080000:3.0:1780997320.111230:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1780997320.111236:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00010000:00010000:2.0:1780997320.422575:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997321.448416:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997322.477076:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997323.499834:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1780997323.686786:0:90256:0:(genops.c:1231:class_import_get()) import ffff9689869cf800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1780997323.686873:0:90256:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e7f8a350] to pc [ptlrpcd_00_03+3] req@ffff9689a5c47800 x1867507127047808/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997323.686916:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:0.0:1780997323.686933:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689a5c47800 x1867507127047808/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997323.687131:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997323.687144:0:90819:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000100:00000040:2.0:1780997323.687157:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS req@ffff9689b1163100 x1867507127047936/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997323.687171:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bd4c7d11] to pc [ptlrpcd_00_00+0] req@ffff9689b1163100 x1867507127047936/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997323.687194:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997323.687201:0:90819:0:(genops.c:1231:class_import_get()) import ffff9689bcdfb800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1780997323.687208:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9689b1161880 x1867507127048064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997323.687231:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000601df19] to pc [ptlrpcd_00_01+1] req@ffff9689b1161880 x1867507127048064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997323.687241:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997323.687250:0:90819:0:(genops.c:1231:class_import_get()) import ffff968885ce2000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1780997323.687258:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff96888b336a00 x1867507127048192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997323.687289:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008ba9200b] to pc [ptlrpcd_00_02+2] req@ffff96888b336a00 x1867507127048192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997323.687298:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997323.687304:0:90819:0:(genops.c:1231:class_import_get()) import ffff9689ae566000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1780997323.687311:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff96888b334a80 x1867507127048320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997323.687319:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c8320963] to pc [ptlrpcd_00_03+3] req@ffff96888b334a80 x1867507127048320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780997323.687327:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997323.687331:0:90819:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1780997323.687334:0:90819:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997323.687339:0:90819:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3846 00000100:00080000:2.0:1780997323.687345:0:90819:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00000040:2.0:1780997323.687347:0:90819:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 50 to 0@lo 00000100:00000040:2.0:1780997323.687351:0:90819:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 51 to 0@lo 00000020:00000040:2.0:1780997323.687355:0:90819:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c03055384 00000020:00000040:2.0:1780997323.687359:0:90819:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79cc800 refcount=4 00000100:00000040:2.0:1780997323.687362:0:90819:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 50 to 0@lo 00000100:00000040:2.0:1780997323.687371:0:90819:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 51 to 0@lo 00000020:00000040:2.0:1780997323.687373:0:90819:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79cc800 : new refcount 3 00000100:00080000:2.0:1780997323.687377:0:90819:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff968990cc0800 using connection 192.168.206.151@tcp/0@lo 00000020:00000040:2.0:1780997323.687389:0:90819:0:(genops.c:1231:class_import_get()) import ffff968990cc0800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1780997323.687403:0:90819:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96888b335c00 x1867507127048448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997323.687413:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ccaf4e95] to pc [ptlrpcd_rcv+-1] req@ffff96888b335c00 x1867507127048448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997323.687440:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997323.687447:0:90819:0:(genops.c:1231:class_import_get()) import ffff9689a69f7000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1780997323.687454:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff96888b336300 x1867507127048576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997323.687463:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000087c1f71d] to pc [ptlrpcd_00_00+0] req@ffff96888b336300 x1867507127048576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997323.687471:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997323.687486:0:90819:0:(genops.c:1231:class_import_get()) import ffff96888b416000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1780997323.687494:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff96888b337800 x1867507127048704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997323.687503:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d667619c] to pc [ptlrpcd_00_01+1] req@ffff96888b337800 x1867507127048704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997323.687509:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997323.687514:0:90819:0:(genops.c:1231:class_import_get()) import ffff9689869cf800 refcount=4 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1780997323.687519:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff96888b337480 x1867507127048832/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997323.687527:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003db7be35] to pc [ptlrpcd_00_02+2] req@ffff96888b337480 x1867507127048832/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780997323.687540:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997323.687544:0:90819:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1780997323.687545:0:90819:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997323.687549:0:90819:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3846 00000100:00080000:2.0:1780997323.687552:0:90819:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00000040:2.0:1780997323.687554:0:90819:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 50 to 0@lo 00000100:00000040:2.0:1780997323.687556:0:90819:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 51 to 0@lo 00000020:00000040:2.0:1780997323.687558:0:90819:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b537 00000020:00000040:2.0:1780997323.687560:0:90819:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689891ac800 refcount=4 00000100:00000040:2.0:1780997323.687563:0:90819:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 50 to 0@lo 00000100:00000040:2.0:1780997323.687565:0:90819:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 51 to 0@lo 00000020:00000040:2.0:1780997323.687567:0:90819:0:(genops.c:900:class_export_put()) PUTting export ffff9689891ac800 : new refcount 3 00000100:00080000:2.0:1780997323.687569:0:90819:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96888a815000 using connection 192.168.206.151@tcp/0@lo 00000020:00000040:2.0:1780997323.687575:0:90819:0:(genops.c:1231:class_import_get()) import ffff96888a815000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1780997323.687585:0:90819:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96888b334e00 x1867507127048960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997323.687593:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c52946cc] to pc [ptlrpcd_rcv+-1] req@ffff96888b334e00 x1867507127048960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997323.687599:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997323.687604:0:90819:0:(genops.c:1231:class_import_get()) import ffff968886bc8000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1780997323.687610:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff96888b335500 x1867507127049088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997323.687617:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cfd78720] to pc [ptlrpcd_00_03+3] req@ffff96888b335500 x1867507127049088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997323.687624:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997323.687635:0:90819:0:(genops.c:1231:class_import_get()) import ffff96898616b000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1780997323.687644:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff96888b334000 x1867507127049216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997323.687653:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000848c2bb] to pc [ptlrpcd_00_00+0] req@ffff96888b334000 x1867507127049216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997323.687664:0:90819:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (3856) 00000100:00100000:0.0:1780997323.687870:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a5c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127047808:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1780997323.687911:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689a5c47800 x1867507127047808/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997339 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.687920:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997323.688203:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689a5c44380 x1867507127047808 msgsize 224 00000100:00100000:0.0:1780997323.688220:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997323.688321:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689a5c47800 x1867507127047808/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997339 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.688342:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 7946 usecs (8 jiffies) 00000020:00000040:3.0:1780997323.688352:0:72371:0:(genops.c:1231:class_import_get()) import ffff9689ae566000 refcount=4 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1780997323.688369:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b336a00 x1867507127048192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997323.688385:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127048192:0@lo:400:kworker.0 00000100:00000040:0.0:1780997323.688411:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b336a00 x1867507127048192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.688418:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997323.688467:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689a5c46a00 x1867507127048192 msgsize 224 00000100:00100000:0.0:1780997323.688471:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997323.688494:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b336a00 x1867507127048192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.688530:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7833 usecs (8 jiffies) 00000100:00000040:0.0:1780997323.688538:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b337480 x1867507127048832/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997323.688567:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127048832:0@lo:400:kworker.0 00000100:00000040:0.0:1780997323.688582:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b337480 x1867507127048832/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.688588:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997323.688605:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689a5c47b80 x1867507127048832 msgsize 224 00000100:00100000:0.0:1780997323.688609:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997323.688628:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b337480 x1867507127048832/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.688637:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 7946 usecs (8 jiffies) 00000100:00100000:0.0:1780997323.688646:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:0.0:1780997323.688666:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b334a80 x1867507127048320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997323.688678:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127048320:0@lo:400:kworker.0 00000100:00000040:0.0:1780997323.689113:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b334a80 x1867507127048320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.689127:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997323.689149:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689a5c44700 x1867507127048320 msgsize 224 00000100:00100000:0.0:1780997323.689153:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997323.689179:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b334a80 x1867507127048320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.689191:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b335c00 x1867507127048448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.689195:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 961206 usecs (962 jiffies) 00000100:00000040:0.0:1780997323.689215:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b335500 x1867507127049088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.689223:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127048448:0@lo:8:kworker.0 00000100:00100000:0.0:1780997323.689241:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127049088:0@lo:400:kworker.0 00000100:00000040:1.0:1780997323.689266:0:3495:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b335c00 x1867507127048448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997343 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.689298:0:3495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.689337:0:3495:0:(events.c:343:request_in_callback()) incoming req@ffff9689b11a8000 x1867507127048448 msgsize 520 00000100:00100000:1.0:1780997323.689341:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997323.689368:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b335c00 x1867507127048448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997343 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.689382:0:3495:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5283 usecs (6 jiffies) 00000100:00000040:1.0:1780997323.689394:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b334e00 x1867507127048960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.689420:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507127048960:0@lo:8:kworker.0 00000100:00000040:1.0:1780997323.689631:0:3495:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b334e00 x1867507127048960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997343 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.689639:0:3495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.689655:0:3495:0:(events.c:343:request_in_callback()) incoming req@ffff9689b11a8380 x1867507127048960 msgsize 520 00000100:00100000:1.0:1780997323.689659:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997323.689673:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b334e00 x1867507127048960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997343 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.689682:0:3495:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8053 usecs (9 jiffies) 00000100:00000040:1.0:1780997323.689709:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1161880 x1867507127048064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.689719:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507127048064:0@lo:400:kworker.0 00000100:00000040:1.0:1780997323.689744:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b1161880 x1867507127048064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.689752:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.689769:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff9689ba185500 x1867507127048064 msgsize 224 00000100:00100000:1.0:1780997323.689773:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997323.689788:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1161880 x1867507127048064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.690046:0:3497:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8550 usecs (9 jiffies) 00000100:00000040:1.0:1780997323.690055:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b337800 x1867507127048704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.690065:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507127048704:0@lo:400:kworker.0 00000100:00000040:1.0:1780997323.690080:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b337800 x1867507127048704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.690100:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.690117:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff968988613100 x1867507127048704 msgsize 224 00000100:00100000:1.0:1780997323.690121:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997323.690141:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b337800 x1867507127048704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.690149:0:3497:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 139038 usecs (140 jiffies) 00000100:00100000:1.0:1780997323.690160:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00000040:1.0:1780997323.690165:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1163100 x1867507127047936/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.690174:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127047936:0@lo:400:kworker.0 00000100:00000040:1.0:1780997323.690189:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b1163100 x1867507127047936/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.690196:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.690219:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff968993693050 x1867507127047936 msgsize 224 00000100:00100000:1.0:1780997323.690223:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997323.690225:0:3497:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780997323.690239:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1163100 x1867507127047936/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.690293:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b336300 x1867507127048576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.690304:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127048576:0@lo:400:kworker.0 00000100:00000040:1.0:1780997323.690319:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b336300 x1867507127048576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.690326:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.690339:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff9689adbb5f80 x1867507127048576 msgsize 224 00000100:00100000:1.0:1780997323.690343:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997323.690357:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b336300 x1867507127048576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.690375:0:3497:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5881 usecs (6 jiffies) 00000100:00000040:1.0:1780997323.690382:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b334000 x1867507127049216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.690391:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507127049216:0@lo:400:kworker.0 00000100:00000040:1.0:1780997323.690405:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b334000 x1867507127049216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.690412:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.690674:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff9689adbb5880 x1867507127049216 msgsize 224 00000100:00100000:1.0:1780997323.690679:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997323.690698:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b334000 x1867507127049216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.690709:0:3497:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8880 usecs (9 jiffies) 00000100:00100000:1.0:1780997323.690744:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127048448 00000100:00100000:1.0:1780997323.690754:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127048448 00000020:00000040:1.0:1780997323.690758:0:25177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c03055399 00000100:00100000:1.0:1780997323.690868:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127048960 00000100:00100000:1.0:1780997323.690873:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127048960 00000020:00000040:1.0:1780997323.690875:0:25177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b53e 00000100:00100000:1.0:1780997323.690896:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127048576 00000100:00100000:1.0:1780997323.690899:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127048576 00000020:00000040:1.0:1780997323.690900:0:25177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c030553a7 00000020:00000040:1.0:1780997323.690904:0:25177:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689ae564000 refcount=5 00000020:00000040:1.0:1780997323.690920:0:25177:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:1.0:1780997323.690938:0:25177:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1780997323.690970:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00000040:1.0:1780997323.690976:0:25177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689ae564000 : new rpc_count 1 00000100:00000040:1.0:1780997323.690982:0:25177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689adbb5f80 x1867507127048576/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:654/0 lens 224/0 e 0 to 0 dl 1780997334 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.690995:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127048576:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780997323.691043:0:25177:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1867507127048576 00000100:00000040:1.0:1780997323.691058:0:25177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997323.691065:0:25177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.691085:0:25177:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff96888b336300 x1867507127048576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.691105:0:25177:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:1.0:1780997323.691109:0:25177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adbb5f80 x1867507127048576/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:654/0 lens 224/224 e 0 to 0 dl 1780997334 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.691117:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127048576:12345-0@lo:400:kworker.0 Request processed in 125us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997323.691125:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00000040:1.0:1780997323.691128:0:25177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689ae564000 : new rpc_count 0 00000020:00000040:1.0:1780997323.691139:0:25177:0:(genops.c:900:class_export_put()) PUTting export ffff9689ae564000 : new refcount 4 00000100:00100000:1.0:1780997323.691149:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6052 00000100:00000040:1.0:1780997323.691153:0:25177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b11a8000 x1867507127048448/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780997343 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.691160:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3495:x1867507127048448:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1780997323.691184:0:25177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1780997323.691197:0:25177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997323.691200:0:25177:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997323.691202:0:25177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.691217:0:25177:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff96888b335c00 x1867507127048448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997343 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.691233:0:25177:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:1.0:1780997323.691237:0:25177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b11a8000 x1867507127048448/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.691256:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3495:x1867507127048448:12345-0@lo:8:kworker.0 Request processed in 95us (1918us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997323.691263:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6052 00000100:00100000:1.0:1780997323.691298:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6053 00000100:00000040:1.0:1780997323.691302:0:25177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b11a8380 x1867507127048960/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780997343 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.691309:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3495:x1867507127048960:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1780997323.691320:0:25177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1780997323.691328:0:25177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997323.691330:0:25177:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997323.691333:0:25177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.691349:0:25177:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff96888b334e00 x1867507127048960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997343 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.691362:0:25177:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:1.0:1780997323.691365:0:25177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b11a8380 x1867507127048960/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.691373:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3495:x1867507127048960:12345-0@lo:8:kworker.0 Request processed in 63us (1716us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997323.691379:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6053 00000100:00100000:1.0:1780997323.691399:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127048192 00000100:00100000:1.0:1780997323.691403:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127048192 00000020:00000040:1.0:1780997323.691405:0:63419:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305541e 00000020:00000040:1.0:1780997323.691408:0:63419:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968983335800 refcount=5 00000020:00000040:1.0:1780997323.691418:0:63419:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9689ba680000) now 10 - evictor 00000100:00000040:1.0:1780997323.692124:0:63419:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1780997323.692158:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127048064 00000100:00100000:1.0:1780997323.692162:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127048064 00000020:00000040:1.0:1780997323.692172:0:63419:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b687 00000020:00000040:1.0:1780997323.692175:0:63419:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bfa9f000 refcount=5 00000020:00000040:1.0:1780997323.692186:0:63419:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff96888ac53380) now 14 - evictor 00000100:00100000:1.0:1780997323.692206:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127048704 00000100:00100000:1.0:1780997323.692210:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127048704 00000020:00000040:1.0:1780997323.692211:0:63419:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b68e 00000020:00000040:1.0:1780997323.692214:0:63419:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968986145800 refcount=5 00000100:00100000:1.0:1780997323.692226:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127049216 00000100:00100000:1.0:1780997323.692229:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127049216 00000020:00000040:1.0:1780997323.692230:0:63419:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b695 00000020:00000040:1.0:1780997323.692232:0:63419:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968983331000 refcount=5 00000100:00100000:1.0:1780997323.692246:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00000040:1.0:1780997323.692249:0:63419:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968983335800 : new rpc_count 1 00000100:00000040:1.0:1780997323.692253:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689a5c46a00 x1867507127048192/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:654/0 lens 224/0 e 0 to 0 dl 1780997334 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.692265:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127048192:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780997323.692303:0:63419:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127048192 00000100:00000040:1.0:1780997323.692309:0:63419:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997323.692313:0:63419:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.692341:0:63419:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff96888b336a00 x1867507127048192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.692357:0:63419:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:1.0:1780997323.692362:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a5c46a00 x1867507127048192/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:654/0 lens 224/224 e 0 to 0 dl 1780997334 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.692371:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127048192:12345-0@lo:400:kworker.0 Request processed in 108us (3902us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997323.692377:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00000040:1.0:1780997323.692380:0:63419:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968983335800 : new rpc_count 0 00000020:00000040:1.0:1780997323.692387:0:63419:0:(genops.c:900:class_export_put()) PUTting export ffff968983335800 : new refcount 4 00000100:00100000:1.0:1780997323.692404:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00000040:1.0:1780997323.692406:0:63419:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bfa9f000 : new rpc_count 1 00000100:00000040:1.0:1780997323.692411:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689ba185500 x1867507127048064/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:654/0 lens 224/0 e 0 to 0 dl 1780997334 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.692421:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507127048064:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780997323.692587:0:63419:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127048064 00000100:00000040:1.0:1780997323.692593:0:63419:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997323.692597:0:63419:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.692613:0:63419:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689b1161880 x1867507127048064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.692626:0:63419:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:1.0:1780997323.692630:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba185500 x1867507127048064/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:654/0 lens 224/224 e 0 to 0 dl 1780997334 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.692638:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507127048064:12345-0@lo:400:kworker.0 Request processed in 218us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997323.692644:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00000040:1.0:1780997323.692647:0:63419:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bfa9f000 : new rpc_count 0 00000020:00000040:1.0:1780997323.692652:0:63419:0:(genops.c:900:class_export_put()) PUTting export ffff9689bfa9f000 : new refcount 4 00000100:00100000:1.0:1780997323.692661:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00000040:1.0:1780997323.692663:0:63419:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968986145800 : new rpc_count 1 00000100:00000040:1.0:1780997323.692667:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968988613100 x1867507127048704/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:654/0 lens 224/0 e 0 to 0 dl 1780997334 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.692678:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3497:x1867507127048704:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780997323.692687:0:63419:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127048704 00000100:00000040:1.0:1780997323.692691:0:63419:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997323.692695:0:63419:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.692893:0:63419:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff96888b337800 x1867507127048704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.692923:0:63419:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:1.0:1780997323.692932:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968988613100 x1867507127048704/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:654/0 lens 224/224 e 0 to 0 dl 1780997334 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997323.692952:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127047808 00000100:00100000:1.0:1780997323.692955:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3497:x1867507127048704:12345-0@lo:400:kworker.0 Request processed in 277us (2834us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997323.692967:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00000040:1.0:1780997323.692971:0:63419:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968986145800 : new rpc_count 0 00000100:00100000:2.0:1780997323.692975:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127047808 00000020:00000040:2.0:1780997323.692980:0:8242:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b530 00000020:00000040:2.0:1780997323.692984:0:8242:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968889698800 refcount=5 00000020:00000040:1.0:1780997323.692986:0:63419:0:(genops.c:900:class_export_put()) PUTting export ffff968986145800 : new refcount 4 00000100:00100000:1.0:1780997323.693007:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00000040:1.0:1780997323.693011:0:63419:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968983331000 : new rpc_count 1 00000100:00000040:1.0:1780997323.693016:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689adbb5880 x1867507127049216/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:654/0 lens 224/0 e 0 to 0 dl 1780997334 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.693030:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507127049216:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1780997323.693033:0:8242:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00010000:00000040:1.0:1780997323.693054:0:63419:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127049216 00000100:00100000:2.0:1780997323.693063:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127048832 00000100:00000040:1.0:1780997323.693067:0:63419:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00100000:2.0:1780997323.693068:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127048832 00000020:00000040:2.0:1780997323.693072:0:8242:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b530 00000020:00000040:2.0:1780997323.693075:0:8242:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968889698800 refcount=6 00000100:00000040:1.0:1780997323.693076:0:63419:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1780997323.693100:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127048320 00000100:00000040:1.0:1780997323.693100:0:63419:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff96888b334000 x1867507127049216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997323.693105:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127048320 00000020:00000040:2.0:1780997323.693108:0:8242:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b4ea 00000020:00000040:2.0:1780997323.693112:0:8242:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79c9000 refcount=7 00000100:00000040:1.0:1780997323.693122:0:63419:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:1.0:1780997323.693128:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adbb5880 x1867507127049216/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:654/0 lens 224/224 e 0 to 0 dl 1780997334 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997323.693132:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4147 00000100:00000040:2.0:1780997323.693138:0:8242:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968889698800 : new rpc_count 1 00000100:00000040:2.0:1780997323.693147:0:8242:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689a5c44380 x1867507127047808/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:654/0 lens 224/0 e 0 to 0 dl 1780997334 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.693147:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507127049216:12345-0@lo:400:kworker.0 Request processed in 120us (2469us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997323.693163:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00000040:1.0:1780997323.693167:0:63419:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968983331000 : new rpc_count 0 00000100:00100000:2.0:1780997323.693172:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507127047808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780997323.693200:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00010000:00000040:2.0:1780997323.693210:0:8242:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127047808 00000100:00000040:2.0:1780997323.693215:0:8242:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:2.0:1780997323.693218:0:8242:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997323.693242:0:8242:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9689a5c47800 x1867507127047808/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997323.693476:0:63419:0:(genops.c:900:class_export_put()) PUTting export ffff968983331000 : new refcount 4 00000100:00080000:1.0:1780997323.693504:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1780997323.693509:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff96888ac53380) now 14 - evictor 00000100:00080000:1.0:1780997323.693512:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1780997323.693514:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9689ba680000) now 10 - evictor 00000100:00080000:1.0:1780997323.693517:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1780997323.693520:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:1.0:1780997323.693565:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b335c00 x1867507127048448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997343 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997323.693576:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997323.693581:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1780997323.693586:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b335c00 x1867507127048448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997343 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.693594:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127048448:0@lo:8:kworker.0 00000100:00000040:1.0:1780997323.693609:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b334e00 x1867507127048960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997343 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997323.693616:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780997323.693619:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1780997323.693622:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b334e00 x1867507127048960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997343 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.693629:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507127048960:0@lo:8:kworker.0 00000100:00000040:1.0:1780997323.693635:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b335c00 x1867507127048448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997343 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997323.693646:0:3495:0:(genops.c:1244:class_import_put()) import ffff968990cc0800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1780997323.693695:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b335500 x1867507127049088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.693718:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997323.693750:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689a5c47100 x1867507127049088 msgsize 224 00000100:00100000:0.0:1780997323.693755:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997323.693777:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b335500 x1867507127049088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997339 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.693788:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7403 usecs (8 jiffies) 00000100:00000040:0.0:1780997323.693810:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1780997323.693815:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b336a00 x1867507127048192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.693824:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b336a00 x1867507127048192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997323.693831:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127048192:0@lo:400:kworker.0 00000100:00000040:0.0:1780997323.693843:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1780997323.693847:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689a5c47800 x1867507127047808/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.693853:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b334e00 x1867507127048960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997343 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1780997323.693859:0:3498:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352898 avail=317195 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023661 state=0: rc = 0 00000100:00000040:0.0:1780997323.693871:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a5c47800 x1867507127047808/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997339 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997323.693878:0:3495:0:(genops.c:1244:class_import_put()) import ffff96888a815000 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1780997323.693883:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a5c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127047808:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1780997323.693891:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b336a00 x1867507127048192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997323.693901:0:3498:0:(genops.c:1244:class_import_put()) import ffff968885ce2000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1780997323.693910:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689a5c47800 x1867507127047808/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997339 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.693917:0:3497:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:1.0:1780997323.693925:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b336300 x1867507127048576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997323.693937:0:3498:0:(genops.c:1244:class_import_put()) import ffff9689869cf800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1780997323.693950:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b336300 x1867507127048576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.693958:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127048576:0@lo:400:kworker.0 00000100:00000040:1.0:1780997323.693972:0:3497:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1780997323.693977:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b334000 x1867507127049216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997323.693986:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4148 00000100:00000040:1.0:1780997323.693990:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b334000 x1867507127049216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.693993:0:8241:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968889698800 : new rpc_count 2 00000100:00000040:0.0:1780997323.694002:0:8241:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689a5c47b80 x1867507127048832/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:654/0 lens 224/0 e 0 to 0 dl 1780997334 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.694003:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507127049216:0@lo:400:kworker.0 00000100:00000040:1.0:1780997323.694021:0:3497:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00100000:0.0:1780997323.694022:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507127048832:12345-0@lo:400:kworker.0 00000100:00000040:1.0:1780997323.694028:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b1161880 x1867507127048064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.694038:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1161880 x1867507127048064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1780997323.694038:0:8241:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127048832 00000100:00000040:0.0:1780997323.694047:0:8241:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00100000:1.0:1780997323.694050:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507127048064:0@lo:400:kworker.0 00000100:00000040:0.0:1780997323.694056:0:8241:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.694064:0:3497:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1780997323.694070:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b337800 x1867507127048704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.694080:0:8241:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff96888b337480 x1867507127048832/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.694081:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b337800 x1867507127048704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.694098:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507127048704:0@lo:400:kworker.0 00000100:00000040:0.0:1780997323.694103:0:8241:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:1.0:1780997323.694107:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b336300 x1867507127048576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.694112:0:8241:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a5c47b80 x1867507127048832/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:654/0 lens 224/224 e 0 to 0 dl 1780997334 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997323.694125:0:3497:0:(genops.c:1244:class_import_put()) import ffff9689a69f7000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00100000:0.0:1780997323.694131:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3498:x1867507127048832:12345-0@lo:400:kworker.0 Request processed in 112us (5521us total) trans 0 rc 0/0 00000100:00000040:1.0:1780997323.694137:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b334000 x1867507127049216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997323.694141:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4148 00000100:00000040:0.0:1780997323.694147:0:8241:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968889698800 : new rpc_count 1 00000020:00000040:1.0:1780997323.694154:0:3497:0:(genops.c:1244:class_import_put()) import ffff96898616b000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000040:0.0:1780997323.694159:0:8241:0:(genops.c:900:class_export_put()) PUTting export ffff968889698800 : new refcount 5 00000100:00000040:1.0:1780997323.694163:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b1161880 x1867507127048064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997323.694172:0:3497:0:(genops.c:1244:class_import_put()) import ffff9689bcdfb800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00100000:0.0:1780997323.694173:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4149 00000100:00000040:0.0:1780997323.694178:0:8241:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689b79c9000 : new rpc_count 1 00000100:00000040:1.0:1780997323.694180:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b337800 x1867507127048704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.694185:0:8241:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689a5c44700 x1867507127048320/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:654/0 lens 224/0 e 0 to 0 dl 1780997334 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997323.694197:0:3497:0:(genops.c:1244:class_import_put()) import ffff96888b416000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00100000:0.0:1780997323.694206:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127048320:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780997323.694218:0:8241:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1867507127048320 00000100:00000040:0.0:1780997323.694234:0:8241:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:0.0:1780997323.694238:0:8241:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1780997323.694254:0:25168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127049088 00000100:00000040:0.0:1780997323.694258:0:8241:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff96888b334a80 x1867507127048320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.694262:0:25168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127049088 00000020:00000040:1.0:1780997323.694266:0:25168:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b55a 00000020:00000040:1.0:1780997323.694287:0:25168:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968886bcb000 refcount=5 00000020:00000040:1.0:1780997323.694298:0:25168:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:1.0:1780997323.694313:0:25168:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1780997323.694332:0:25168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00000040:1.0:1780997323.694335:0:25168:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968886bcb000 : new rpc_count 1 00000100:00000040:1.0:1780997323.694340:0:25168:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689a5c47100 x1867507127049088/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:654/0 lens 224/0 e 0 to 0 dl 1780997334 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.694351:0:25168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127049088:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780997323.694361:0:25168:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1867507127049088 00000100:00000040:1.0:1780997323.694366:0:25168:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 53 to 0@lo 00000100:00000040:1.0:1780997323.694376:0:25168:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.694392:0:25168:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff96888b335500 x1867507127049088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.694405:0:25168:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997323.694410:0:25168:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a5c47100 x1867507127049088/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:654/0 lens 224/224 e 0 to 0 dl 1780997334 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.694418:0:25168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127049088:12345-0@lo:400:kworker.0 Request processed in 68us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997323.694425:0:25168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000100:00000040:1.0:1780997323.694427:0:25168:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968886bcb000 : new rpc_count 0 00000020:00000040:1.0:1780997323.694433:0:25168:0:(genops.c:900:class_export_put()) PUTting export ffff968886bcb000 : new refcount 4 00000100:00080000:1.0:1780997323.694453:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1780997323.694456:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00100000:1.0:1780997323.694480:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127047936 00000100:00100000:1.0:1780997323.694485:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127047936 00000020:00000040:1.0:1780997323.694487:0:90246:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:1.0:1780997323.694490:0:90246:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=20 00000100:00000040:1.0:1780997323.694502:0:90246:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1780997323.694520:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00000040:1.0:1780997323.694524:0:90246:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:1.0:1780997323.694529:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968993693050 x1867507127047936/t0(0) o400->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:654/0 lens 224/0 e 0 to 0 dl 1780997334 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.694541:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3497:x1867507127047936:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780997323.694550:0:90246:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127047936 00000100:00000040:1.0:1780997323.694555:0:90246:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 53 to 0@lo 00000100:00000040:1.0:1780997323.694561:0:90246:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997323.694577:0:90246:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689b1163100 x1867507127047936/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.694592:0:90246:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997323.694603:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968993693050 x1867507127047936/t0(0) o400->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:654/0 lens 224/224 e 0 to 0 dl 1780997334 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.694612:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3497:x1867507127047936:12345-0@lo:400:kworker.0 Request processed in 72us (4390us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997323.694621:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00000040:3.0:1780997323.694622:0:72371:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009692571c] to pc [ptlrpcd_00_01+1] req@ffff9689bb55ce00 x1867507127049344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.694624:0:90246:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:1.0:1780997323.694630:0:90246:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 19 00000100:00100000:3.0:1780997323.694653:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:2.0:1780997323.694658:0:8242:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997323.694665:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bb55ce00 x1867507127049344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997323.694668:0:8242:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a5c44380 x1867507127047808/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:654/0 lens 224/368 e 0 to 0 dl 1780997334 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997323.694692:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127047808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1524us (6490us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997323.694694:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127049344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997323.694704:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4147 00000100:00000040:2.0:1780997323.694708:0:8242:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968889698800 : new rpc_count 0 00000020:00000040:2.0:1780997323.694718:0:8242:0:(genops.c:900:class_export_put()) PUTting export ffff968889698800 : new refcount 4 00000100:00000040:1.0:1780997323.694798:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b1163100 x1867507127047936/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.694807:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1163100 x1867507127047936/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.694813:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127047936:0@lo:400:kworker.0 00000100:00000040:1.0:1780997323.694818:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b1163100 x1867507127047936/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997323.694826:0:3497:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997323.695022:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bb55ce00 x1867507127049344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997339 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997323.695031:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997323.695050:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55ea00 x1867507127049344 msgsize 224 00000100:00100000:3.0:1780997323.695054:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997323.695474:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bb55ce00 x1867507127049344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997339 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997323.695488:0:3496:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 961206 usecs (962 jiffies) 00000100:00100000:2.0:1780997323.696162:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127049344 00000100:00100000:2.0:1780997323.696170:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127049344 00000020:00000040:2.0:1780997323.696172:0:23042:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b4ea 00000020:00000040:2.0:1780997323.696176:0:23042:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79c9000 refcount=8 00000100:00100000:2.0:1780997323.696222:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4150 00000100:00000040:2.0:1780997323.696225:0:23042:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689b79c9000 : new rpc_count 2 00000100:00000040:2.0:1780997323.696231:0:23042:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55ea00 x1867507127049344/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:654/0 lens 224/0 e 0 to 0 dl 1780997334 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997323.696244:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3496:x1867507127049344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780997323.696298:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00010000:00000040:2.0:1780997323.696308:0:23042:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1867507127049344 00000100:00000040:2.0:1780997323.696316:0:23042:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 53 to 0@lo 00000100:00000040:2.0:1780997323.696321:0:23042:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997323.696350:0:23042:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9689bb55ce00 x1867507127049344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997323.696372:0:23042:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:2.0:1780997323.696377:0:23042:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55ea00 x1867507127049344/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:654/0 lens 224/368 e 0 to 0 dl 1780997334 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997323.696401:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3496:x1867507127049344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997323.696408:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4150 00000100:00000040:2.0:1780997323.696411:0:23042:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689b79c9000 : new rpc_count 1 00000020:00000040:2.0:1780997323.696419:0:23042:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79c9000 : new refcount 7 00000100:00000040:2.0:1780997323.696453:0:3496:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:2.0:1780997323.696459:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bb55ce00 x1867507127049344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1780997323.696471:0:3496:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352839 avail=317136 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023597 state=0: rc = 0 00000100:00000040:2.0:1780997323.696481:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55ce00 x1867507127049344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997339 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997323.696487:0:8241:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00100000:2.0:1780997323.696492:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127049344:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1780997323.696500:0:8241:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a5c44700 x1867507127048320/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:654/0 lens 224/224 e 0 to 0 dl 1780997334 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997323.696502:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bb55ce00 x1867507127049344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997339 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780997323.696532:0:3496:0:(genops.c:1244:class_import_put()) import ffff9689ae566000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:0.0:1780997323.696533:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127048320:12345-0@lo:400:kworker.0 Request processed in 2329us (7379us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997323.696543:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4149 00000100:00000040:0.0:1780997323.696545:0:8241:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689b79c9000 : new rpc_count 0 00000020:00000040:0.0:1780997323.696555:0:8241:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79c9000 : new refcount 6 00000100:00000040:1.0:1780997323.702910:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:1.0:1780997323.702930:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b334a80 x1867507127048320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.702955:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b334a80 x1867507127048320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.702964:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127048320:0@lo:400:kworker.0 00000100:00000040:1.0:1780997323.702982:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:1.0:1780997323.702988:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b335500 x1867507127049088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.702996:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b335500 x1867507127049088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.703016:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127049088:0@lo:400:kworker.0 00000100:00000040:1.0:1780997323.703030:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1780997323.703034:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b337480 x1867507127048832/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997323.703042:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b337480 x1867507127048832/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997323.703050:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127048832:0@lo:400:kworker.0 00000100:00000040:1.0:1780997323.703057:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b334a80 x1867507127048320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997323.703071:0:3498:0:(genops.c:1244:class_import_put()) import ffff9689ae566000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1780997323.703080:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b335500 x1867507127049088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997323.703087:0:3498:0:(genops.c:1244:class_import_put()) import ffff968886bc8000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1780997323.703092:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b337480 x1867507127048832/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997323.703098:0:3498:0:(genops.c:1244:class_import_put()) import ffff9689869cf800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:3.0:1780997324.208177:0:90260:0:(genops.c:1231:class_import_get()) import ffff968886bc8000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1780997324.208248:0:90260:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a0878490] to pc [ptlrpcd_00_02+2] req@ffff9689bb55d880 x1867507127049472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997324.208360:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:2.0:1780997324.214240:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bb55d880 x1867507127049472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997324.214389:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127049472:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1780997324.214438:0:3499:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bb55d880 x1867507127049472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997340 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997324.214447:0:3499:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997324.214507:0:3499:0:(events.c:343:request_in_callback()) incoming req@ffff96888b335880 x1867507127049472 msgsize 224 00000100:00100000:2.0:1780997324.214513:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780997324.214613:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bb55d880 x1867507127049472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997340 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997324.214652:0:3499:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7875 usecs (8 jiffies) 00000100:00100000:1.0:1780997324.220241:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127049472 00000100:00100000:1.0:1780997324.220263:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127049472 00000020:00000040:1.0:1780997324.220267:0:85815:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b55a 00000020:00000040:1.0:1780997324.220563:0:85815:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968886bcb000 refcount=5 00000100:00000040:0.0:1780997324.220654:0:85815:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1780997324.220694:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00000040:0.0:1780997324.220700:0:85815:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968886bcb000 : new rpc_count 1 00000100:00000040:0.0:1780997324.220711:0:85815:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff96888b335880 x1867507127049472/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:655/0 lens 224/0 e 0 to 0 dl 1780997335 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997324.220727:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127049472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780997324.220787:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:0.0:1780997324.220803:0:85815:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1867507127049472 00000100:00000040:0.0:1780997324.220815:0:85815:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:0.0:1780997324.220823:0:85815:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997324.220902:0:85815:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9689bb55d880 x1867507127049472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997340 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997324.220943:0:85815:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:0.0:1780997324.220948:0:85815:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b335880 x1867507127049472/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:655/0 lens 224/368 e 0 to 0 dl 1780997335 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997324.220986:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127049472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 261us (6476us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997324.220993:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00000040:0.0:1780997324.220997:0:85815:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968886bcb000 : new rpc_count 0 00000020:00000040:0.0:1780997324.221008:0:85815:0:(genops.c:900:class_export_put()) PUTting export ffff968886bcb000 : new refcount 4 00000100:00000040:1.0:1780997324.221253:0:3499:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:1.0:1780997324.221263:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bb55d880 x1867507127049472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1780997324.221315:0:3499:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:1.0:1780997324.221319:0:3499:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:1.0:1780997324.221336:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55d880 x1867507127049472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997340 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997324.221343:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127049472:0@lo:13:osp-pre-1-0.0 00000100:00000040:1.0:1780997324.221352:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bb55d880 x1867507127049472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997340 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997324.221367:0:3499:0:(genops.c:1244:class_import_put()) import ffff968886bc8000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00010000:00010000:3.0:1780997324.523169:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1780997324.553829:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff968993691050 x1867507110485760 msgsize 224 00000100:00100000:0.0:1780997324.553856:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:0.0:1780997324.553859:0:3490:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1780997324.553917:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689a5c47800 x1867507110486016 msgsize 224 00000100:00100000:0.0:1780997324.553924:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997324.553979:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110485760 00000100:00100000:3.0:1780997324.554004:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110485760 00000100:00000040:0.0:1780997324.554007:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaae680 x1867507110485888 msgsize 224 00000020:00000040:3.0:1780997324.554009:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b47a 00000100:00100000:0.0:1780997324.554019:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000020:00000040:3.0:1780997324.554021:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff96888a811000 refcount=9 00000100:00000040:3.0:1780997324.554067:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780997324.554123:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 184 00000100:00000040:3.0:1780997324.554129:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff96888a811000 : new rpc_count 1 00000100:00000040:3.0:1780997324.554138:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968993691050 x1867507110485760/t0(0) o400->cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp:655/0 lens 224/0 e 0 to 0 dl 1780997335 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997324.554154:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110485760:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000040:3.0:1780997324.554177:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507110485760 00000100:00000040:3.0:1780997324.554189:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997324.554196:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997324.554267:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 8 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997324.554329:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968993691050 x1867507110485760/t0(0) o400->cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp:655/0 lens 224/224 e 0 to 0 dl 1780997335 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997324.554340:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110485760:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 187us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997324.554349:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 184 00000100:00000040:3.0:1780997324.554354:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff96888a811000 : new rpc_count 0 00000020:00000040:3.0:1780997324.554372:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff96888a811000 : new refcount 8 00000100:00000040:0.0:1780997324.559937:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaaf100 x1867507110486144 msgsize 520 00000100:00100000:0.0:1780997324.559961:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:0.0:1780997324.560001:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaaf800 x1867507110486272 msgsize 224 00000100:00100000:0.0:1780997324.560008:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997324.560047:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110486144 00000100:00100000:0.0:1780997324.560061:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110486144 00000020:00000040:0.0:1780997324.560066:0:9596:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b894 00000100:00100000:0.0:1780997324.560112:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110486272 00000100:00100000:0.0:1780997324.560116:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110486272 00000020:00000040:0.0:1780997324.560117:0:9596:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b89b 00000020:00000040:0.0:1780997324.560121:0:9596:0:(lustre_handles.c:131:class_handle2object()) GET export ffff96888b414800 refcount=7 00000020:00000040:0.0:1780997324.560141:0:9596:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:0.0:1780997324.560167:0:9596:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1780997324.560194:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2722 00000100:00000040:0.0:1780997324.560200:0:9596:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff96888b414800 : new rpc_count 1 00000100:00000040:0.0:1780997324.560210:0:9596:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaaf800 x1867507110486272/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:655/0 lens 224/0 e 0 to 0 dl 1780997335 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997324.560248:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110486272:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000040:0.0:1780997324.560312:0:9596:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507110486272 00000100:00000040:0.0:1780997324.560328:0:9596:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997324.560338:0:9596:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997324.560402:0:9596:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 8 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997324.560409:0:9596:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaaf800 x1867507110486272/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:655/0 lens 224/224 e 0 to 0 dl 1780997335 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997324.560420:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110486272:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 177us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997324.560428:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2722 00000100:00000040:0.0:1780997324.560432:0:9596:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff96888b414800 : new rpc_count 0 00000020:00000040:0.0:1780997324.560447:0:9596:0:(genops.c:900:class_export_put()) PUTting export ffff96888b414800 : new refcount 6 00000100:00100000:0.0:1780997324.560460:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6054 00000100:00000040:0.0:1780997324.560464:0:9596:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaaf100 x1867507110486144/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780997344 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997324.560474:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1867507110486144:12345-192.168.206.51@tcp:8:kworker.0 00010000:00020000:0.0:1780997324.560514:0:9596:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1780997324.560530:0:9596:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997324.560533:0:9596:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997324.560536:0:9596:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997324.560550:0:9596:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 8 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997324.560554:0:9596:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaaf100 x1867507110486144/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780997344 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997324.560563:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1867507110486144:12345-192.168.206.51@tcp:8:kworker.0 Request processed in 89us (629us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780997324.560577:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6054 00000100:00080000:0.0:1780997324.560631:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1780997324.560636:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00100000:2.0:1780997324.560859:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110486016 00000100:00100000:2.0:1780997324.560866:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110486016 00000020:00000040:2.0:1780997324.560869:0:63419:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305aafd 00000020:00000040:2.0:1780997324.560873:0:63419:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968994767800 refcount=51 00000020:00000040:2.0:1780997324.560886:0:63419:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9689ba680000) now 10 - evictor 00000100:00000040:2.0:1780997324.560907:0:63419:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1780997324.560933:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110485888 00000100:00100000:2.0:1780997324.560937:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110485888 00000020:00000040:2.0:1780997324.560938:0:63419:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b4f1 00000020:00000040:2.0:1780997324.560941:0:63419:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79cb000 refcount=11 00000020:00000040:2.0:1780997324.560948:0:63419:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff96888ac53380) now 14 - evictor 00000100:00100000:2.0:1780997324.560971:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1455 00000100:00000040:2.0:1780997324.560974:0:63419:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968994767800 : new rpc_count 1 00000100:00000040:2.0:1780997324.560980:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689a5c47800 x1867507110486016/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:655/0 lens 224/0 e 0 to 0 dl 1780997335 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997324.560993:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a5c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2395:x1867507110486016:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000040:2.0:1780997324.561009:0:63419:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 81604378913, transno 0, xid 1867507110486016 00000100:00000040:2.0:1780997324.561015:0:63419:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997324.561019:0:63419:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997324.561227:0:63419:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 8 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997324.561249:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a5c47800 x1867507110486016/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:655/0 lens 224/224 e 0 to 0 dl 1780997335 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997324.561263:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a5c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2395:x1867507110486016:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 272us (7343us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997324.561303:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1455 00000100:00000040:2.0:1780997324.561307:0:63419:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968994767800 : new rpc_count 0 00000020:00000040:2.0:1780997324.561335:0:63419:0:(genops.c:900:class_export_put()) PUTting export ffff968994767800 : new refcount 50 00000100:00100000:2.0:1780997324.561362:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1456 00000100:00000040:2.0:1780997324.561366:0:63419:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689b79cb000 : new rpc_count 1 00000100:00000040:2.0:1780997324.561371:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaae680 x1867507110485888/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:655/0 lens 224/0 e 0 to 0 dl 1780997335 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997324.561387:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2395:x1867507110485888:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000040:2.0:1780997324.561430:0:63419:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 120259084292, transno 0, xid 1867507110485888 00000100:00000040:2.0:1780997324.561442:0:63419:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997324.561448:0:63419:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997324.561468:0:63419:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 8 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997324.561473:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaae680 x1867507110485888/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:655/0 lens 224/224 e 0 to 0 dl 1780997335 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997324.561482:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2395:x1867507110485888:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 101us (7474us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997324.561488:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1456 00000100:00000040:2.0:1780997324.561490:0:63419:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689b79cb000 : new rpc_count 0 00000020:00000040:2.0:1780997324.561496:0:63419:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79cb000 : new refcount 10 00000100:00080000:2.0:1780997324.561517:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1780997324.561523:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff96888ac53380) now 14 - evictor 00000100:00080000:2.0:1780997324.561526:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1780997324.561528:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9689ba680000) now 10 - evictor 00000020:00000040:3.0:1780997325.230261:0:72375:0:(genops.c:1231:class_import_get()) import ffff9689a69f7000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1780997325.230551:0:72375:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005c6890f4] to pc [ptlrpcd_00_03+3] req@ffff9689bb55c700 x1867507127049600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997325.230872:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bb55c700 x1867507127049600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997325.230889:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127049600:0@lo:13:osp-pre-1-1.0 00000100:00000040:1.0:1780997325.230921:0:3499:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bb55c700 x1867507127049600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997341 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997325.230939:0:3499:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997325.230987:0:3499:0:(events.c:343:request_in_callback()) incoming req@ffff9689adbb6680 x1867507127049600 msgsize 224 00000100:00100000:1.0:1780997325.230993:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997325.231026:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bb55c700 x1867507127049600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997341 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997325.231040:0:3499:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5887 usecs (6 jiffies) 00000100:00100000:3.0:1780997325.231171:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127049600 00000100:00100000:3.0:1780997325.231178:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127049600 00000020:00000040:3.0:1780997325.231181:0:8234:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c030553a7 00000020:00000040:3.0:1780997325.231185:0:8234:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689ae564000 refcount=5 00000020:00000040:3.0:1780997325.231199:0:8234:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:3.0:1780997325.231227:0:8234:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1780997325.231253:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00000040:3.0:1780997325.231258:0:8234:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689ae564000 : new rpc_count 1 00000100:00000040:3.0:1780997325.231263:0:8234:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689adbb6680 x1867507127049600/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:656/0 lens 224/0 e 0 to 0 dl 1780997336 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997325.231302:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127049600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997325.231324:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1780997325.231334:0:8234:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1867507127049600 00000100:00000040:3.0:1780997325.231344:0:8234:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997325.231349:0:8234:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997325.231369:0:8234:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9689bb55c700 x1867507127049600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997341 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997325.231389:0:8234:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:3.0:1780997325.231395:0:8234:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adbb6680 x1867507127049600/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:656/0 lens 224/368 e 0 to 0 dl 1780997336 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997325.231403:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127049600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997325.231409:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00000040:3.0:1780997325.231413:0:8234:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689ae564000 : new rpc_count 0 00000020:00000040:3.0:1780997325.231422:0:8234:0:(genops.c:900:class_export_put()) PUTting export ffff9689ae564000 : new refcount 4 00000100:00000040:3.0:1780997325.231456:0:3499:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:3.0:1780997325.231461:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bb55c700 x1867507127049600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1780997325.231481:0:3499:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:3.0:1780997325.231484:0:3499:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:3.0:1780997325.231490:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55c700 x1867507127049600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997341 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997325.231497:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127049600:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1780997325.231502:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bb55c700 x1867507127049600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997341 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997325.231511:0:3499:0:(genops.c:1244:class_import_put()) import ffff9689a69f7000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00080000:1.0:1780997325.236404:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1780997325.236416:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00010000:00010000:0.0:1780997325.541897:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997326.573902:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997327.596750:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780997328.617387:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1780997328.807248:0:90256:0:(genops.c:1231:class_import_get()) import ffff9689869cf800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1780997328.807328:0:90256:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003db7be35] to pc [ptlrpcd_00_00+0] req@ffff96888b337480 x1867507127049728/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.807362:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b337480 x1867507127049728/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997328.807394:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127049728:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1780997328.807420:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b337480 x1867507127049728/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997344 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.807428:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997328.807467:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff96888b335500 x1867507127049728 msgsize 224 00000100:00100000:2.0:1780997328.807471:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780997328.807492:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b337480 x1867507127049728/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997344 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.807505:0:3496:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 8432 usecs (9 jiffies) 00000100:00100000:2.0:1780997328.807544:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127049728 00000100:00100000:2.0:1780997328.807551:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127049728 00000020:00000040:2.0:1780997328.807554:0:80061:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b530 00000020:00000040:2.0:1780997328.807558:0:80061:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968889698800 refcount=5 00000100:00000040:2.0:1780997328.807578:0:80061:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1780997328.807653:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4151 00000100:00000040:2.0:1780997328.807657:0:80061:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968889698800 : new rpc_count 1 00000100:00000040:2.0:1780997328.807662:0:80061:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff96888b335500 x1867507127049728/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:659/0 lens 224/0 e 0 to 0 dl 1780997339 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997328.807674:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888b335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127049728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780997328.807720:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00010000:00000040:2.0:1780997328.807731:0:80061:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127049728 00000100:00000040:2.0:1780997328.807741:0:80061:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:2.0:1780997328.807746:0:80061:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997328.807764:0:80061:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff96888b337480 x1867507127049728/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.807780:0:80061:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:2.0:1780997328.807784:0:80061:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b335500 x1867507127049728/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:659/0 lens 224/368 e 0 to 0 dl 1780997339 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997328.807798:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888b335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127049728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997328.807805:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4151 00000100:00000040:2.0:1780997328.807808:0:80061:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968889698800 : new rpc_count 0 00000020:00000040:2.0:1780997328.807817:0:80061:0:(genops.c:900:class_export_put()) PUTting export ffff968889698800 : new refcount 4 00000100:00000040:2.0:1780997328.807850:0:3496:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1780997328.807855:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b337480 x1867507127049728/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1780997328.807865:0:3496:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352898 avail=317195 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023661 state=0: rc = 0 00000100:00000040:2.0:1780997328.807872:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b337480 x1867507127049728/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997344 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997328.807880:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127049728:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1780997328.807886:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b337480 x1867507127049728/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997344 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780997328.807896:0:3496:0:(genops.c:1244:class_import_put()) import ffff9689869cf800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1780997328.808050:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997328.808058:0:90819:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000100:00000040:2.0:1780997328.808069:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS req@ffff96888b337480 x1867507127049856/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997328.808080:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003db7be35] to pc [ptlrpcd_00_01+1] req@ffff96888b337480 x1867507127049856/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808093:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997328.808099:0:90819:0:(genops.c:1231:class_import_get()) import ffff9689bcdfb800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1780997328.808105:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff96888b334a80 x1867507127049984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997328.808121:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c8320963] to pc [ptlrpcd_00_02+2] req@ffff96888b334a80 x1867507127049984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808135:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997328.808140:0:90819:0:(genops.c:1231:class_import_get()) import ffff968885ce2000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1780997328.808149:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff96888b337800 x1867507127050112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997328.808157:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d667619c] to pc [ptlrpcd_00_03+3] req@ffff96888b337800 x1867507127050112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808165:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997328.808170:0:90819:0:(genops.c:1231:class_import_get()) import ffff9689ae566000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1780997328.808176:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff96888b334000 x1867507127050240/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997328.808185:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000848c2bb] to pc [ptlrpcd_00_00+0] req@ffff96888b334000 x1867507127050240/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780997328.808193:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997328.808196:0:90819:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1780997328.808199:0:90819:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997328.808203:0:90819:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3851 00000100:00080000:2.0:1780997328.808208:0:90819:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00000040:2.0:1780997328.808211:0:90819:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 50 to 0@lo 00000100:00000040:2.0:1780997328.808213:0:90819:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 51 to 0@lo 00000020:00000040:2.0:1780997328.808215:0:90819:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c03055384 00000020:00000040:2.0:1780997328.808218:0:90819:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79cc800 refcount=4 00000100:00000040:2.0:1780997328.808221:0:90819:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 50 to 0@lo 00000100:00000040:2.0:1780997328.808228:0:90819:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 51 to 0@lo 00000020:00000040:2.0:1780997328.808230:0:90819:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79cc800 : new refcount 3 00000100:00080000:2.0:1780997328.808233:0:90819:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff968990cc0800 using connection 192.168.206.151@tcp/0@lo 00000020:00000040:2.0:1780997328.808243:0:90819:0:(genops.c:1231:class_import_get()) import ffff968990cc0800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1780997328.808253:0:90819:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96888b336300 x1867507127050368/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997328.808262:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000087c1f71d] to pc [ptlrpcd_rcv+-1] req@ffff96888b336300 x1867507127050368/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808302:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997328.808308:0:90819:0:(genops.c:1231:class_import_get()) import ffff9689a69f7000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1780997328.808316:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff96888b336a00 x1867507127050496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997328.808326:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008ba9200b] to pc [ptlrpcd_00_01+1] req@ffff96888b336a00 x1867507127050496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808333:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997328.808337:0:90819:0:(genops.c:1231:class_import_get()) import ffff96888b416000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1780997328.808343:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff96888b334e00 x1867507127050624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997328.808351:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c52946cc] to pc [ptlrpcd_00_02+2] req@ffff96888b334e00 x1867507127050624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780997328.808358:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780997328.808361:0:90819:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1780997328.808363:0:90819:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780997328.808367:0:90819:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3851 00000100:00080000:2.0:1780997328.808369:0:90819:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00000040:2.0:1780997328.808379:0:90819:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 50 to 0@lo 00000100:00000040:2.0:1780997328.808382:0:90819:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 51 to 0@lo 00000020:00000040:2.0:1780997328.808384:0:90819:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b537 00000020:00000040:2.0:1780997328.808386:0:90819:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689891ac800 refcount=4 00000100:00000040:2.0:1780997328.808389:0:90819:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 50 to 0@lo 00000100:00000040:2.0:1780997328.808391:0:90819:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 51 to 0@lo 00000020:00000040:2.0:1780997328.808393:0:90819:0:(genops.c:900:class_export_put()) PUTting export ffff9689891ac800 : new refcount 3 00000100:00080000:2.0:1780997328.808395:0:90819:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96888a815000 using connection 192.168.206.151@tcp/0@lo 00000020:00000040:2.0:1780997328.808401:0:90819:0:(genops.c:1231:class_import_get()) import ffff96888a815000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1780997328.808409:0:90819:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96888b335c00 x1867507127050752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997328.808418:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ccaf4e95] to pc [ptlrpcd_rcv+-1] req@ffff96888b335c00 x1867507127050752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808424:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997328.808429:0:90819:0:(genops.c:1231:class_import_get()) import ffff968886bc8000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1780997328.808436:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9689a568b480 x1867507127050880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997328.808443:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a501c9b7] to pc [ptlrpcd_00_03+3] req@ffff9689a568b480 x1867507127050880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808451:0:90819:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780997328.808455:0:90819:0:(genops.c:1231:class_import_get()) import ffff96898616b000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1780997328.808461:0:90819:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9689854b6d80 x1867507127051008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997328.808469:0:90819:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004c2e9e8b] to pc [ptlrpcd_00_00+0] req@ffff9689854b6d80 x1867507127051008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808477:0:90819:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (3861) 00000100:00000040:2.0:1780997328.808500:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b337480 x1867507127049856/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997328.808509:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127049856:0@lo:400:kworker.0 00000100:00000040:2.0:1780997328.808527:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b337480 x1867507127049856/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808534:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997328.808558:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff968993693450 x1867507127049856 msgsize 224 00000100:00100000:2.0:1780997328.808563:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780997328.808565:0:3497:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1780997328.808580:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b337480 x1867507127049856/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808603:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b336a00 x1867507127050496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997328.808611:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127050496:0@lo:400:kworker.0 00000100:00000040:2.0:1780997328.808624:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b336a00 x1867507127050496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808631:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997328.808646:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff9689854b6300 x1867507127050496 msgsize 224 00000100:00100000:2.0:1780997328.808650:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780997328.808662:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b336a00 x1867507127050496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808672:0:3497:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5873 usecs (6 jiffies) 00000100:00100000:2.0:1780997328.808682:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00000040:2.0:1780997328.808686:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b334000 x1867507127050240/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997328.808694:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127050240:0@lo:400:kworker.0 00000100:00000040:2.0:1780997328.808719:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b334000 x1867507127050240/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808733:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997328.808751:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff9689bff6f100 x1867507127050240 msgsize 224 00000100:00100000:2.0:1780997328.808755:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780997328.808767:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b334000 x1867507127050240/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808776:0:3497:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 955806 usecs (956 jiffies) 00000100:00000040:2.0:1780997328.808782:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689854b6d80 x1867507127051008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997328.808790:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689854b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507127051008:0@lo:400:kworker.0 00000100:00000040:2.0:1780997328.808804:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689854b6d80 x1867507127051008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808811:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997328.808825:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff9689bff6c700 x1867507127051008 msgsize 224 00000100:00100000:2.0:1780997328.808829:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780997328.808842:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689854b6d80 x1867507127051008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997328.808851:0:3497:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8797 usecs (9 jiffies) 00000100:00000040:3.0:1780997328.810393:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b337800 x1867507127050112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.810410:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507127050112:0@lo:400:kworker.0 00000100:00000040:3.0:1780997328.810437:0:3499:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b337800 x1867507127050112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.810445:0:3499:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.810477:0:3499:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55c700 x1867507127050112 msgsize 224 00000100:00100000:3.0:1780997328.810482:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997328.810504:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b337800 x1867507127050112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.810515:0:3499:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7833 usecs (8 jiffies) 00000100:00000040:3.0:1780997328.810524:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689a568b480 x1867507127050880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.810534:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127050880:0@lo:400:kworker.0 00000100:00000040:3.0:1780997328.810557:0:3499:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689a568b480 x1867507127050880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.810563:0:3499:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.810578:0:3499:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55df80 x1867507127050880 msgsize 224 00000100:00100000:3.0:1780997328.810582:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997328.810595:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689a568b480 x1867507127050880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.810604:0:3499:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8195 usecs (9 jiffies) 00000100:00100000:3.0:1780997328.810616:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00000040:3.0:1780997328.810622:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b334a80 x1867507127049984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.810631:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507127049984:0@lo:400:kworker.0 00000100:00000040:3.0:1780997328.810642:0:3499:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b334a80 x1867507127049984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.810649:0:3499:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.810661:0:3499:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55c000 x1867507127049984 msgsize 224 00000100:00100000:3.0:1780997328.810664:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997328.810680:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b334a80 x1867507127049984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.810689:0:3499:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8550 usecs (9 jiffies) 00000100:00000040:3.0:1780997328.810695:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b334e00 x1867507127050624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.810703:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507127050624:0@lo:400:kworker.0 00000100:00000040:3.0:1780997328.810729:0:3499:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b334e00 x1867507127050624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.810736:0:3499:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.810747:0:3499:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55f480 x1867507127050624 msgsize 224 00000100:00100000:3.0:1780997328.810756:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997328.810772:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b334e00 x1867507127050624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.810781:0:3499:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 138395 usecs (139 jiffies) 00000100:00100000:3.0:1780997328.810807:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127051008 00000100:00100000:3.0:1780997328.810815:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127051008 00000020:00000040:3.0:1780997328.810818:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b695 00000020:00000040:3.0:1780997328.810822:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968983331000 refcount=5 00000100:00000040:3.0:1780997328.810842:0:63417:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1780997328.810866:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127050112 00000100:00100000:3.0:1780997328.810869:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127050112 00000020:00000040:3.0:1780997328.810871:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305541e 00000020:00000040:3.0:1780997328.810873:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968983335800 refcount=5 00000020:00000040:3.0:1780997328.810883:0:63417:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9689ba680000) now 10 - evictor 00000100:00100000:3.0:1780997328.810905:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127049984 00000100:00100000:3.0:1780997328.810908:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127049984 00000020:00000040:3.0:1780997328.810909:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b687 00000020:00000040:3.0:1780997328.810911:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bfa9f000 refcount=5 00000020:00000040:3.0:1780997328.810917:0:63417:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff96888ac53380) now 14 - evictor 00000100:00100000:3.0:1780997328.810928:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127050624 00000100:00100000:3.0:1780997328.810931:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127050624 00000020:00000040:3.0:1780997328.810932:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b68e 00000020:00000040:3.0:1780997328.810934:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968986145800 refcount=5 00000100:00100000:3.0:1780997328.810949:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00000040:3.0:1780997328.810953:0:63417:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968983331000 : new rpc_count 1 00000100:00000040:3.0:1780997328.810958:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bff6c700 x1867507127051008/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:659/0 lens 224/0 e 0 to 0 dl 1780997339 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.810970:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507127051008:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997328.810990:0:63417:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127051008 00000100:00000040:3.0:1780997328.811000:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997328.811011:0:63417:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.811031:0:63417:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689854b6d80 x1867507127051008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.811052:0:63417:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:3.0:1780997328.811057:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bff6c700 x1867507127051008/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.811066:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507127051008:12345-0@lo:400:kworker.0 Request processed in 98us (2238us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997328.811073:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00000040:3.0:1780997328.811076:0:63417:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968983331000 : new rpc_count 0 00000020:00000040:3.0:1780997328.811086:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff968983331000 : new refcount 4 00000100:00100000:3.0:1780997328.811096:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00000040:3.0:1780997328.811098:0:63417:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968983335800 : new rpc_count 1 00000100:00000040:3.0:1780997328.811102:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55c700 x1867507127050112/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:659/0 lens 224/0 e 0 to 0 dl 1780997339 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.811113:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507127050112:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997328.811123:0:63417:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127050112 00000100:00000040:3.0:1780997328.811127:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997328.811130:0:63417:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.811143:0:63417:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff96888b337800 x1867507127050112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.811159:0:63417:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:3.0:1780997328.811163:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55c700 x1867507127050112/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.811170:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3499:x1867507127050112:12345-0@lo:400:kworker.0 Request processed in 60us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997328.811176:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00000040:3.0:1780997328.811185:0:63417:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968983335800 : new rpc_count 0 00000020:00000040:3.0:1780997328.811191:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff968983335800 : new refcount 4 00000100:00100000:3.0:1780997328.811201:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00000040:3.0:1780997328.811203:0:63417:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bfa9f000 : new rpc_count 1 00000100:00000040:3.0:1780997328.811208:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55c000 x1867507127049984/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:659/0 lens 224/0 e 0 to 0 dl 1780997339 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.811217:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507127049984:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997328.811226:0:63417:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127049984 00000100:00000040:3.0:1780997328.811231:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997328.811234:0:63417:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.811298:0:63417:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff96888b334a80 x1867507127049984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.811310:0:63417:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:3.0:1780997328.811314:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55c000 x1867507127049984/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.811320:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507127049984:12345-0@lo:400:kworker.0 Request processed in 105us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997328.811325:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00000040:3.0:1780997328.811327:0:63417:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bfa9f000 : new rpc_count 0 00000020:00000040:3.0:1780997328.811332:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff9689bfa9f000 : new refcount 4 00000100:00100000:3.0:1780997328.811340:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00000040:3.0:1780997328.811343:0:63417:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968986145800 : new rpc_count 1 00000100:00000040:3.0:1780997328.811346:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55f480 x1867507127050624/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:659/0 lens 224/0 e 0 to 0 dl 1780997339 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.811356:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507127050624:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997328.811364:0:63417:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127050624 00000100:00000040:3.0:1780997328.811374:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997328.811378:0:63417:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.811393:0:63417:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff96888b334e00 x1867507127050624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.811404:0:63417:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:3.0:1780997328.811408:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55f480 x1867507127050624/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.811416:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507127050624:12345-0@lo:400:kworker.0 Request processed in 63us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997328.811422:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00000040:3.0:1780997328.811425:0:63417:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968986145800 : new rpc_count 0 00000020:00000040:3.0:1780997328.811431:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff968986145800 : new refcount 4 00000100:00080000:3.0:1780997328.811457:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1780997328.811462:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff96888ac53380) now 14 - evictor 00000100:00080000:3.0:1780997328.811465:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1780997328.811467:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9689ba680000) now 10 - evictor 00000100:00000040:3.0:1780997328.811503:0:3497:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1780997328.811509:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689854b6d80 x1867507127051008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.811519:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689854b6d80 x1867507127051008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.811525:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689854b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507127051008:0@lo:400:kworker.0 00000100:00000040:3.0:1780997328.811532:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689854b6d80 x1867507127051008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997328.811542:0:3497:0:(genops.c:1244:class_import_put()) import ffff96898616b000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1780997328.811648:0:3499:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1780997328.811654:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b334a80 x1867507127049984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.811669:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b334a80 x1867507127049984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.811676:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507127049984:0@lo:400:kworker.0 00000100:00000040:3.0:1780997328.811688:0:3499:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:3.0:1780997328.811693:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b334e00 x1867507127050624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.811700:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b334e00 x1867507127050624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.811719:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507127050624:0@lo:400:kworker.0 00000100:00000040:3.0:1780997328.811730:0:3499:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1780997328.811734:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b337800 x1867507127050112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.811742:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b337800 x1867507127050112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.811748:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3499:1867507127050112:0@lo:400:kworker.0 00000100:00000040:3.0:1780997328.811754:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b334a80 x1867507127049984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997328.811762:0:3499:0:(genops.c:1244:class_import_put()) import ffff9689bcdfb800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1780997328.811769:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b334e00 x1867507127050624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997328.811776:0:3499:0:(genops.c:1244:class_import_put()) import ffff96888b416000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1780997328.811782:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b337800 x1867507127050112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997328.811801:0:3499:0:(genops.c:1244:class_import_put()) import ffff968885ce2000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1780997328.811853:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b336300 x1867507127050368/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.811864:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127050368:0@lo:8:kworker.0 00000100:00000040:3.0:1780997328.811882:0:3495:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b336300 x1867507127050368/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997353 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.811888:0:3495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.811902:0:3495:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55ed80 x1867507127050368 msgsize 520 00000100:00100000:3.0:1780997328.811906:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997328.811921:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b336300 x1867507127050368/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997353 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.811932:0:3495:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5290 usecs (6 jiffies) 00000100:00000040:3.0:1780997328.811940:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888b335c00 x1867507127050752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.811949:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888b335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507127050752:0@lo:8:kworker.0 00000100:00000040:3.0:1780997328.811961:0:3495:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888b335c00 x1867507127050752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997353 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.811968:0:3495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.811978:0:3495:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55d180 x1867507127050752 msgsize 520 00000100:00100000:3.0:1780997328.811982:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997328.811994:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888b335c00 x1867507127050752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997353 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.812002:0:3495:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8031 usecs (9 jiffies) 00000100:00100000:3.0:1780997328.812023:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127050496 00000100:00100000:3.0:1780997328.812028:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127050496 00000020:00000040:3.0:1780997328.812030:0:25181:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c030553a7 00000020:00000040:3.0:1780997328.812032:0:25181:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689ae564000 refcount=5 00000020:00000040:3.0:1780997328.812047:0:25181:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:3.0:1780997328.812062:0:25181:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1780997328.812077:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127050880 00000100:00100000:3.0:1780997328.812080:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127050880 00000020:00000040:3.0:1780997328.812082:0:25181:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b55a 00000020:00000040:3.0:1780997328.812084:0:25181:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968886bcb000 refcount=5 00000100:00100000:3.0:1780997328.812101:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127050368 00000100:00100000:3.0:1780997328.812105:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127050368 00000020:00000040:3.0:1780997328.812106:0:25181:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c03055399 00000100:00100000:3.0:1780997328.812119:0:25181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127050752 00000100:00100000:3.0:1780997328.812121:0:25181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127050752 00000020:00000040:3.0:1780997328.812123:0:25181:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b53e 00000100:00100000:3.0:1780997328.812136:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723 00000100:00000040:3.0:1780997328.812139:0:25181:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689ae564000 : new rpc_count 1 00000100:00000040:3.0:1780997328.812143:0:25181:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689854b6300 x1867507127050496/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:659/0 lens 224/0 e 0 to 0 dl 1780997339 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.812153:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689854b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127050496:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997328.812164:0:25181:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1867507127050496 00000100:00000040:3.0:1780997328.812169:0:25181:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997328.812173:0:25181:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.812189:0:25181:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff96888b336a00 x1867507127050496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.812207:0:25181:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:3.0:1780997328.812211:0:25181:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689854b6300 x1867507127050496/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.812219:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689854b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127050496:12345-0@lo:400:kworker.0 Request processed in 68us (3572us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997328.812226:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723 00000100:00000040:3.0:1780997328.812228:0:25181:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689ae564000 : new rpc_count 0 00000020:00000040:3.0:1780997328.812241:0:25181:0:(genops.c:900:class_export_put()) PUTting export ffff9689ae564000 : new refcount 4 00000100:00100000:3.0:1780997328.812251:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00000040:3.0:1780997328.812253:0:25181:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968886bcb000 : new rpc_count 1 00000100:00000040:3.0:1780997328.812257:0:25181:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55df80 x1867507127050880/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:659/0 lens 224/0 e 0 to 0 dl 1780997339 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.812267:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127050880:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997328.812308:0:25181:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1867507127050880 00000100:00000040:3.0:1780997328.812313:0:25181:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997328.812316:0:25181:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.812333:0:25181:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689a568b480 x1867507127050880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.812350:0:25181:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:3.0:1780997328.812354:0:25181:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55df80 x1867507127050880/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.812362:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127050880:12345-0@lo:400:kworker.0 Request processed in 97us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997328.812368:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00000040:3.0:1780997328.812370:0:25181:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968886bcb000 : new rpc_count 0 00000020:00000040:3.0:1780997328.812375:0:25181:0:(genops.c:900:class_export_put()) PUTting export ffff968886bcb000 : new refcount 4 00000100:00100000:3.0:1780997328.812383:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6055 00000100:00000040:3.0:1780997328.812387:0:25181:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55ed80 x1867507127050368/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780997348 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.812394:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3495:x1867507127050368:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1780997328.812414:0:25181:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1780997328.812425:0:25181:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997328.812427:0:25181:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997328.812437:0:25181:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.812451:0:25181:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff96888b336300 x1867507127050368/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.812466:0:25181:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:3.0:1780997328.812470:0:25181:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55ed80 x1867507127050368/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780997348 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.812477:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3495:x1867507127050368:12345-0@lo:8:kworker.0 Request processed in 83us (573us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997328.812483:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6055 00000100:00100000:3.0:1780997328.812495:0:25181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6056 00000100:00000040:3.0:1780997328.812498:0:25181:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55d180 x1867507127050752/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780997348 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.812505:0:25181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3495:x1867507127050752:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1780997328.812516:0:25181:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1780997328.812523:0:25181:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997328.812526:0:25181:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997328.812528:0:25181:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.812541:0:25181:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff96888b335c00 x1867507127050752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.812552:0:25181:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:3.0:1780997328.812555:0:25181:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55d180 x1867507127050752/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780997348 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.812562:0:25181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3495:x1867507127050752:12345-0@lo:8:kworker.0 Request processed in 56us (582us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780997328.812567:0:25181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6056 00000100:00080000:3.0:1780997328.812600:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1780997328.812603:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:3.0:1780997328.812633:0:3497:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:3.0:1780997328.812638:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b336a00 x1867507127050496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.812646:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b336a00 x1867507127050496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.812652:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127050496:0@lo:400:kworker.0 00000100:00000040:3.0:1780997328.812657:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b336a00 x1867507127050496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997328.812664:0:3497:0:(genops.c:1244:class_import_put()) import ffff9689a69f7000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1780997328.812686:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b336300 x1867507127050368/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997328.812695:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997328.812700:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1780997328.812716:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b336300 x1867507127050368/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997353 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.812724:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127050368:0@lo:8:kworker.0 00000100:00000040:3.0:1780997328.812735:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b335c00 x1867507127050752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997328.812741:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780997328.812744:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1780997328.812747:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b335c00 x1867507127050752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997353 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.812753:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507127050752:0@lo:8:kworker.0 00000100:00000040:3.0:1780997328.812757:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b336300 x1867507127050368/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997353 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997328.812771:0:3495:0:(genops.c:1244:class_import_put()) import ffff968990cc0800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1780997328.812777:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b335c00 x1867507127050752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997353 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997328.812783:0:3495:0:(genops.c:1244:class_import_put()) import ffff96888a815000 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1780997328.812806:0:3499:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:3.0:1780997328.812811:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689a568b480 x1867507127050880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.812817:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a568b480 x1867507127050880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.812824:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127050880:0@lo:400:kworker.0 00000100:00000040:3.0:1780997328.812828:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689a568b480 x1867507127050880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997328.812835:0:3499:0:(genops.c:1244:class_import_put()) import ffff968886bc8000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00100000:3.0:1780997328.812896:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127049856 00000100:00100000:3.0:1780997328.812901:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127049856 00000020:00000040:3.0:1780997328.812903:0:90246:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:3.0:1780997328.812905:0:90246:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=20 00000100:00000040:3.0:1780997328.812917:0:90246:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780997328.812934:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00000040:3.0:1780997328.812937:0:90246:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:3.0:1780997328.812941:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968993693450 x1867507127049856/t0(0) o400->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:659/0 lens 224/0 e 0 to 0 dl 1780997339 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.812952:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3497:x1867507127049856:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997328.812962:0:90246:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127049856 00000100:00000040:3.0:1780997328.812966:0:90246:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997328.812969:0:90246:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997328.812995:0:90246:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff96888b337480 x1867507127049856/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.813011:0:90246:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:3.0:1780997328.813016:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968993693450 x1867507127049856/t0(0) o400->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:659/0 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.813024:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:3497:x1867507127049856:12345-0@lo:400:kworker.0 Request processed in 74us (4464us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997328.813030:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00000040:3.0:1780997328.813032:0:90246:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:3.0:1780997328.813038:0:90246:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 19 00000100:00000040:3.0:1780997328.813068:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b337480 x1867507127049856/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.813076:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b337480 x1867507127049856/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.813083:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3497:1867507127049856:0@lo:400:kworker.0 00000100:00000040:3.0:1780997328.813089:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b337480 x1867507127049856/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997328.813097:0:3497:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000020:00000040:0.0:1780997328.813226:0:72371:0:(genops.c:1231:class_import_get()) import ffff9689ae566000 refcount=4 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1780997328.813252:0:72371:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a033b777] to pc [ptlrpcd_00_01+1] req@ffff9689bfaad180 x1867507127051136/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997328.813306:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127050240 00000100:00100000:0.0:1780997328.813310:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127050240 00000020:00000040:0.0:1780997328.813312:0:8241:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b4ea 00000020:00000040:0.0:1780997328.813315:0:8241:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79c9000 refcount=7 00000100:00000040:0.0:1780997328.813327:0:8241:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1780997328.813346:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4152 00000100:00000040:0.0:1780997328.813348:0:8241:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689b79c9000 : new rpc_count 1 00000100:00000040:0.0:1780997328.813353:0:8241:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bff6f100 x1867507127050240/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:659/0 lens 224/0 e 0 to 0 dl 1780997339 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997328.813363:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3497:x1867507127050240:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780997328.813376:0:8241:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1867507127050240 00000100:00000040:0.0:1780997328.813380:0:8241:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:0.0:1780997328.813383:0:8241:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997328.813402:0:8241:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff96888b334000 x1867507127050240/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997328.813416:0:8241:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:0.0:1780997328.813420:0:8241:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bff6f100 x1867507127050240/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1780997339 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997328.813428:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3497:x1867507127050240:12345-0@lo:400:kworker.0 Request processed in 66us (4675us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997328.813445:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4152 00000100:00000040:0.0:1780997328.813448:0:8241:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689b79c9000 : new rpc_count 0 00000020:00000040:0.0:1780997328.813456:0:8241:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79c9000 : new refcount 6 00000100:00100000:0.0:1780997328.813490:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:0.0:1780997328.813500:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfaad180 x1867507127051136/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997328.813511:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127051136:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1780997328.813528:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfaad180 x1867507127051136/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997344 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997328.813536:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997328.813552:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaaea00 x1867507127051136 msgsize 224 00000100:00100000:0.0:1780997328.813556:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997328.813571:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfaad180 x1867507127051136/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997344 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997328.813581:0:3496:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 955806 usecs (956 jiffies) 00000100:00100000:0.0:1780997328.813597:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127051136 00000100:00100000:0.0:1780997328.813600:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127051136 00000020:00000040:0.0:1780997328.813602:0:8242:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b4ea 00000020:00000040:0.0:1780997328.813604:0:8242:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79c9000 refcount=7 00000100:00000040:0.0:1780997328.813612:0:8242:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1780997328.813628:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4153 00000100:00000040:0.0:1780997328.813631:0:8242:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689b79c9000 : new rpc_count 1 00000100:00000040:0.0:1780997328.813635:0:8242:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaaea00 x1867507127051136/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:659/0 lens 224/0 e 0 to 0 dl 1780997339 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997328.813645:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127051136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780997328.813667:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00010000:00000040:0.0:1780997328.813678:0:8242:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1867507127051136 00000100:00000040:0.0:1780997328.813689:0:8242:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:0.0:1780997328.813692:0:8242:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997328.813722:0:8242:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9689bfaad180 x1867507127051136/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997328.813738:0:8242:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:0.0:1780997328.813743:0:8242:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaaea00 x1867507127051136/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:659/0 lens 224/368 e 0 to 0 dl 1780997339 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997328.813751:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127051136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997328.813757:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4153 00000100:00000040:0.0:1780997328.813760:0:8242:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689b79c9000 : new rpc_count 0 00000020:00000040:0.0:1780997328.813766:0:8242:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79c9000 : new refcount 6 00000100:00000040:0.0:1780997328.813792:0:3496:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:0.0:1780997328.813797:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfaad180 x1867507127051136/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1780997328.813807:0:3496:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352839 avail=317136 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023597 state=0: rc = 0 00000100:00000040:0.0:1780997328.813814:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaad180 x1867507127051136/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997344 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997328.813820:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127051136:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1780997328.813825:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfaad180 x1867507127051136/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997344 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997328.813833:0:3496:0:(genops.c:1244:class_import_put()) import ffff9689ae566000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1780997328.816514:0:3497:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:3.0:1780997328.816532:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888b334000 x1867507127050240/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997328.816545:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888b334000 x1867507127050240/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997328.816552:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888b334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127050240:0@lo:400:kworker.0 00000100:00000040:3.0:1780997328.816560:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888b334000 x1867507127050240/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997344 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997328.816578:0:3497:0:(genops.c:1244:class_import_put()) import ffff9689ae566000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000020:00000040:0.0:1780997329.324533:0:90260:0:(genops.c:1231:class_import_get()) import ffff968886bc8000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1780997329.324582:0:90260:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a033b777] to pc [ptlrpcd_00_02+2] req@ffff9689bfaad180 x1867507127051264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997329.324625:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfaad180 x1867507127051264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997329.324650:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127051264:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1780997329.324682:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfaad180 x1867507127051264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997345 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997329.324692:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997329.324739:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaac380 x1867507127051264 msgsize 224 00000100:00100000:0.0:1780997329.324744:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997329.324769:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfaad180 x1867507127051264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997345 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997329.324784:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8093 usecs (9 jiffies) 00000100:00100000:0.0:1780997329.324822:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127051264 00000100:00100000:0.0:1780997329.324828:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127051264 00000020:00000040:0.0:1780997329.324831:0:85815:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b55a 00000020:00000040:0.0:1780997329.324835:0:85815:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968886bcb000 refcount=5 00000100:00000040:0.0:1780997329.324856:0:85815:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1780997329.324885:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190 00000100:00000040:0.0:1780997329.324889:0:85815:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968886bcb000 : new rpc_count 1 00000100:00000040:0.0:1780997329.324895:0:85815:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaac380 x1867507127051264/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:660/0 lens 224/0 e 0 to 0 dl 1780997340 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997329.324908:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127051264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780997329.324940:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:0.0:1780997329.324950:0:85815:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1867507127051264 00000100:00000040:0.0:1780997329.324960:0:85815:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:0.0:1780997329.324964:0:85815:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997329.324982:0:85815:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9689bfaad180 x1867507127051264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997345 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997329.325000:0:85815:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:0.0:1780997329.325004:0:85815:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaac380 x1867507127051264/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:660/0 lens 224/368 e 0 to 0 dl 1780997340 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997329.325020:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127051264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997329.325027:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190 00000100:00000040:0.0:1780997329.325030:0:85815:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968886bcb000 : new rpc_count 0 00000020:00000040:0.0:1780997329.325041:0:85815:0:(genops.c:900:class_export_put()) PUTting export ffff968886bcb000 : new refcount 4 00000100:00000040:0.0:1780997329.325076:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:0.0:1780997329.325082:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfaad180 x1867507127051264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1780997329.325092:0:3498:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1780997329.325095:0:3498:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1780997329.325103:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaad180 x1867507127051264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997345 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997329.325122:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127051264:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1780997329.325128:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfaad180 x1867507127051264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997345 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997329.325138:0:3498:0:(genops.c:1244:class_import_put()) import ffff968886bc8000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00010000:00010000:0.0:1780997329.638721:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1780997329.675603:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff968993691850 x1867507110486400 msgsize 224 00000100:00100000:1.0:1780997329.675621:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:1.0:1780997329.675624:0:3491:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780997329.675894:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689adbb6300 x1867507110486656 msgsize 224 00000100:00100000:1.0:1780997329.675900:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997329.675972:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110486656 00000100:00100000:2.0:1780997329.675983:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110486656 00000020:00000040:2.0:1780997329.675986:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305aafd 00000020:00000040:2.0:1780997329.675991:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968994767800 refcount=51 00000020:00000040:2.0:1780997329.676005:0:63417:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9689ba680000) now 10 - evictor 00000100:00000040:2.0:1780997329.676029:0:63417:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1780997329.676056:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1461 00000100:00000040:2.0:1780997329.676060:0:63417:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968994767800 : new rpc_count 1 00000100:00000040:2.0:1780997329.676083:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689adbb6300 x1867507110486656/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:660/0 lens 224/0 e 0 to 0 dl 1780997340 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997329.676097:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2395:x1867507110486656:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000040:2.0:1780997329.676131:0:63417:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 81604378913, transno 0, xid 1867507110486656 00000100:00000040:2.0:1780997329.676143:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997329.676149:0:63417:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997329.676198:0:63417:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 8 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997329.676203:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adbb6300 x1867507110486656/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:660/0 lens 224/224 e 0 to 0 dl 1780997340 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997329.676213:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2395:x1867507110486656:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 117us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997329.676220:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1461 00000100:00000040:2.0:1780997329.676223:0:63417:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968994767800 : new rpc_count 0 00000020:00000040:2.0:1780997329.676232:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff968994767800 : new refcount 50 00000100:00080000:2.0:1780997329.676245:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1780997329.676249:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9689ba680000) now 10 - evictor 00000100:00100000:3.0:1780997329.680974:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110486400 00000100:00100000:3.0:1780997329.680991:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110486400 00000020:00000040:3.0:1780997329.680994:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b47a 00000020:00000040:3.0:1780997329.681000:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff96888a811000 refcount=9 00000100:00000040:3.0:1780997329.682494:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55d880 x1867507110486528 msgsize 224 00000100:00100000:3.0:1780997329.682509:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:3.0:1780997329.682545:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55ce00 x1867507110486912 msgsize 224 00000100:00100000:3.0:1780997329.682550:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:3.0:1780997329.682570:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55dc00 x1867507110486784 msgsize 520 00000100:00100000:3.0:1780997329.682574:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997329.683719:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110486528 00000100:00100000:1.0:1780997329.683730:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110486528 00000020:00000040:1.0:1780997329.683733:0:65272:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b4f1 00000020:00000040:1.0:1780997329.683753:0:65272:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79cb000 refcount=11 00000020:00000040:1.0:1780997329.683775:0:65272:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff96888ac53380) now 14 - evictor 00000100:00000040:1.0:1780997329.683813:0:65272:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1780997329.683855:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1462 00000100:00000040:1.0:1780997329.683859:0:65272:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689b79cb000 : new rpc_count 1 00000100:00000040:1.0:1780997329.683869:0:65272:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55d880 x1867507110486528/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:660/0 lens 224/0 e 0 to 0 dl 1780997340 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997329.683894:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2394:x1867507110486528:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000040:1.0:1780997329.683921:0:65272:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 120259084292, transno 0, xid 1867507110486528 00000100:00000040:1.0:1780997329.683933:0:65272:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:1.0:1780997329.683940:0:65272:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:1.0:1780997329.683994:0:65272:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 8 to 192.168.206.51@tcp 00000100:00000040:1.0:1780997329.684011:0:65272:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55d880 x1867507110486528/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:660/0 lens 224/224 e 0 to 0 dl 1780997340 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997329.684021:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2394:x1867507110486528:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 141us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997329.684028:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1462 00000100:00000040:1.0:1780997329.684032:0:65272:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689b79cb000 : new rpc_count 0 00000020:00000040:1.0:1780997329.684042:0:65272:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79cb000 : new refcount 10 00000100:00100000:1.0:1780997329.684060:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110486912 00000100:00100000:1.0:1780997329.684063:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110486912 00000020:00000040:1.0:1780997329.684065:0:25180:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b89b 00000020:00000040:1.0:1780997329.684068:0:25180:0:(lustre_handles.c:131:class_handle2object()) GET export ffff96888b414800 refcount=7 00000020:00000040:1.0:1780997329.684076:0:25180:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:1.0:1780997329.684084:0:25180:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1780997329.684101:0:25180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110486784 00000100:00100000:1.0:1780997329.684104:0:25180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110486784 00000020:00000040:1.0:1780997329.684105:0:25180:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b894 00000100:00100000:1.0:1780997329.684122:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2725 00000100:00000040:1.0:1780997329.684131:0:25180:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff96888b414800 : new rpc_count 1 00000100:00000040:1.0:1780997329.684136:0:25180:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55ce00 x1867507110486912/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:660/0 lens 224/0 e 0 to 0 dl 1780997340 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997329.684148:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110486912:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000040:1.0:1780997329.684159:0:25180:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507110486912 00000100:00000040:1.0:1780997329.684164:0:25180:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:1.0:1780997329.684167:0:25180:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:1.0:1780997329.684180:0:25180:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 8 to 192.168.206.51@tcp 00000100:00000040:1.0:1780997329.684185:0:25180:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55ce00 x1867507110486912/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:660/0 lens 224/224 e 0 to 0 dl 1780997340 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997329.684193:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110486912:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 48us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997329.684199:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2725 00000100:00000040:1.0:1780997329.684201:0:25180:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff96888b414800 : new rpc_count 0 00000020:00000040:1.0:1780997329.684207:0:25180:0:(genops.c:900:class_export_put()) PUTting export ffff96888b414800 : new refcount 6 00000100:00100000:1.0:1780997329.684215:0:25180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6057 00000100:00000040:1.0:1780997329.684219:0:25180:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55dc00 x1867507110486784/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780997349 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997329.684227:0:25180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2393:x1867507110486784:12345-192.168.206.51@tcp:8:kworker.0 00010000:00020000:1.0:1780997329.684246:0:25180:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.206.51@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1780997329.684294:0:25180:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:1.0:1780997329.684297:0:25180:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:1.0:1780997329.684300:0:25180:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:1.0:1780997329.684312:0:25180:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 8 to 192.168.206.51@tcp 00000100:00000040:1.0:1780997329.684316:0:25180:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55dc00 x1867507110486784/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780997349 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997329.684331:0:25180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2393:x1867507110486784:12345-192.168.206.51@tcp:8:kworker.0 Request processed in 104us (1759us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780997329.684338:0:25180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6057 00000100:00080000:3.0:1780997329.685763:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1780997329.685771:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00080000:3.0:1780997329.685776:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1780997329.685778:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff96888ac53380) now 14 - evictor 00000100:00000040:2.0:1780997329.692027:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780997329.692117:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 186 00000100:00000040:2.0:1780997329.692122:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff96888a811000 : new rpc_count 1 00000100:00000040:2.0:1780997329.692131:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968993691850 x1867507110486400/t0(0) o400->cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp:660/0 lens 224/0 e 0 to 0 dl 1780997340 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997329.692146:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968993691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110486400:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000040:2.0:1780997329.692169:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507110486400 00000100:00000040:2.0:1780997329.692179:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997329.692185:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997329.692240:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 8 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997329.692246:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968993691850 x1867507110486400/t0(0) o400->cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp:660/0 lens 224/224 e 0 to 0 dl 1780997340 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997329.692255:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968993691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110486400:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 113us (16652us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997329.692289:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 186 00000100:00000040:2.0:1780997329.692293:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff96888a811000 : new rpc_count 0 00000020:00000040:2.0:1780997329.692304:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff96888a811000 : new refcount 8 00000020:01000004:0.0:1780997329.705695:0:92686:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1780997329.705711:0:92686:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1780997329.705713:0:92686:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1780997329.706253:0:92686:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff96888a990000 00000020:01000004:0.0:1780997329.706298:0:92686:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1780997329.706317:0:92686:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1780997329.706333:0:92686:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff968886ec4d40) 00000020:00000040:0.0:1780997329.706340:0:92686:0:(lustre_handles.c:77:class_handle_hash()) added object ffff96888a991800 with handle 0x30fd811c0305c44f to hash 00000020:00000040:0.0:1780997329.706347:0:92686:0:(genops.c:900:class_export_put()) PUTting export ffff96888a991800 : new refcount 1 00000020:00000040:0.0:1780997329.706361:0:92686:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff968886ec4d40) now 2 - obd_device_list 00000020:00000080:0.0:1780997329.706367:0:92686:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000020:00000040:0.0:1780997330.343687:0:72375:0:(genops.c:1231:class_import_get()) import ffff9689a69f7000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1780997330.343744:0:72375:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a033b777] to pc [ptlrpcd_00_03+3] req@ffff9689bfaad180 x1867507127051392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.343786:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:0.0:1780997330.343801:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfaad180 x1867507127051392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.343815:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127051392:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1780997330.343846:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfaad180 x1867507127051392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997346 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.343854:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.343895:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaadf80 x1867507127051392 msgsize 224 00000100:00100000:0.0:1780997330.343900:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997330.343920:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfaad180 x1867507127051392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.343933:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5872 usecs (6 jiffies) 00000100:00100000:3.0:1780997330.344129:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127051392 00000100:00100000:3.0:1780997330.344139:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127051392 00000020:00000040:3.0:1780997330.344143:0:8234:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c030553a7 00000020:00000040:3.0:1780997330.344147:0:8234:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689ae564000 refcount=5 00000020:00000040:3.0:1780997330.344161:0:8234:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:3.0:1780997330.344193:0:8234:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1780997330.344227:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191 00000100:00000040:3.0:1780997330.344232:0:8234:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689ae564000 : new rpc_count 1 00000100:00000040:3.0:1780997330.344237:0:8234:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaadf80 x1867507127051392/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:661/0 lens 224/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.344251:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127051392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997330.344289:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1780997330.344301:0:8234:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1867507127051392 00000100:00000040:3.0:1780997330.344330:0:8234:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997330.344335:0:8234:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.344355:0:8234:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9689bfaad180 x1867507127051392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.344375:0:8234:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:3.0:1780997330.344380:0:8234:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaadf80 x1867507127051392/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:661/0 lens 224/368 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.344390:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127051392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 142us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997330.344398:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191 00000100:00000040:3.0:1780997330.344401:0:8234:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689ae564000 : new rpc_count 0 00000020:00000040:3.0:1780997330.344411:0:8234:0:(genops.c:900:class_export_put()) PUTting export ffff9689ae564000 : new refcount 4 00000100:00000040:3.0:1780997330.344445:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:3.0:1780997330.344451:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfaad180 x1867507127051392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1780997330.344460:0:3498:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:3.0:1780997330.344462:0:3498:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:3.0:1780997330.344471:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaad180 x1867507127051392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.344478:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127051392:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1780997330.344483:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfaad180 x1867507127051392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.344493:0:3498:0:(genops.c:1244:class_import_put()) import ffff9689a69f7000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00080000:0.0:1780997330.346782:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1780997330.346793:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000001:00000040:3.0:1780997330.576365:0:92686:0:(osd_compat.c:233:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:3.0:1780997330.586520:0:92686:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1780997330.587437:0:92686:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1780997330.587492:0:92686:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1780997330.587523:0:92686:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1780997330.587549:0:92686:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1780997330.587590:0:92686:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1780997330.588008:0:92686:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1780997330.590510:0:92686:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:3.0:1780997330.590799:0:92686:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff968886ec4d40) now 3 - setup 00000020:00000080:3.0:1780997330.590805:0:92686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1780997330.590818:0:92686:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000040:3.0:1780997330.590826:0:92686:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689bc969800 with handle 0x30fd811c0305c456 to hash 00000020:00000040:3.0:1780997330.590833:0:92686:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff968886ec4d40) now 4 - export 00000020:00000040:3.0:1780997330.590836:0:92686:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc969800 : new refcount 1 00000020:00000080:3.0:1780997330.590839:0:92686:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x30fd811c0305c456 00000020:00000040:3.0:1780997330.590842:0:92686:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c456 00000020:00000040:3.0:1780997330.590845:0:92686:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc969800 refcount=2 00000020:01000004:3.0:1780997330.590850:0:92686:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1780997330.590875:0:92686:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1780997330.590878:0:92686:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1780997330.590884:0:92686:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1780997330.590919:0:92686:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1780997330.590923:0:92686:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:3.0:1780997330.591550:0:92686:0:(genops.c:889:class_export_get()) GET export ffff96888a991800 refcount=2 00000040:00000040:3.0:1780997330.591555:0:92686:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968982993b40 : new refcount 2 00000040:00000040:3.0:1780997330.592398:0:92686:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968982993b40 : new refcount 1 00000040:01000000:3.0:1780997330.592403:0:92686:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 10000000:00000040:3.0:1780997330.592405:0:92686:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968982993b40 : new refcount 2 10000000:00000040:3.0:1780997330.592407:0:92686:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968982993b40 : new refcount 1 00000020:00000040:3.0:1780997330.592410:0:92686:0:(obd_config.c:994:class_incref()) incref MGC192.168.206.151@tcp (ffff9689b6283380) now 6 - mgc_fs 00000020:01000004:3.0:1780997330.592450:0:92686:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1780997330.592456:0:92686:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1780997330.592463:0:92686:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780997330.592464:0:92686:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997330.592465:0:92686:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997330.592466:0:92686:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997330.592468:0:92686:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997330.592469:0:92686:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780997330.592471:0:92686:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997330.592473:0:92686:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1780997330.592475:0:92686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1780997330.592477:0:92686:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1780997330.592478:0:92686:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780997330.592479:0:92686:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997330.592480:0:92686:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997330.592481:0:92686:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997330.592482:0:92686:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997330.592482:0:92686:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780997330.592483:0:92686:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997330.592484:0:92686:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:3.0:1780997330.592492:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 10000000:01000000:3.0:1780997330.592517:0:92686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:3.0:1780997330.592540:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bb55e680 x1867507127051520/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.592554:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127051520:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1780997330.592583:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bb55e680 x1867507127051520/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.592591:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.592639:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff96898d8e4850 x1867507127051520 msgsize 4848 00000100:00100000:3.0:1780997330.592644:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.592646:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780997330.592671:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bb55e680 x1867507127051520/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.592709:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780997330.593217:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127051520 00000100:00100000:0.0:1780997330.593228:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127051520 00000020:00000040:0.0:1780997330.593231:0:90246:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:0.0:1780997330.593236:0:90246:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=20 00000100:00000040:0.0:1780997330.593260:0:90246:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780997330.593325:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00000040:0.0:1780997330.593330:0:90246:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:0.0:1780997330.593336:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff96898d8e4850 x1867507127051520/t0(0) o253->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 4848/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.593349:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:92686:x1867507127051520:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1780997330.593392:0:90246:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1780997330.593396:0:90246:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1780997330.593400:0:90246:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:0.0:1780997330.594182:0:90246:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127051520 00000100:00000040:0.0:1780997330.594197:0:90246:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:0.0:1780997330.594203:0:90246:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.594241:0:90246:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff9689bb55e680 x1867507127051520/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.594301:0:90246:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:0.0:1780997330.594307:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96898d8e4850 x1867507127051520/t0(0) o253->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 4848/4768 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.594316:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:92686:x1867507127051520:12345-0@lo:253:mount.lustre.0 Request processed in 968us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997330.594323:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00000040:0.0:1780997330.594326:0:90246:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:0.0:1780997330.594338:0:90246:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 19 00000100:00000040:3.0:1780997330.595037:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bb55e680 x1867507127051520/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.595065:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55e680 x1867507127051520/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.595072:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127051520:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1780997330.595080:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bb55e680 x1867507127051520/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1780997330.595091:0:92686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1780997330.595094:0:92686:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1780997330.595095:0:92686:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780997330.595097:0:92686:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997330.595098:0:92686:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997330.595099:0:92686:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997330.595100:0:92686:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997330.595102:0:92686:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780997330.595103:0:92686:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997330.595104:0:92686:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:3.0:1780997330.595107:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bb55e680 x1867507127051520/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.595118:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000020:01000004:3.0:1780997330.595133:0:92686:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96888a990000 from lustre-OST0000 10000000:01000000:3.0:1780997330.595164:0:92686:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1780997330.595168:0:92686:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:3.0:1780997330.595177:0:92686:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff968987718e00) refs 5 10000000:01000000:3.0:1780997330.595180:0:92686:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9689b6283380 local copy 00000020:00000040:3.0:1780997330.595185:0:92686:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689ba454c00 refcount=2 00010000:00010000:3.0:1780997330.595194:0:92686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c0305ba62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba69 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1780997330.595221:0:92686:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968982d5b900 : new refcount 2 10000000:00000040:3.0:1780997330.595224:0:92686:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968982993b40 : new refcount 2 10000000:00000040:3.0:1780997330.595227:0:92686:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.206.151@tcp: copy local log lustre-sptlrpc 00000020:00000040:3.0:1780997330.595365:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.595370:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997330.595399:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bb55e680 x1867507127051648/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.595412:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127051648:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1780997330.595432:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bb55e680 x1867507127051648/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.595438:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.595466:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff9689bc845450 x1867507127051648 msgsize 512 00000100:00100000:3.0:1780997330.595471:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.595473:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780997330.595539:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bb55e680 x1867507127051648/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.595565:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997330.596105:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127051648 00000100:00100000:1.0:1780997330.596113:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127051648 00000020:00000040:1.0:1780997330.596116:0:90247:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:1.0:1780997330.596119:0:90247:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=20 00000100:00000040:1.0:1780997330.596141:0:90247:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1780997330.596231:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00000040:1.0:1780997330.596236:0:90247:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:1.0:1780997330.596242:0:90247:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bc845450 x1867507127051648/t0(0) o501->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 512/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.596255:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:92686:x1867507127051648:12345-0@lo:501:mount.lustre.0 00000040:00000040:1.0:1780997330.596524:0:90247:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:1.0:1780997330.596528:0:90247:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:1.0:1780997330.596562:0:90247:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00010000:00000040:1.0:1780997330.596567:0:90247:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127051648 00000100:00000040:1.0:1780997330.596586:0:90247:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997330.596591:0:90247:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.596630:0:90247:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9689bb55e680 x1867507127051648/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.596662:0:90247:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:1.0:1780997330.596667:0:90247:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc845450 x1867507127051648/t0(0) o501->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 512/272 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.596675:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:92686:x1867507127051648:12345-0@lo:501:mount.lustre.0 Request processed in 423us (1208us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780997330.596683:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00000040:1.0:1780997330.596706:0:90247:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:1.0:1780997330.596716:0:90247:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 19 00000100:00000040:3.0:1780997330.596876:0:92686:0:(client.c:1496:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff9689bb55e680 x1867507127051648/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.596886:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bb55e680 x1867507127051648/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.596894:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55e680 x1867507127051648/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.596901:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127051648:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1780997330.596907:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bb55e680 x1867507127051648/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.596928:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997330.596933:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bb55e680 x1867507127051648/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.596953:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 10000000:01000000:3.0:1780997330.596960:0:92686:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1780997330.596982:0:92686:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:3.0:1780997330.596986:0:92686:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689ba454c00 refcount=3 00010000:00010000:3.0:1780997330.596993:0:92686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c0305ba62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba69 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997330.597003:0:92686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c0305ba62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305ba69 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780997330.597038:0:92686:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96888a990000 10000000:01000000:3.0:1780997330.597043:0:92686:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:3.0:1780997330.597048:0:92686:0:(genops.c:889:class_export_get()) GET export ffff968987770000 refcount=18 10000000:00000040:3.0:1780997330.597052:0:92686:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff9689ba603000) refs 4 10000000:01000000:3.0:1780997330.597054:0:92686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1780997330.597056:0:92686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:3.0:1780997330.597058:0:92686:0:(genops.c:889:class_export_get()) GET export ffff968987770000 refcount=19 10000000:01000000:3.0:1780997330.597062:0:92686:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1780997330.597064:0:92686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:3.0:1780997330.597069:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00010000:00000040:3.0:1780997330.597090:0:92686:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff96898712d600 count: 8 00000020:00000040:3.0:1780997330.597097:0:92686:0:(lustre_handles.c:77:class_handle_hash()) added object ffff96898d6daa00 with handle 0x30fd811c0305c45d to hash 00010000:00010000:3.0:1780997330.597104:0:92686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6daa00/0x30fd811c0305c45d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997330.597112:0:92686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff96898d6daa00/0x30fd811c0305c45d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997330.597121:0:92686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff96898d6daa00/0x30fd811c0305c45d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1780997330.597141:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bb55e680 x1867507127051776/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.597150:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127051776:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1780997330.597165:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bb55e680 x1867507127051776/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.597172:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.597190:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff9689bc844850 x1867507127051776 msgsize 328 00000100:00100000:3.0:1780997330.597194:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.597196:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780997330.597846:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bb55e680 x1867507127051776/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.597870:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780997330.597946:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127051776 00000100:00100000:1.0:1780997330.597952:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127051776 00000020:00000040:1.0:1780997330.597954:0:90247:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:1.0:1780997330.597957:0:90247:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=20 00000100:00000040:1.0:1780997330.597973:0:90247:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1780997330.597997:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00000040:1.0:1780997330.598001:0:90247:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:1.0:1780997330.598005:0:90247:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bc844850 x1867507127051776/t0(0) o101->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.598015:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+20:92686:x1867507127051776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997330.598027:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1780997330.598035:0:90247:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff968983653900 count: 10 00000020:00000040:1.0:1780997330.598040:0:90247:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689a5a43800 with handle 0x30fd811c0305c464 to hash 00010000:00010000:1.0:1780997330.598044:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a5a43800/0x30fd811c0305c464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305c45d expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598051:0:90247:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff968982cc7800 : new locks_count 16 00000020:00000040:1.0:1780997330.598053:0:90247:0:(genops.c:889:class_export_get()) GET export ffff968982cc7800 refcount=21 00010000:00000040:1.0:1780997330.598067:0:90247:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff968983653900) refcount = 10 00010000:00000040:1.0:1780997330.598070:0:90247:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1780997330.598076:0:90247:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689a56c8400/0x30fd811c0305ba77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ecc expref: 8 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598085:0:90247:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bc4c1e00/0x30fd811c0305ba70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ec5 expref: 8 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598092:0:90247:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bc4c0a00/0x30fd811c0305ba69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba62 expref: 21 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598112:0:90247:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689a56c8200/0x30fd811c0305ba3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba38 expref: 21 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598124:0:90247:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689ba455200/0x30fd811c0305ba31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba2a expref: 21 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598131:0:90247:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bb4efa00/0x30fd811c0305ba23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba1c expref: 21 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598138:0:90247:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bc4c0600/0x30fd811c0305ba15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba0e expref: 21 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598145:0:90247:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bc4c0c00/0x30fd811c0305ba07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba00 expref: 21 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598152:0:90247:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689ba454200/0x30fd811c0305b9f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b9f2 expref: 21 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.598158:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a5a43800/0x30fd811c0305c464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305c45d expref: 21 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.598169:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a5a43800/0x30fd811c0305c464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305c45d expref: 21 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.598178:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a5a43800, rc 0) 00010000:00000040:1.0:1780997330.598181:0:90247:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127051776 00000100:00000040:1.0:1780997330.598189:0:90247:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997330.598193:0:90247:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.598213:0:90247:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9689bb55e680 x1867507127051776/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.598233:0:90247:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:1.0:1780997330.598243:0:90247:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc844850 x1867507127051776/t0(0) o101->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/344 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.598252:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:92686:x1867507127051776:12345-0@lo:101:mount.lustre.0 Request processed in 238us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997330.598258:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00000040:1.0:1780997330.598261:0:90247:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:1.0:1780997330.598293:0:90247:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 20 00000100:00000040:1.0:1780997330.598327:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bb55e680 x1867507127051776/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.598337:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55e680 x1867507127051776/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.598343:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127051776:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1780997330.598350:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bb55e680 x1867507127051776/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.598358:0:92686:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff96898d6daa00 refcount=4 00010000:00000040:1.0:1780997330.598367:0:92686:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff96898d6daa00, remote cookie: 0x30fd811c0305c464, flags: 0x0 00010000:00000040:1.0:1780997330.598372:0:92686:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff96898712d600) refcount = 8 00010000:00000040:1.0:1780997330.598375:0:92686:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1780997330.598378:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c0305ba62 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba69 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598385:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305ba38 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba3f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598391:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689bb4efc00/0x30fd811c0305ba2a lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba31 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598397:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305ba1c lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba23 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598410:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee400/0x30fd811c0305ba0e lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba15 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598415:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef400/0x30fd811c0305ba00 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba07 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.598421:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1600/0x30fd811c0305b9f2 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b9f9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.598427:0:92686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff96898d6daa00/0x30fd811c0305c45d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c464 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.598436:0:92686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff96898d6daa00/0x30fd811c0305c45d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305c464 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1780997330.598445:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bb55e680 x1867507127051776/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.598454:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 10000000:00000040:1.0:1780997330.598462:0:92686:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff968991342e00) refs 2 00000020:00000040:1.0:1780997330.598465:0:92686:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff96898d6daa00 refcount=3 10000000:00000040:1.0:1780997330.598491:0:92686:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968982d5b900 : new refcount 2 10000000:00000040:1.0:1780997330.598495:0:92686:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968982993b40 : new refcount 2 10000000:00000040:1.0:1780997330.598498:0:92686:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.206.151@tcp: copy local log lustre-OST0000 00000040:00080000:1.0:1780997330.598711:0:92686:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1780997330.599517:0:92686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1780997330.608207:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1780997330.608996:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1780997330.609028:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1780997330.609041:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1780997330.609054:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1780997330.609065:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1780997330.609098:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1780997330.609103:0:92686:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:3.0:1780997330.609169:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.609178:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997330.609217:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bb55f100 x1867507127051904/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.609233:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127051904:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1780997330.609257:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bb55f100 x1867507127051904/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.610072:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.610111:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff9689bc846050 x1867507127051904 msgsize 512 00000100:00100000:3.0:1780997330.610115:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.610117:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780997330.610184:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bb55f100 x1867507127051904/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.610209:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993a80 going to sleep for 11 seconds 00000100:00100000:1.0:1780997330.618540:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127051904 00000100:00100000:1.0:1780997330.618558:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127051904 00000020:00000040:1.0:1780997330.618562:0:90247:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:1.0:1780997330.618567:0:90247:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=21 00000100:00000040:1.0:1780997330.619019:0:90247:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1780997330.619073:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00000040:1.0:1780997330.619079:0:90247:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:1.0:1780997330.619087:0:90247:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bc846050 x1867507127051904/t0(0) o501->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 512/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.619101:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:92686:x1867507127051904:12345-0@lo:501:mount.lustre.0 00000040:00000040:1.0:1780997330.619130:0:90247:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:1.0:1780997330.619134:0:90247:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:1.0:1780997330.619222:0:90247:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00000020:00000040:1.0:1780997330.619233:0:90247:0:(genops.c:889:class_export_get()) GET export ffff968982cc7800 refcount=22 00000020:00000040:1.0:1780997330.619237:0:90247:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 21 00010000:00000040:1.0:1780997330.619243:0:90247:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127051904 00000100:00000040:1.0:1780997330.619254:0:90247:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997330.619261:0:90247:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.619449:0:90247:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9689bb55f100 x1867507127051904/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.619484:0:90247:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:1.0:1780997330.619491:0:90247:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc846050 x1867507127051904/t0(0) o501->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 512/272 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.619500:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:92686:x1867507127051904:12345-0@lo:501:mount.lustre.0 Request processed in 402us (9387us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997330.619508:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00000040:1.0:1780997330.619512:0:90247:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:1.0:1780997330.619523:0:90247:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 20 00000100:00000040:3.0:1780997330.619652:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bb55f100 x1867507127051904/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.619664:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55f100 x1867507127051904/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.619672:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127051904:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1780997330.619683:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bb55f100 x1867507127051904/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.619704:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997330.619709:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bb55f100 x1867507127051904/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.619719:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.620041:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.620047:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997330.620072:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bb55f100 x1867507127052032/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.620083:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052032:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1780997330.620116:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bb55f100 x1867507127052032/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.620134:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.620158:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff9689bc845050 x1867507127052032 msgsize 272 00000100:00100000:3.0:1780997330.620162:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.620164:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780997330.620191:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bb55f100 x1867507127052032/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.620217:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993a80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997330.620307:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127052032 00000100:00100000:2.0:1780997330.620315:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127052032 00000020:00000040:2.0:1780997330.620318:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:2.0:1780997330.620321:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=21 00000100:00000040:2.0:1780997330.620339:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780997330.620366:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00000040:2.0:1780997330.620369:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:2.0:1780997330.620374:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bc845050 x1867507127052032/t0(0) o503->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.620386:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:92686:x1867507127052032:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1780997330.620409:0:90245:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:2.0:1780997330.620453:0:90245:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00010000:00000040:2.0:1780997330.620458:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127052032 00000100:00000040:2.0:1780997330.620465:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:2.0:1780997330.620470:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997330.620491:0:90245:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9689bb55f100 x1867507127052032/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997330.620511:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:2.0:1780997330.620515:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc845050 x1867507127052032/t0(0) o503->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/8416 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.620523:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:92686:x1867507127052032:12345-0@lo:503:mount.lustre.0 Request processed in 140us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997330.620530:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00000040:2.0:1780997330.620532:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:2.0:1780997330.620546:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 20 00000100:00000040:3.0:1780997330.621065:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bb55f100 x1867507127052032/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.621074:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55f100 x1867507127052032/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.621080:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052032:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1780997330.621087:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bb55f100 x1867507127052032/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.621099:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bb55f100 x1867507127052032/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.621116:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.621122:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000040:00080000:3.0:1780997330.621568:0:92686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:3.0:1780997330.622032:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.622039:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997330.622066:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bb55f100 x1867507127052160/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.622080:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052160:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1780997330.622119:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bb55f100 x1867507127052160/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.622139:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.622171:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff968986909450 x1867507127052160 msgsize 272 00000100:00100000:3.0:1780997330.622175:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.622177:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780997330.622261:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bb55f100 x1867507127052160/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.622326:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993a80 going to sleep for 11 seconds 00000100:00100000:0.0:1780997330.632360:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127052160 00000100:00100000:0.0:1780997330.632382:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127052160 00000020:00000040:0.0:1780997330.632385:0:90246:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:0.0:1780997330.632391:0:90246:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=21 00000100:00000040:0.0:1780997330.632422:0:90246:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780997330.632453:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00000040:0.0:1780997330.632458:0:90246:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:0.0:1780997330.632465:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968986909450 x1867507127052160/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.632479:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:92686:x1867507127052160:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1780997330.632527:0:90246:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:0.0:1780997330.633633:0:90246:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00010000:00000040:0.0:1780997330.633649:0:90246:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127052160 00000100:00000040:0.0:1780997330.633662:0:90246:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:0.0:1780997330.633670:0:90246:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.634007:0:90246:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9689bb55f100 x1867507127052160/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.634045:0:90246:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:0.0:1780997330.634051:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968986909450 x1867507127052160/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/8472 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.634061:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:92686:x1867507127052160:12345-0@lo:502:mount.lustre.0 Request processed in 1583us (11887us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997330.634068:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00000040:0.0:1780997330.634071:0:90246:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:0.0:1780997330.634081:0:90246:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 20 00000100:00000040:3.0:1780997330.634196:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bb55f100 x1867507127052160/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.634208:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55f100 x1867507127052160/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.634215:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052160:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1780997330.634224:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bb55f100 x1867507127052160/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.634238:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bb55f100 x1867507127052160/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.634255:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.634262:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000040:00080000:3.0:1780997330.634537:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1780997330.634875:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1780997330.634903:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1780997330.634999:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1780997330.635016:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1780997330.635029:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1780997330.635042:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1780997330.635054:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1780997330.635065:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1780997330.635077:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1780997330.635103:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1780997330.635117:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:3.0:1780997330.635126:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.635132:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997330.635160:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bb55f100 x1867507127052288/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.635173:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052288:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1780997330.635205:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bb55f100 x1867507127052288/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.635214:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.635243:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff968986908c50 x1867507127052288 msgsize 272 00000100:00100000:3.0:1780997330.635248:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.635251:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780997330.636473:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bb55f100 x1867507127052288/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.636505:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993a80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997330.645059:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127052288 00000100:00100000:2.0:1780997330.645075:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127052288 00000020:00000040:2.0:1780997330.645078:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:2.0:1780997330.645083:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=21 00000100:00000040:2.0:1780997330.645114:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780997330.645149:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00000040:2.0:1780997330.645153:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:2.0:1780997330.645161:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968986908c50 x1867507127052288/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.645174:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968986908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:92686:x1867507127052288:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1780997330.645214:0:90245:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:2.0:1780997330.645298:0:90245:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00010000:00000040:2.0:1780997330.645303:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127052288 00000100:00000040:2.0:1780997330.645313:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:2.0:1780997330.645319:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997330.645369:0:90245:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9689bb55f100 x1867507127052288/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997330.645398:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:2.0:1780997330.645403:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968986908c50 x1867507127052288/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/8472 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.645411:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968986908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:92686:x1867507127052288:12345-0@lo:502:mount.lustre.0 Request processed in 239us (10166us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997330.645421:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00000040:2.0:1780997330.645424:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:2.0:1780997330.645434:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 20 00000100:00000040:3.0:1780997330.645565:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bb55f100 x1867507127052288/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.645576:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55f100 x1867507127052288/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.645597:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052288:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1780997330.645606:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bb55f100 x1867507127052288/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.645630:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bb55f100 x1867507127052288/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.645657:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.645667:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000040:00080000:3.0:1780997330.645748:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1780997330.645763:0:92686:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:3.0:1780997330.646058:0:92686:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968982d5b900 : new refcount 1 00000020:00000040:3.0:1780997330.646063:0:92686:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:3.0:1780997330.647349:0:92690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1780997330.647360:0:92690:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1780997330.647368:0:92690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997330.647370:0:92690:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1780997330.647375:0:92690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1780997330.647390:0:92690:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9689aeba3380) 00000020:00000040:3.0:1780997330.647397:0:92690:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689bc96f000 with handle 0x30fd811c0305c46b to hash 00000020:00000040:3.0:1780997330.647403:0:92690:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc96f000 : new refcount 1 00000020:00000040:3.0:1780997330.647418:0:92690:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 2 - obd_device_list 00000020:00000080:3.0:1780997330.647424:0:92690:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type obdfilter with refcount 2 00000020:00000040:3.0:1780997330.647429:0:92690:0:(obd_config.c:1948:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:3.0:1780997330.647432:0:92690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1780997330.647501:0:92690:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96888a990000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1780997330.647509:0:92690:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000040:3.0:1780997330.647513:0:92690:0:(lustre_handles.c:77:class_handle_hash()) added object ffff96888964e800 with handle 0x30fd811c0305c472 to hash 00000020:00000040:3.0:1780997330.647517:0:92690:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff968886ec4d40) now 5 - export 00000020:00000040:3.0:1780997330.647520:0:92690:0:(genops.c:900:class_export_put()) PUTting export ffff96888964e800 : new refcount 1 00000020:00000080:3.0:1780997330.647522:0:92690:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x30fd811c0305c472 00000020:00000040:3.0:1780997330.647524:0:92690:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c472 00000020:00000040:3.0:1780997330.647526:0:92690:0:(lustre_handles.c:131:class_handle2object()) GET export ffff96888964e800 refcount=2 00010000:00010000:2.0:1780997330.660169:0:92690:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:2.0:1780997330.660179:0:92690:0:(obd_cksum.c:33:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 1075, crc32c 9875, adler 679, t10ip512 4294, t10ip4k 3135, t10crc512 539, t10crc4k 571 00002000:00000040:2.0:1780997330.660227:0:92690:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:2.0:1780997330.662866:0:92690:0:(tgt_lastrcvd.c:690:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969455: rc = 0 00000001:00000040:2.0:1780997330.662877:0:92690:0:(tgt_lastrcvd.c:2003:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:2.0:1780997330.662887:0:92690:0:(tgt_lastrcvd.c:530:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294969456, last_xid = 1867507127008896, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1780997330.662891:0:92690:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 4294969456 srv lr: 4294969455 lx: 1867507127008896 gen 0 00000020:00000040:2.0:1780997330.662898:0:92690:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689bc9e3000 with handle 0x30fd811c0305c479 to hash 00000020:00000040:2.0:1780997330.662936:0:92690:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e3000 refcount=3 00000020:00000040:2.0:1780997330.662942:0:92690:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 3 - export 00000001:00000040:2.0:1780997330.662946:0:92690:0:(tgt_lastrcvd.c:1180:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1780997330.662949:0:92690:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e3000 : new refcount 2 00000001:00000040:2.0:1780997330.662954:0:92690:0:(tgt_lastrcvd.c:530:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294969473, last_xid = 1867507127038080, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1780997330.662958:0:92690:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 4294969473 srv lr: 4294969455 lx: 1867507127038080 gen 0 00000020:00000040:2.0:1780997330.662962:0:92690:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689bc9e6800 with handle 0x30fd811c0305c480 to hash 00000020:00000040:2.0:1780997330.662971:0:92690:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6800 refcount=3 00000020:00000040:2.0:1780997330.662974:0:92690:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 4 - export 00000001:00000040:2.0:1780997330.662976:0:92690:0:(tgt_lastrcvd.c:1180:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1780997330.662978:0:92690:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6800 : new refcount 2 00000001:00000040:2.0:1780997330.662981:0:92690:0:(tgt_lastrcvd.c:530:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = e4805cfa-ac6d-4d67-bb97-a6c06740fcd0, last_transno = 4294969477, last_xid = 1867507110452864, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1780997330.662985:0:92690:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 idx: 2 lr: 4294969477 srv lr: 4294969455 lx: 1867507110452864 gen 0 00000020:00000040:2.0:1780997330.662990:0:92690:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689bc9e6000 with handle 0x30fd811c0305c487 to hash 00000020:00000040:2.0:1780997330.663005:0:92690:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=3 00000020:00000040:2.0:1780997330.663007:0:92690:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 5 - export 00000001:00000040:2.0:1780997330.663009:0:92690:0:(tgt_lastrcvd.c:1180:tgt_client_add()) lustre-OST0000: client at idx 2 with UUID 'e4805cfa-ac6d-4d67-bb97-a6c06740fcd0' added, generation 0 00000020:00000040:2.0:1780997330.663026:0:92690:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 2 00000001:00000040:2.0:1780997330.663031:0:92690:0:(tgt_lastrcvd.c:530:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:2.0:1780997330.663034:0:92690:0:(tgt_lastrcvd.c:1746:tgt_clients_data_init()) skipping zeroed client at offset 3 00000001:00000004:2.0:1780997330.663043:0:92690:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294969477 00000001:00000040:2.0:1780997330.663091:0:92690:0:(tgt_lastrcvd.c:712:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969477: rc = 0 00000001:00000040:2.0:1780997330.663105:0:92690:0:(tgt_lastrcvd.c:766:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969477: rc = 0 00002000:00000040:2.0:1780997330.663126:0:92690:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:2.0:1780997330.663189:0:92690:0:(fid_store.c:166:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:2.0:1780997330.663260:0:92690:0:(fid_handler.c:57:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:2.0:1780997330.663288:0:92690:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:2.0:1780997330.663296:0:92690:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:2.0:1780997330.663339:0:92690:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:2.0:1780997330.663348:0:92690:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:2.0:1780997330.663391:0:92690:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:2.0:1780997330.663411:0:92690:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:2.0:1780997330.663458:0:92690:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:2.0:1780997330.663510:0:92690:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:2.0:1780997330.663540:0:92690:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:2.0:1780997330.664899:0:92690:0:(ofd_dev.c:464:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:2.0:1780997330.665251:0:92690:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00010000:00010000:3.0:1780997330.665463:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1780997330.672157:0:92690:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 6 - setup 00000020:00000080:3.0:1780997330.672166:0:92690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1780997330.672177:0:92690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780997330.672184:0:92690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997330.672186:0:92690:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1780997330.672190:0:92690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1780997330.672193:0:92690:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1780997330.672202:0:92690:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1780997330.672204:0:92690:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1780997330.672206:0:92690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1780997330.672208:0:92690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997330.672210:0:92690:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1780997330.672212:0:92690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997330.672215:0:92690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997330.672217:0:92690:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1780997330.672220:0:92690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1780997330.672222:0:92690:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1780997330.672225:0:92690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780997330.672228:0:92690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997330.672229:0:92690:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1780997330.672231:0:92690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997330.672234:0:92690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997330.672235:0:92690:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1780997330.672238:0:92690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1780997330.672295:0:92690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780997330.672299:0:92690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997330.672300:0:92690:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1780997330.672304:0:92690:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1780997330.673113:0:92686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1780997330.673154:0:92686:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:1.0:1780997330.673181:0:92686:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff96898d6daa00 refcount=3 00010000:00010000:1.0:1780997330.673191:0:92686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff96898d6daa00/0x30fd811c0305c45d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c464 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.673218:0:92686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff96898d6daa00/0x30fd811c0305c45d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c464 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780997330.673227:0:92686:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96888a990000 from 1 10000000:01000000:1.0:1780997330.673230:0:92686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:1.0:1780997330.673240:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00010000:00000040:1.0:1780997330.673524:0:92686:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff96898962ce00 count: 4 00000020:00000040:1.0:1780997330.673535:0:92686:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689a5a43400 with handle 0x30fd811c0305c48e to hash 00010000:00010000:1.0:1780997330.673542:0:92686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a5a43400/0x30fd811c0305c48e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.673550:0:92686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689a5a43400/0x30fd811c0305c48e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.673563:0:92686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689a5a43400/0x30fd811c0305c48e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1780997330.673590:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1163100 x1867507127052416/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.673606:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1163100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052416:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1780997330.673635:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b1163100 x1867507127052416/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.673645:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.673690:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff968988536050 x1867507127052416 msgsize 328 00000100:00100000:1.0:1780997330.673706:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997330.673709:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780997330.673869:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689b1163100 x1867507127052416/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.673915:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127052416 00000100:00100000:1.0:1780997330.673922:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127052416 00000020:00000040:1.0:1780997330.673925:0:90247:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:1.0:1780997330.673928:0:90247:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=21 00000100:00000040:1.0:1780997330.673948:0:90247:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1780997330.674016:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:1.0:1780997330.674021:0:90247:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:1.0:1780997330.674027:0:90247:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968988536050 x1867507127052416/t0(0) o101->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.674040:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968988536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:92686:x1867507127052416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997330.674055:0:90247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1780997330.674064:0:90247:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff9689896fe700 count: 5 00000020:00000040:1.0:1780997330.674069:0:90247:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689a5a43600 with handle 0x30fd811c0305c495 to hash 00010000:00010000:1.0:1780997330.674073:0:90247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a5a43600/0x30fd811c0305c495 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305c48e expref: -99 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.674080:0:90247:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff968982cc7800 : new locks_count 17 00000020:00000040:1.0:1780997330.674082:0:90247:0:(genops.c:889:class_export_get()) GET export ffff968982cc7800 refcount=22 00010000:00000040:1.0:1780997330.674102:0:90247:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff9689896fe700) refcount = 5 00010000:00000040:1.0:1780997330.674105:0:90247:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1780997330.674109:0:90247:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689ba455000/0x30fd811c0305b633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b62c expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.674117:0:90247:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bff03800/0x30fd811c0305b609 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b602 expref: 22 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.674126:0:90247:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689ba455e00/0x30fd811c0305b5ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e63 expref: 8 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.674144:0:90247:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bff02400/0x30fd811c0305b576 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b56f expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.674150:0:90247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a5a43600/0x30fd811c0305c495 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305c48e expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.674162:0:90247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a5a43600/0x30fd811c0305c495 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305c48e expref: 22 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.674172:0:90247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a5a43600, rc 0) 00010000:00000040:1.0:1780997330.674176:0:90247:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127052416 00000100:00000040:1.0:1780997330.674188:0:90247:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997330.674193:0:90247:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.674212:0:90247:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9689b1163100 x1867507127052416/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.674227:0:90247:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:1.0:1780997330.674232:0:90247:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968988536050 x1867507127052416/t0(0) o101->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/344 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.674242:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968988536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:92686:x1867507127052416:12345-0@lo:101:mount.lustre.0 Request processed in 204us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997330.674250:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:1.0:1780997330.674253:0:90247:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:1.0:1780997330.674264:0:90247:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 21 00000100:00100000:2.0:1780997330.677381:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034780 going to sleep for 11 seconds 00000100:00000040:2.0:1780997330.677429:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b1163100 x1867507127052416/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997330.677443:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1163100 x1867507127052416/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.677451:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1163100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052416:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1780997330.677460:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1163100 x1867507127052416/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780997330.677488:0:92686:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689a5a43400 refcount=4 00010000:00000040:2.0:1780997330.677496:0:92686:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9689a5a43400, remote cookie: 0x30fd811c0305c495, flags: 0x0 00010000:00000040:2.0:1780997330.677506:0:92686:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff96898962ce00) refcount = 4 00010000:00000040:2.0:1780997330.677509:0:92686:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1780997330.677513:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689bff02600/0x30fd811c0305b62c lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b633 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780997330.677523:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff968889ffd000/0x30fd811c0305b602 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b609 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780997330.677529:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff968889ffc400/0x30fd811c0305b56f lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b576 expref: -99 pid: 90239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997330.677537:0:92686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689a5a43400/0x30fd811c0305c48e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c495 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997330.677548:0:92686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689a5a43400/0x30fd811c0305c48e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305c495 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1780997330.677560:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b1163100 x1867507127052416/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780997330.677571:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 10000000:00000040:2.0:1780997330.677581:0:92686:0:(mgc_request.c:108:config_log_get()) log params (ffff968991342800) refs 2 00000020:00000040:2.0:1780997330.677584:0:92686:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689a5a43400 refcount=3 10000000:00000040:2.0:1780997330.677628:0:92686:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968982d5b900 : new refcount 2 10000000:00000040:2.0:1780997330.677632:0:92686:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968982993b40 : new refcount 2 10000000:00000040:2.0:1780997330.677635:0:92686:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.206.151@tcp: copy local log params 00000040:00080000:2.0:1780997330.677901:0:92686:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1780997330.678147:0:92686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780997330.678517:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1780997330.678551:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1780997330.678571:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1780997330.678576:0:92686:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:2.0:1780997330.678612:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:2.0:1780997330.678618:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:2.0:1780997330.678655:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888d28ed80 x1867507127052544/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.678667:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888d28ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052544:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1780997330.678691:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888d28ed80 x1867507127052544/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997330.679475:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997330.679519:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff9689a67c7850 x1867507127052544 msgsize 504 00000100:00100000:2.0:1780997330.679524:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780997330.679525:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1780997330.679975:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff96888d28ed80 x1867507127052544/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.680006:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff96888a47fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1780997330.680074:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127052544 00000100:00100000:0.0:1780997330.680084:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127052544 00000020:00000040:0.0:1780997330.680087:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:0.0:1780997330.680091:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=22 00000100:00000040:0.0:1780997330.680113:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780997330.680150:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:0.0:1780997330.680154:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:0.0:1780997330.680160:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689a67c7850 x1867507127052544/t0(0) o501->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 504/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.680173:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a67c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:92686:x1867507127052544:12345-0@lo:501:mount.lustre.0 00000040:00000040:0.0:1780997330.680195:0:90245:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:0.0:1780997330.680198:0:90245:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:0.0:1780997330.680263:0:90245:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00010000:00000040:0.0:1780997330.680411:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127052544 00000100:00000040:0.0:1780997330.680434:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:0.0:1780997330.680439:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.680465:0:90245:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff96888d28ed80 x1867507127052544/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.680533:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:0.0:1780997330.680539:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a67c7850 x1867507127052544/t0(0) o501->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 504/272 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.680548:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a67c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:92686:x1867507127052544:12345-0@lo:501:mount.lustre.0 Request processed in 378us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997330.680556:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:0.0:1780997330.680559:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:0.0:1780997330.680569:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 21 00000100:00000040:3.0:1780997330.680805:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888d28ed80 x1867507127052544/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.680818:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888d28ed80 x1867507127052544/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.680825:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888d28ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052544:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1780997330.680833:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888d28ed80 x1867507127052544/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.680846:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997330.680850:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888d28ed80 x1867507127052544/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.680869:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.680880:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.680884:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997330.680908:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bb55f100 x1867507127052672/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.680918:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052672:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1780997330.680948:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bb55f100 x1867507127052672/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.680955:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.680975:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff9689bc276050 x1867507127052672 msgsize 272 00000100:00100000:3.0:1780997330.680979:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.680981:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780997330.681038:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bb55f100 x1867507127052672/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.681057:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993600 going to sleep for 11 seconds 00000100:00100000:0.0:1780997330.681093:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127052672 00000100:00100000:0.0:1780997330.681099:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127052672 00000020:00000040:0.0:1780997330.681101:0:90246:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:0.0:1780997330.681103:0:90246:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=22 00000100:00000040:0.0:1780997330.681116:0:90246:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780997330.681164:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:0.0:1780997330.681167:0:90246:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:0.0:1780997330.681172:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bc276050 x1867507127052672/t0(0) o503->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.681183:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:92686:x1867507127052672:12345-0@lo:503:mount.lustre.0 00000040:00000040:0.0:1780997330.681205:0:90246:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:0.0:1780997330.681241:0:90246:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00010000:00000040:0.0:1780997330.681245:0:90246:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127052672 00000100:00000040:0.0:1780997330.681252:0:90246:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:0.0:1780997330.681256:0:90246:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.681562:0:90246:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9689bb55f100 x1867507127052672/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.681599:0:90246:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:0.0:1780997330.681604:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc276050 x1867507127052672/t0(0) o503->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/8416 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.681611:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:92686:x1867507127052672:12345-0@lo:503:mount.lustre.0 Request processed in 430us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997330.681618:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:0.0:1780997330.681620:0:90246:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:0.0:1780997330.681627:0:90246:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 21 00000100:00000040:3.0:1780997330.681708:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bb55f100 x1867507127052672/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.681717:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55f100 x1867507127052672/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.681723:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052672:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1780997330.681737:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bb55f100 x1867507127052672/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.681747:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bb55f100 x1867507127052672/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.681761:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.681772:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000040:00080000:3.0:1780997330.682207:0:92686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:3.0:1780997330.682263:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.682316:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997330.682343:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bb55f100 x1867507127052800/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.682355:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052800:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1780997330.682383:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bb55f100 x1867507127052800/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.682391:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.682412:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff9689a67c5c50 x1867507127052800 msgsize 272 00000100:00100000:3.0:1780997330.682417:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.682419:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780997330.682852:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bb55f100 x1867507127052800/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.682879:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993600 going to sleep for 11 seconds 00000100:00100000:2.0:1780997330.682955:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127052800 00000100:00100000:2.0:1780997330.682962:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127052800 00000020:00000040:2.0:1780997330.682966:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:2.0:1780997330.682969:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=22 00000100:00000040:2.0:1780997330.682993:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780997330.683024:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1780997330.683028:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:2.0:1780997330.683034:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689a67c5c50 x1867507127052800/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.683045:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a67c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:92686:x1867507127052800:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1780997330.683073:0:90245:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:2.0:1780997330.683138:0:90245:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00010000:00000040:2.0:1780997330.683142:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127052800 00000100:00000040:2.0:1780997330.683151:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:2.0:1780997330.683157:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997330.683181:0:90245:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9689bb55f100 x1867507127052800/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997330.683198:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:2.0:1780997330.683203:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a67c5c50 x1867507127052800/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/8472 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.683211:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a67c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:92686:x1867507127052800:12345-0@lo:502:mount.lustre.0 Request processed in 167us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997330.683218:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1780997330.683221:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:2.0:1780997330.683230:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 21 00000100:00000040:3.0:1780997330.683339:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bb55f100 x1867507127052800/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.683350:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55f100 x1867507127052800/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.683359:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052800:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1780997330.683365:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bb55f100 x1867507127052800/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.683378:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bb55f100 x1867507127052800/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.683395:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.683403:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000040:00080000:3.0:1780997330.683625:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1780997330.683655:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1780997330.683671:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1780997330.683686:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1780997330.683713:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:3.0:1780997330.683720:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.683876:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997330.683901:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bb55f100 x1867507127052928/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.683912:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052928:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1780997330.683937:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bb55f100 x1867507127052928/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.683945:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.683964:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff9689a67c5850 x1867507127052928 msgsize 272 00000100:00100000:3.0:1780997330.683969:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.683971:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780997330.683982:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bb55f100 x1867507127052928/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.684000:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993600 going to sleep for 11 seconds 00000100:00100000:2.0:1780997330.684171:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127052928 00000100:00100000:2.0:1780997330.684177:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127052928 00000020:00000040:2.0:1780997330.684179:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:2.0:1780997330.684182:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=22 00000100:00000040:2.0:1780997330.684198:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780997330.684216:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00000040:2.0:1780997330.684220:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:2.0:1780997330.684225:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689a67c5850 x1867507127052928/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.684236:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a67c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:92686:x1867507127052928:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1780997330.684259:0:90245:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:2.0:1780997330.684456:0:90245:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00010000:00000040:2.0:1780997330.684461:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127052928 00000100:00000040:2.0:1780997330.684467:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:2.0:1780997330.684478:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997330.684497:0:90245:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9689bb55f100 x1867507127052928/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997330.684521:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:2.0:1780997330.684526:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a67c5850 x1867507127052928/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/8472 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.684535:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a67c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:92686:x1867507127052928:12345-0@lo:502:mount.lustre.0 Request processed in 301us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997330.684542:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00000040:2.0:1780997330.684545:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:2.0:1780997330.684552:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 21 00000100:00000040:3.0:1780997330.684626:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bb55f100 x1867507127052928/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.684636:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55f100 x1867507127052928/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.684643:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bb55f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127052928:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1780997330.684649:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bb55f100 x1867507127052928/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.684660:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bb55f100 x1867507127052928/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.684678:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997330.684683:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000040:00080000:3.0:1780997330.684723:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1780997330.684811:0:92686:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:3.0:1780997330.685082:0:92686:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968982d5b900 : new refcount 1 00000020:00000040:3.0:1780997330.685087:0:92686:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:3.0:1780997330.685910:0:92694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997330.685922:0:92694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997330.685924:0:92694:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1780997330.685932:0:92694:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96888a990000 00000020:00000080:3.0:1780997330.685934:0:92694:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1780997330.685941:0:92694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780997330.685944:0:92694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997330.685946:0:92694:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1780997330.685948:0:92694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780997330.685950:0:92694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997330.685952:0:92694:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1780997330.685955:0:92694:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96888a990000 00000020:00000080:3.0:1780997330.685957:0:92694:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1780997330.686053:0:92694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780997330.686057:0:92694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780997330.686059:0:92694:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1780997330.686061:0:92694:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:0.0:1780997330.688825:0:92686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1780997330.688887:0:92686:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:0.0:1780997330.688955:0:92686:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689a5a43400 refcount=3 00010000:00010000:0.0:1780997330.688965:0:92686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a5a43400/0x30fd811c0305c48e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c495 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997330.688976:0:92686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689a5a43400/0x30fd811c0305c48e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c495 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997330.689040:0:92686:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1780997330.689044:0:92686:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96888a990000 10000000:01000000:0.0:1780997330.689048:0:92686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96888a990000 10000000:01000000:0.0:1780997330.689052:0:92686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:0.0:1780997330.689056:0:92686:0:(genops.c:889:class_export_get()) GET export ffff968987770000 refcount=20 10000000:01000000:0.0:1780997330.689061:0:92686:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff96888a990000 from 1 10000000:01000000:0.0:1780997330.689064:0:92686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:0.0:1780997330.689072:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00010000:00000040:0.0:1780997330.689102:0:92686:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff96898712d600 count: 9 00000020:00000040:0.0:1780997330.689111:0:92686:0:(lustre_handles.c:77:class_handle_hash()) added object ffff968983ce2000 with handle 0x30fd811c0305c49c to hash 00010000:00010000:0.0:1780997330.689119:0:92686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c0305c49c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997330.689134:0:92686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c0305c49c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997330.689146:0:92686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c0305c49c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1780997330.689170:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfaad180 x1867507127053056/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.689184:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127053056:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1780997330.689214:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfaad180 x1867507127053056/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.689223:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.689266:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff96888753a850 x1867507127053056 msgsize 328 00000100:00100000:0.0:1780997330.689301:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997330.689303:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1780997330.689330:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bfaad180 x1867507127053056/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.689358:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689871083c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780997330.690184:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127053056 00000100:00100000:1.0:1780997330.690196:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127053056 00000020:00000040:1.0:1780997330.690198:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:1.0:1780997330.690202:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=22 00000100:00000040:1.0:1780997330.690224:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1780997330.690300:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00000040:1.0:1780997330.690305:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:1.0:1780997330.690311:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff96888753a850 x1867507127053056/t0(0) o101->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.690323:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:92686:x1867507127053056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780997330.690336:0:90245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1780997330.690345:0:90245:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff968983653900 count: 11 00000020:00000040:1.0:1780997330.690351:0:90245:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689a5a42600 with handle 0x30fd811c0305c4a3 to hash 00010000:00010000:1.0:1780997330.690356:0:90245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689a5a42600/0x30fd811c0305c4a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305c49c expref: -99 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690363:0:90245:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff968982cc7800 : new locks_count 18 00000020:00000040:1.0:1780997330.690365:0:90245:0:(genops.c:889:class_export_get()) GET export ffff968982cc7800 refcount=23 00010000:00000040:1.0:1780997330.690381:0:90245:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff968983653900) refcount = 11 00010000:00000040:1.0:1780997330.690384:0:90245:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1780997330.690388:0:90245:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689a5a43800/0x30fd811c0305c464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305c45d expref: 23 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690398:0:90245:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689a56c8400/0x30fd811c0305ba77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ecc expref: 8 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690406:0:90245:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bc4c1e00/0x30fd811c0305ba70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8ec5 expref: 8 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690412:0:90245:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bc4c0a00/0x30fd811c0305ba69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba62 expref: 23 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690418:0:90245:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689a56c8200/0x30fd811c0305ba3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba38 expref: 23 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690424:0:90245:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689ba455200/0x30fd811c0305ba31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba2a expref: 23 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690436:0:90245:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bb4efa00/0x30fd811c0305ba23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba1c expref: 23 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690443:0:90245:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bc4c0600/0x30fd811c0305ba15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba0e expref: 23 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690450:0:90245:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bc4c0c00/0x30fd811c0305ba07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305ba00 expref: 23 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690456:0:90245:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689ba454200/0x30fd811c0305b9f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b9f2 expref: 23 pid: 90247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.690462:0:90245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a5a42600/0x30fd811c0305c4a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305c49c expref: 23 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.690474:0:90245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689a5a42600/0x30fd811c0305c4a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305c49c expref: 23 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.690482:0:90245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689a5a42600, rc 0) 00010000:00000040:1.0:1780997330.690486:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127053056 00000100:00000040:1.0:1780997330.690496:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997330.690502:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.690530:0:90245:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9689bfaad180 x1867507127053056/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.690557:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:1.0:1780997330.690562:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888753a850 x1867507127053056/t0(0) o101->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/344 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.690572:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:92686:x1867507127053056:12345-0@lo:101:mount.lustre.0 Request processed in 252us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997330.690588:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00000040:1.0:1780997330.690591:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:1.0:1780997330.690601:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 22 00000100:00000040:1.0:1780997330.690653:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfaad180 x1867507127053056/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.690664:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaad180 x1867507127053056/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.690672:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127053056:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1780997330.690679:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfaad180 x1867507127053056/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.690689:0:92686:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff968983ce2000 refcount=4 00010000:00000040:1.0:1780997330.690704:0:92686:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff968983ce2000, remote cookie: 0x30fd811c0305c4a3, flags: 0x0 00010000:00000040:1.0:1780997330.690709:0:92686:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff96898712d600) refcount = 9 00010000:00000040:1.0:1780997330.690711:0:92686:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1780997330.690714:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff96898d6daa00/0x30fd811c0305c45d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305c464 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690721:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689ba454c00/0x30fd811c0305ba62 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba69 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690797:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef600/0x30fd811c0305ba38 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba3f expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690803:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689bb4efc00/0x30fd811c0305ba2a lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba31 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690809:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689ba455400/0x30fd811c0305ba1c lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba23 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690822:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689bb4ee400/0x30fd811c0305ba0e lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba15 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690829:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689bb4ef400/0x30fd811c0305ba00 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305ba07 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.690834:0:92686:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689bc4c1600/0x30fd811c0305b9f2 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305b9f9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.690841:0:92686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c0305c49c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c4a3 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.690850:0:92686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c0305c49c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305c4a3 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1780997330.690861:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfaad180 x1867507127053056/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.690871:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 10000000:00000040:1.0:1780997330.690883:0:92686:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff968885b3fc00) refs 2 00000020:00000040:1.0:1780997330.690886:0:92686:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff968983ce2000 refcount=3 10000000:00000040:1.0:1780997330.690912:0:92686:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968982d5b900 : new refcount 2 10000000:00000040:1.0:1780997330.690916:0:92686:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968982993b40 : new refcount 2 10000000:00000040:1.0:1780997330.690919:0:92686:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.206.151@tcp: copy local log lustre-client 00000040:00080000:1.0:1780997330.691093:0:92686:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1780997330.691372:0:92686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780997330.691566:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1780997330.691592:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1780997330.691606:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1780997330.691619:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1780997330.691633:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1780997330.691659:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1780997330.691673:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1780997330.691685:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1780997330.691712:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1780997330.693162:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1780997330.693201:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1780997330.693219:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1780997330.693232:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1780997330.693244:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1780997330.693256:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1780997330.693373:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1780997330.693400:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1780997330.693414:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1780997330.693426:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1780997330.693442:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1780997330.693456:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1780997330.693469:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1780997330.693481:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1780997330.693495:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1780997330.693507:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1780997330.693521:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1780997330.693533:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1780997330.693546:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1780997330.693558:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1780997330.693572:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1780997330.693587:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1780997330.693599:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1780997330.693612:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1780997330.693627:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1780997330.693641:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1780997330.693654:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1780997330.693666:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1780997330.693708:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1780997330.694523:0:92686:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:1.0:1780997330.694613:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:1.0:1780997330.694622:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:1.0:1780997330.694671:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1161880 x1867507127053184/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.694686:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127053184:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1780997330.694723:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b1161880 x1867507127053184/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.695404:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.695454:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff96898d2cec50 x1867507127053184 msgsize 512 00000100:00100000:1.0:1780997330.695459:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997330.695461:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780997330.695529:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689b1161880 x1867507127053184/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.695562:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034480 going to sleep for 11 seconds 00000100:00100000:3.0:1780997330.708949:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127053184 00000100:00100000:3.0:1780997330.708966:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127053184 00000020:00000040:3.0:1780997330.708969:0:90246:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:3.0:1780997330.708975:0:90246:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=23 00000100:00000040:3.0:1780997330.708999:0:90246:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780997330.709042:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00000040:3.0:1780997330.709047:0:90246:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:3.0:1780997330.709055:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff96898d2cec50 x1867507127053184/t0(0) o501->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 512/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.709084:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96898d2cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:92686:x1867507127053184:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1780997330.709109:0:90246:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:3.0:1780997330.709112:0:90246:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:3.0:1780997330.709183:0:90246:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00000020:00000040:3.0:1780997330.709193:0:90246:0:(genops.c:889:class_export_get()) GET export ffff968982cc7800 refcount=24 00000020:00000040:3.0:1780997330.709197:0:90246:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 23 00010000:00000040:3.0:1780997330.709201:0:90246:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127053184 00000100:00000040:3.0:1780997330.709212:0:90246:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:3.0:1780997330.709218:0:90246:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.709265:0:90246:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9689b1161880 x1867507127053184/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.709317:0:90246:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:3.0:1780997330.709322:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96898d2cec50 x1867507127053184/t0(0) o501->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 512/272 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.709331:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96898d2cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:92686:x1867507127053184:12345-0@lo:501:mount.lustre.0 Request processed in 251us (13875us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997330.709338:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00000040:3.0:1780997330.709341:0:90246:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:3.0:1780997330.709351:0:90246:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 22 00000100:00000040:1.0:1780997330.709574:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b1161880 x1867507127053184/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.709587:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1161880 x1867507127053184/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.709595:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127053184:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1780997330.709605:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1161880 x1867507127053184/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.709617:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000100:00000040:1.0:1780997330.709622:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b1161880 x1867507127053184/t0(0) o501->MGC192.168.206.151@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.709631:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000020:00000040:1.0:1780997330.709644:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:1.0:1780997330.709655:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:1.0:1780997330.709680:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1161880 x1867507127053312/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.709702:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127053312:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1780997330.709896:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b1161880 x1867507127053312/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.709905:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.709926:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff96888753ac50 x1867507127053312 msgsize 272 00000100:00100000:1.0:1780997330.709930:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997330.709932:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780997330.709989:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689b1161880 x1867507127053312/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.710011:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034480 going to sleep for 11 seconds 00000100:00100000:2.0:1780997330.712519:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127053312 00000100:00100000:2.0:1780997330.712536:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127053312 00000020:00000040:2.0:1780997330.712540:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:2.0:1780997330.712545:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=23 00000100:00000040:2.0:1780997330.712574:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780997330.712607:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00000040:2.0:1780997330.712611:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:2.0:1780997330.712618:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff96888753ac50 x1867507127053312/t0(0) o503->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.712632:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:92686:x1867507127053312:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1780997330.712667:0:90245:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:2.0:1780997330.712826:0:90245:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00010000:00000040:2.0:1780997330.712832:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127053312 00000100:00000040:2.0:1780997330.712843:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:2.0:1780997330.712849:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997330.712906:0:90245:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9689b1161880 x1867507127053312/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997330.712954:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:2.0:1780997330.712959:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888753ac50 x1867507127053312/t0(0) o503->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/8416 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.712967:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:92686:x1867507127053312:12345-0@lo:503:mount.lustre.0 Request processed in 338us (3040us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997330.712975:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00000040:2.0:1780997330.712978:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:2.0:1780997330.712988:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 22 00000100:00000040:0.0:1780997330.713106:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b1161880 x1867507127053312/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.713117:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1161880 x1867507127053312/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.713124:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127053312:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1780997330.713132:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1161880 x1867507127053312/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.713145:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b1161880 x1867507127053312/t0(0) o503->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997330.713166:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:0.0:1780997330.713175:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000040:00080000:0.0:1780997330.713616:0:92686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:0.0:1780997330.713671:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:0.0:1780997330.713677:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:0.0:1780997330.713720:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfaad180 x1867507127053440/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.713925:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127053440:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1780997330.713961:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfaad180 x1867507127053440/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.713970:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.713998:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff968887538050 x1867507127053440 msgsize 272 00000100:00100000:0.0:1780997330.714003:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997330.714005:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1780997330.714034:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bfaad180 x1867507127053440/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.714061:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968987108900 going to sleep for 11 seconds 00000100:00100000:2.0:1780997330.714216:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127053440 00000100:00100000:2.0:1780997330.714224:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127053440 00000020:00000040:2.0:1780997330.714226:0:90246:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:2.0:1780997330.714229:0:90246:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=23 00000100:00000040:2.0:1780997330.714246:0:90246:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780997330.714298:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00000040:2.0:1780997330.714303:0:90246:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:2.0:1780997330.714308:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968887538050 x1867507127053440/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.714321:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:92686:x1867507127053440:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1780997330.714345:0:90246:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:2.0:1780997330.714398:0:90246:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00010000:00000040:2.0:1780997330.714403:0:90246:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127053440 00000100:00000040:2.0:1780997330.714410:0:90246:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:2.0:1780997330.714414:0:90246:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997330.714437:0:90246:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9689bfaad180 x1867507127053440/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997330.714456:0:90246:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:2.0:1780997330.714460:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968887538050 x1867507127053440/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/8472 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.714489:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:92686:x1867507127053440:12345-0@lo:502:mount.lustre.0 Request processed in 171us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997330.714496:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00000040:2.0:1780997330.714499:0:90246:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:2.0:1780997330.714508:0:90246:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 22 00000100:00000040:0.0:1780997330.714821:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfaad180 x1867507127053440/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.714831:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaad180 x1867507127053440/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.714837:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127053440:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1780997330.714844:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfaad180 x1867507127053440/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.714854:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfaad180 x1867507127053440/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997330.714879:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:0.0:1780997330.714885:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000040:00080000:0.0:1780997330.715083:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1780997330.715113:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1780997330.715127:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1780997330.715140:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1780997330.715152:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1780997330.715163:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1780997330.715174:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1780997330.715190:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1780997330.715202:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1780997330.715214:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1780997330.715227:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1780997330.715240:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1780997330.715253:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1780997330.715265:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1780997330.715842:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1780997330.715858:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1780997330.715869:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1780997330.715884:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1780997330.715899:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1780997330.715915:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1780997330.715929:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1780997330.715943:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1780997330.715957:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1780997330.715972:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1780997330.715985:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1780997330.715996:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1780997330.716008:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1780997330.716019:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1780997330.716029:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1780997330.716056:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1780997330.716067:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1780997330.716077:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1780997330.716088:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1780997330.716098:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1780997330.716109:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1780997330.716119:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1780997330.716130:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1780997330.716141:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1780997330.716153:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1780997330.716165:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1780997330.716177:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1780997330.716189:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1780997330.716201:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1780997330.716212:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1780997330.716225:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1780997330.716238:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1780997330.716253:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1780997330.716299:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:0.0:1780997330.716322:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:0.0:1780997330.716329:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:0.0:1780997330.716358:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfaad180 x1867507127053568/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.716372:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127053568:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1780997330.716405:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfaad180 x1867507127053568/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.716413:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.716442:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff96888753b850 x1867507127053568 msgsize 272 00000100:00100000:0.0:1780997330.716446:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997330.716448:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1780997330.716473:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bfaad180 x1867507127053568/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.716502:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968987108900 going to sleep for 11 seconds 00000100:00100000:2.0:1780997330.717549:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127053568 00000100:00100000:2.0:1780997330.717563:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127053568 00000020:00000040:2.0:1780997330.717567:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:2.0:1780997330.717572:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=23 00000100:00000040:2.0:1780997330.717600:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780997330.717642:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00000040:2.0:1780997330.717647:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:2.0:1780997330.717653:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff96888753b850 x1867507127053568/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.717665:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:92686:x1867507127053568:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1780997330.717705:0:90245:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:2.0:1780997330.717862:0:90245:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00010000:00000040:2.0:1780997330.717868:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127053568 00000100:00000040:2.0:1780997330.717878:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:2.0:1780997330.717883:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997330.717920:0:90245:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9689bfaad180 x1867507127053568/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997330.717945:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:2.0:1780997330.717950:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888753b850 x1867507127053568/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/8472 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.717959:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:92686:x1867507127053568:12345-0@lo:502:mount.lustre.0 Request processed in 295us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997330.717971:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00000040:2.0:1780997330.717974:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:2.0:1780997330.717984:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 22 00000100:00000040:0.0:1780997330.718357:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfaad180 x1867507127053568/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.718369:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaad180 x1867507127053568/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.718376:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127053568:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1780997330.718384:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfaad180 x1867507127053568/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.718396:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfaad180 x1867507127053568/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997330.718410:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:0.0:1780997330.718416:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000040:00080000:0.0:1780997330.718600:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1780997330.718627:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:0.0:1780997330.718641:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1780997330.718656:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:0.0:1780997330.718667:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:0.0:1780997330.718680:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:0.0:1780997330.718690:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:0.0:1780997330.718716:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:0.0:1780997330.719399:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:0.0:1780997330.719421:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:0.0:1780997330.719436:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:0.0:1780997330.719448:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:0.0:1780997330.719461:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:0.0:1780997330.719474:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:0.0:1780997330.719484:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:0.0:1780997330.719490:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:0.0:1780997330.719528:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfaad180 x1867507127053696/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.719540:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127053696:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1780997330.719571:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfaad180 x1867507127053696/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.719580:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.719611:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff968887539450 x1867507127053696 msgsize 272 00000100:00100000:0.0:1780997330.719616:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997330.719618:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1780997330.719690:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bfaad180 x1867507127053696/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.719731:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968987108900 going to sleep for 11 seconds 00000100:00100000:2.0:1780997330.720618:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127053696 00000100:00100000:2.0:1780997330.720627:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127053696 00000020:00000040:2.0:1780997330.720630:0:90246:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:2.0:1780997330.720634:0:90246:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=23 00000100:00000040:2.0:1780997330.720655:0:90246:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780997330.720736:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00000040:2.0:1780997330.720740:0:90246:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:2.0:1780997330.720748:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968887539450 x1867507127053696/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.720760:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:92686:x1867507127053696:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1780997330.720795:0:90246:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968888756a80 : new refcount 2 00000040:00000040:2.0:1780997330.720847:0:90246:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968888756a80 : new refcount 1 00010000:00000040:2.0:1780997330.720853:0:90246:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127053696 00000100:00000040:2.0:1780997330.720863:0:90246:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:2.0:1780997330.720868:0:90246:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997330.720909:0:90246:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9689bfaad180 x1867507127053696/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997330.720942:0:90246:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 51 to 0@lo 00000100:00000040:2.0:1780997330.720948:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968887539450 x1867507127053696/t0(0) o502->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 272/8472 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.720956:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:92686:x1867507127053696:12345-0@lo:502:mount.lustre.0 Request processed in 198us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997330.720963:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00000040:2.0:1780997330.720966:0:90246:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:2.0:1780997330.720982:0:90246:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 22 00000100:00000040:1.0:1780997330.721067:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfaad180 x1867507127053696/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.721079:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaad180 x1867507127053696/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.721085:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127053696:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1780997330.721092:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfaad180 x1867507127053696/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.721103:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfaad180 x1867507127053696/t0(0) o502->MGC192.168.206.151@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.721116:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:1.0:1780997330.721123:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000040:00080000:1.0:1780997330.721174:0:92686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:1.0:1780997330.721190:0:92686:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:1.0:1780997330.721515:0:92686:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968982d5b900 : new refcount 1 00000020:00000040:1.0:1780997330.721526:0:92686:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:1.0:1780997330.722034:0:92697:0:(lustre_peer.c:111:class_add_uuid()) found uuid 192.168.206.151@tcp 192.168.206.151@tcp cnt=1 00000020:01000004:1.0:1780997330.722055:0:92697:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1780997330.722070:0:92697:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9689ba4e3380) 00000020:00000040:1.0:1780997330.722076:0:92697:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689ad6c8000 with handle 0x30fd811c0305c4aa to hash 00000020:00000040:1.0:1780997330.722081:0:92697:0:(genops.c:900:class_export_put()) PUTting export ffff9689ad6c8000 : new refcount 1 00000020:00000040:1.0:1780997330.722096:0:92697:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9689ba4e3380) now 2 - obd_device_list 00000020:00000080:1.0:1780997330.722101:0:92697:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1780997330.722263:0:92697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96888a990000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1780997330.722267:0:92697:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96888a990000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1780997330.722292:0:92697:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96888a990000 3 00000020:00000040:1.0:1780997330.722309:0:92697:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9689ba4e3380) now 3 - import 00000020:00000040:1.0:1780997330.722314:0:92697:0:(genops.c:1244:class_import_put()) import ffff9689ad6ca000 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:1.0:1780997330.722325:0:92697:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997330.722328:0:92697:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 52 to 0@lo 00000100:00000040:1.0:1780997330.722330:0:92697:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.206.151@tcp -> ffff96898a59b400 00010000:00080000:1.0:1780997330.722334:0:92697:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689ad6ca000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1780997330.725949:0:92697:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:1.0:1780997330.726072:0:92697:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9689ba4e3380) now 4 - setup 00000020:00000080:1.0:1780997330.726078:0:92697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1780997330.726124:0:92697:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000040:1.0:1780997330.726130:0:92697:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689bca5c800 with handle 0x30fd811c0305c4b1 to hash 00000020:00000040:1.0:1780997330.726136:0:92697:0:(genops.c:889:class_export_get()) GET export ffff9689bca5c800 refcount=3 00000020:00000040:1.0:1780997330.726140:0:92697:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9689ba4e3380) now 5 - export 00000020:00000040:1.0:1780997330.726143:0:92697:0:(genops.c:900:class_export_put()) PUTting export ffff9689bca5c800 : new refcount 2 00000020:00000080:1.0:1780997330.726145:0:92697:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x30fd811c0305c4b1 00000020:00000040:1.0:1780997330.726147:0:92697:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c4b1 00000020:00000040:1.0:1780997330.726150:0:92697:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bca5c800 refcount=3 00000100:00080000:1.0:1780997330.726158:0:92697:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:1.0:1780997330.726163:0:92697:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 53 to 0@lo 00000020:00000040:1.0:1780997330.726170:0:92697:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c4b1 00000020:00000040:1.0:1780997330.726172:0:92697:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bca5c800 refcount=4 00000100:00000040:1.0:1780997330.726174:0:92697:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 54 to 0@lo 00000020:00000040:1.0:1780997330.726176:0:92697:0:(genops.c:900:class_export_put()) PUTting export ffff9689bca5c800 : new refcount 3 00000100:00080000:1.0:1780997330.726178:0:92697:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9689ad6ca000 using connection 192.168.206.151@tcp/0@lo 00000020:00000040:1.0:1780997330.726192:0:92697:0:(genops.c:1231:class_import_get()) import ffff9689ad6ca000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:1.0:1780997330.726214:0:92697:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b1161880 x1867507127053824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.726228:0:92697:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000601df19] to pc [ptlrpcd_rcv+-1] req@ffff9689b1161880 x1867507127053824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997330.726252:0:92697:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:1.0:1780997330.726255:0:92697:0:(genops.c:1231:class_import_get()) import ffff9689ad6ca000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:1.0:1780997330.726307:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780997330.726314:0:36:0:(genops.c:1231:class_import_get()) import ffff9689bcdfb800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1780997330.726323:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9689b1163100 x1867507127053952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.726334:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bd4c7d11] to pc [ptlrpcd_00_00+0] req@ffff9689b1163100 x1867507127053952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.726362:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780997330.726368:0:36:0:(genops.c:1231:class_import_get()) import ffff968885ce2000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1780997330.726376:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9689bfb1df80 x1867507127054080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.726385:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001126e7b9] to pc [ptlrpcd_00_01+1] req@ffff9689bfb1df80 x1867507127054080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.726393:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780997330.726404:0:36:0:(genops.c:1231:class_import_get()) import ffff9689ae566000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1780997330.726412:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9689bfb1dc00 x1867507127054208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.726422:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000da63678] to pc [ptlrpcd_00_02+2] req@ffff9689bfb1dc00 x1867507127054208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997330.726439:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997330.726443:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1780997330.726445:0:36:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997330.726449:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3856 00000100:00080000:1.0:1780997330.726452:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00000040:1.0:1780997330.726454:0:36:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 53 to 0@lo 00000100:00000040:1.0:1780997330.726457:0:36:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 54 to 0@lo 00000020:00000040:1.0:1780997330.726459:0:36:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c03055384 00000020:00000040:1.0:1780997330.726461:0:36:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79cc800 refcount=4 00000100:00000040:1.0:1780997330.726463:0:36:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 53 to 0@lo 00000100:00000040:1.0:1780997330.726465:0:36:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 54 to 0@lo 00000020:00000040:1.0:1780997330.726467:0:36:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79cc800 : new refcount 3 00000100:00080000:1.0:1780997330.726469:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff968990cc0800 using connection 192.168.206.151@tcp/0@lo 00000020:00000040:1.0:1780997330.726475:0:36:0:(genops.c:1231:class_import_get()) import ffff968990cc0800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1780997330.726484:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfb1ce00 x1867507127054336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.726491:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000fa1a14fb] to pc [ptlrpcd_rcv+-1] req@ffff9689bfb1ce00 x1867507127054336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.726497:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780997330.726501:0:36:0:(genops.c:1231:class_import_get()) import ffff9689a69f7000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1780997330.726506:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9689bfb1c700 x1867507127054464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.726520:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b71915c5] to pc [ptlrpcd_00_03+3] req@ffff9689bfb1c700 x1867507127054464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.726527:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780997330.726532:0:36:0:(genops.c:1231:class_import_get()) import ffff96888b416000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1780997330.726539:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9689bfb1ca80 x1867507127054592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.726548:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000057021637] to pc [ptlrpcd_00_00+0] req@ffff9689bfb1ca80 x1867507127054592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.726555:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780997330.726560:0:36:0:(genops.c:1231:class_import_get()) import ffff9689869cf800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1780997330.726565:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff9689bfb1fb80 x1867507127054720/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.726574:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c8802b11] to pc [ptlrpcd_00_01+1] req@ffff9689bfb1fb80 x1867507127054720/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997330.726581:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780997330.726583:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1780997330.726585:0:36:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780997330.726588:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3856 00000100:00080000:1.0:1780997330.726591:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00000040:1.0:1780997330.726593:0:36:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 53 to 0@lo 00000100:00000040:1.0:1780997330.726595:0:36:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 54 to 0@lo 00000020:00000040:1.0:1780997330.726597:0:36:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b537 00000020:00000040:1.0:1780997330.726599:0:36:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689891ac800 refcount=4 00000100:00000040:1.0:1780997330.726602:0:36:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 53 to 0@lo 00000100:00000040:1.0:1780997330.726609:0:36:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 54 to 0@lo 00000020:00000040:1.0:1780997330.726611:0:36:0:(genops.c:900:class_export_put()) PUTting export ffff9689891ac800 : new refcount 3 00000100:00080000:1.0:1780997330.726614:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96888a815000 using connection 192.168.206.151@tcp/0@lo 00000020:00000040:1.0:1780997330.726620:0:36:0:(genops.c:1231:class_import_get()) import ffff96888a815000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:1.0:1780997330.726629:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689bfb1e680 x1867507127054848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.726638:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c92e3278] to pc [ptlrpcd_rcv+-1] req@ffff9689bfb1e680 x1867507127054848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.726645:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780997330.726650:0:36:0:(genops.c:1231:class_import_get()) import ffff968886bc8000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1780997330.726656:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9689bc960000 x1867507127054976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.726665:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b4fc16b2] to pc [ptlrpcd_00_02+2] req@ffff9689bc960000 x1867507127054976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.726672:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780997330.726676:0:36:0:(genops.c:1231:class_import_get()) import ffff96898616b000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1780997330.726681:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9689bc963100 x1867507127055104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.726688:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006574404f] to pc [ptlrpcd_00_03+3] req@ffff9689bc963100 x1867507127055104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.726712:0:36:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (3863) 00000100:00000040:1.0:1780997330.726731:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfb1df80 x1867507127054080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.726744:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507127054080:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.726774:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfb1df80 x1867507127054080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.726788:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.726824:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff9689bc961180 x1867507127054080 msgsize 224 00000100:00100000:1.0:1780997330.726828:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997330.726846:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfb1df80 x1867507127054080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.726858:0:3497:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7828 usecs (8 jiffies) 00000100:00000040:1.0:1780997330.726867:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfb1fb80 x1867507127054720/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.726876:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127054720:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.726890:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfb1fb80 x1867507127054720/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.726896:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.726910:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff9689bc960380 x1867507127054720 msgsize 224 00000100:00100000:1.0:1780997330.726914:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997330.726927:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfb1fb80 x1867507127054720/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.726935:0:3497:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 8132 usecs (9 jiffies) 00000100:00100000:1.0:1780997330.726946:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00000040:1.0:1780997330.726951:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1163100 x1867507127053952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.726959:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507127053952:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.726971:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b1163100 x1867507127053952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.726977:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.726989:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff9689bc963b80 x1867507127053952 msgsize 224 00000100:00100000:1.0:1780997330.726993:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997330.727006:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1163100 x1867507127053952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.727022:0:3497:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8543 usecs (9 jiffies) 00000100:00000040:1.0:1780997330.727028:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfb1ca80 x1867507127054592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.727036:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507127054592:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.727046:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfb1ca80 x1867507127054592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.727052:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.727062:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff9689bc962d80 x1867507127054592 msgsize 224 00000100:00100000:1.0:1780997330.727065:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997330.727085:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfb1ca80 x1867507127054592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.727093:0:3497:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 137736 usecs (138 jiffies) 00000100:00000040:1.0:1780997330.727110:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfb1dc00 x1867507127054208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.727118:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127054208:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.727130:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfb1dc00 x1867507127054208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.727137:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.727147:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689bc960e00 x1867507127054208 msgsize 224 00000100:00100000:1.0:1780997330.727152:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997330.727164:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfb1dc00 x1867507127054208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.727172:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 950437 usecs (951 jiffies) 00000100:00000040:1.0:1780997330.727177:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bc960000 x1867507127054976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.727187:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127054976:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.727204:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bc960000 x1867507127054976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.727210:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.727224:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689b10c0a80 x1867507127054976 msgsize 224 00000100:00100000:1.0:1780997330.727227:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997330.727240:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bc960000 x1867507127054976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.727248:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7825 usecs (8 jiffies) 00000100:00100000:1.0:1780997330.727256:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:1.0:1780997330.727261:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfb1c700 x1867507127054464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.727291:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127054464:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.727302:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfb1c700 x1867507127054464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.727308:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.727320:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689aebba680 x1867507127054464 msgsize 224 00000100:00100000:1.0:1780997330.727324:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997330.727335:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfb1c700 x1867507127054464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.727344:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5858 usecs (6 jiffies) 00000100:00000040:1.0:1780997330.727349:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bc963100 x1867507127055104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.727356:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507127055104:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.727367:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bc963100 x1867507127055104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.727374:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.727385:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689aebb8700 x1867507127055104 msgsize 224 00000100:00100000:1.0:1780997330.727394:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997330.727409:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bc963100 x1867507127055104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.727418:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8410 usecs (9 jiffies) 00000100:00100000:1.0:1780997330.727441:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127054976 00000100:00100000:1.0:1780997330.727448:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127054976 00000020:00000040:1.0:1780997330.727450:0:25172:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b55a 00000020:00000040:1.0:1780997330.727452:0:25172:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968886bcb000 refcount=5 00000020:00000040:1.0:1780997330.727466:0:25172:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:1.0:1780997330.727486:0:25172:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1780997330.727507:0:25172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127054464 00000100:00100000:1.0:1780997330.727510:0:25172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127054464 00000020:00000040:1.0:1780997330.727511:0:25172:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c030553a7 00000020:00000040:1.0:1780997330.727513:0:25172:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689ae564000 refcount=5 00000100:00100000:1.0:1780997330.727532:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726 00000100:00000040:1.0:1780997330.727536:0:25172:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968886bcb000 : new rpc_count 1 00000100:00000040:1.0:1780997330.727541:0:25172:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b10c0a80 x1867507127054976/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:661/0 lens 224/0 e 0 to 0 dl 1780997341 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.727552:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b10c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127054976:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780997330.727574:0:25172:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1867507127054976 00000100:00000040:1.0:1780997330.727584:0:25172:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:1.0:1780997330.727588:0:25172:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.727605:0:25172:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689bc960000 x1867507127054976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.727623:0:25172:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 54 to 0@lo 00000100:00000040:1.0:1780997330.727627:0:25172:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b10c0a80 x1867507127054976/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:661/0 lens 224/224 e 0 to 0 dl 1780997341 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.727636:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b10c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127054976:12345-0@lo:400:kworker.0 Request processed in 86us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997330.727652:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726 00000100:00000040:1.0:1780997330.727655:0:25172:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968886bcb000 : new rpc_count 0 00000020:00000040:1.0:1780997330.727664:0:25172:0:(genops.c:900:class_export_put()) PUTting export ffff968886bcb000 : new refcount 4 00000100:00100000:1.0:1780997330.727672:0:25172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727 00000100:00000040:1.0:1780997330.727675:0:25172:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689ae564000 : new rpc_count 1 00000100:00000040:1.0:1780997330.727679:0:25172:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689aebba680 x1867507127054464/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:661/0 lens 224/0 e 0 to 0 dl 1780997341 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.727689:0:25172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127054464:12345-0@lo:400:kworker.0 00000100:00000040:3.0:1780997330.727852:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1161880 x1867507127053824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.727862:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507127053824:0@lo:38:llog_process_th.0 00000100:00000040:3.0:1780997330.727880:0:3495:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b1161880 x1867507127053824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1780997340 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.727886:0:3495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.727905:0:3495:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55f100 x1867507127053824 msgsize 520 00000100:00100000:3.0:1780997330.727908:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.727922:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1161880 x1867507127053824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1780997340 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.727931:0:3495:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000040:3.0:1780997330.727946:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfb1ce00 x1867507127054336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.727954:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127054336:0@lo:8:kworker.0 00000100:00000040:3.0:1780997330.727965:0:3495:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfb1ce00 x1867507127054336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997355 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.727972:0:3495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.727983:0:3495:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55ca80 x1867507127054336 msgsize 520 00000100:00100000:3.0:1780997330.727987:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.728000:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfb1ce00 x1867507127054336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997355 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.728008:0:3495:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5291 usecs (6 jiffies) 00000100:00000040:3.0:1780997330.728014:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfb1e680 x1867507127054848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.728021:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507127054848:0@lo:8:kworker.0 00000100:00000040:3.0:1780997330.728031:0:3495:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfb1e680 x1867507127054848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997355 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.728037:0:3495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.728047:0:3495:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55e680 x1867507127054848 msgsize 520 00000100:00100000:3.0:1780997330.728050:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.728061:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfb1e680 x1867507127054848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997355 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.728068:0:3495:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7925 usecs (8 jiffies) 00000100:00100000:3.0:1780997330.728090:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127054080 00000100:00100000:3.0:1780997330.728099:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127054080 00000020:00000040:3.0:1780997330.728101:0:63418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305541e 00000020:00000040:3.0:1780997330.728103:0:63418:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968983335800 refcount=5 00000020:00000040:3.0:1780997330.728112:0:63418:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9689ba680000) now 10 - evictor 00000100:00000040:3.0:1780997330.728123:0:63418:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1780997330.728141:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127053952 00000100:00100000:3.0:1780997330.728143:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127053952 00000020:00000040:3.0:1780997330.728145:0:63418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b687 00000020:00000040:3.0:1780997330.728147:0:63418:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bfa9f000 refcount=5 00000020:00000040:3.0:1780997330.728154:0:63418:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff96888ac53380) now 14 - evictor 00000100:00100000:3.0:1780997330.728164:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127054592 00000100:00100000:3.0:1780997330.728166:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127054592 00000020:00000040:3.0:1780997330.728167:0:63418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b68e 00000020:00000040:3.0:1780997330.728169:0:63418:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968986145800 refcount=5 00000100:00100000:3.0:1780997330.728179:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127055104 00000100:00100000:3.0:1780997330.728181:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127055104 00000020:00000040:3.0:1780997330.728182:0:63418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b695 00000020:00000040:3.0:1780997330.728184:0:63418:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968983331000 refcount=5 00000100:00100000:3.0:1780997330.728193:0:63418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127053824 00000100:00100000:3.0:1780997330.728195:0:63418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127053824 00000020:00000040:3.0:1780997330.728196:0:63418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:3.0:1780997330.728205:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00000040:3.0:1780997330.728208:0:63418:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968983335800 : new rpc_count 1 00000100:00000040:3.0:1780997330.728212:0:63418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bc961180 x1867507127054080/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:661/0 lens 224/0 e 0 to 0 dl 1780997341 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.728221:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507127054080:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997330.728232:0:63418:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127054080 00000100:00000040:3.0:1780997330.728237:0:63418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:3.0:1780997330.728241:0:63418:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.728257:0:63418:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689bfb1df80 x1867507127054080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.728310:0:63418:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 54 to 0@lo 00000100:00000040:3.0:1780997330.728315:0:63418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc961180 x1867507127054080/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:661/0 lens 224/224 e 0 to 0 dl 1780997341 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.728323:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507127054080:12345-0@lo:400:kworker.0 Request processed in 102us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997330.728329:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00000040:3.0:1780997330.728332:0:63418:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968983335800 : new rpc_count 0 00000020:00000040:3.0:1780997330.728340:0:63418:0:(genops.c:900:class_export_put()) PUTting export ffff968983335800 : new refcount 4 00000100:00100000:3.0:1780997330.728348:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00000040:3.0:1780997330.728350:0:63418:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bfa9f000 : new rpc_count 1 00000100:00000040:3.0:1780997330.728353:0:63418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bc963b80 x1867507127053952/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:661/0 lens 224/0 e 0 to 0 dl 1780997341 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.728364:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507127053952:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997330.728374:0:63418:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127053952 00000100:00000040:3.0:1780997330.728378:0:63418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:3.0:1780997330.728381:0:63418:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.728397:0:63418:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689b1163100 x1867507127053952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.728409:0:63418:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 54 to 0@lo 00000100:00000040:3.0:1780997330.728412:0:63418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc963b80 x1867507127053952/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:661/0 lens 224/224 e 0 to 0 dl 1780997341 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.728419:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3497:x1867507127053952:12345-0@lo:400:kworker.0 Request processed in 57us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997330.728424:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00000040:3.0:1780997330.728426:0:63418:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bfa9f000 : new rpc_count 0 00000020:00000040:3.0:1780997330.728440:0:63418:0:(genops.c:900:class_export_put()) PUTting export ffff9689bfa9f000 : new refcount 4 00000100:00100000:3.0:1780997330.728450:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00000040:3.0:1780997330.728452:0:63418:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968986145800 : new rpc_count 1 00000100:00000040:3.0:1780997330.728455:0:63418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bc962d80 x1867507127054592/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:661/0 lens 224/0 e 0 to 0 dl 1780997341 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.728464:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3497:x1867507127054592:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997330.728473:0:63418:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127054592 00000100:00000040:3.0:1780997330.728477:0:63418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:3.0:1780997330.728480:0:63418:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.728496:0:63418:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689bfb1ca80 x1867507127054592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.728506:0:63418:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 54 to 0@lo 00000100:00000040:3.0:1780997330.728510:0:63418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc962d80 x1867507127054592/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:661/0 lens 224/224 e 0 to 0 dl 1780997341 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.728517:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3497:x1867507127054592:12345-0@lo:400:kworker.0 Request processed in 54us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997330.728522:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00000040:3.0:1780997330.728524:0:63418:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968986145800 : new rpc_count 0 00000020:00000040:3.0:1780997330.728529:0:63418:0:(genops.c:900:class_export_put()) PUTting export ffff968986145800 : new refcount 4 00000100:00100000:3.0:1780997330.728536:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00000040:3.0:1780997330.728538:0:63418:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968983331000 : new rpc_count 1 00000100:00000040:3.0:1780997330.728541:0:63418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689aebb8700 x1867507127055104/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:661/0 lens 224/0 e 0 to 0 dl 1780997341 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.728550:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507127055104:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997330.728559:0:63418:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127055104 00000100:00000040:3.0:1780997330.728563:0:63418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:3.0:1780997330.728574:0:63418:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.728588:0:63418:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689bc963100 x1867507127055104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.728599:0:63418:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 54 to 0@lo 00000100:00000040:3.0:1780997330.728603:0:63418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689aebb8700 x1867507127055104/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:661/0 lens 224/224 e 0 to 0 dl 1780997341 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.728611:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3498:x1867507127055104:12345-0@lo:400:kworker.0 Request processed in 63us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997330.728617:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00000040:3.0:1780997330.728619:0:63418:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968983331000 : new rpc_count 0 00000020:00000040:3.0:1780997330.728626:0:63418:0:(genops.c:900:class_export_put()) PUTting export ffff968983331000 : new refcount 4 00000100:00100000:3.0:1780997330.728635:0:63418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00000040:3.0:1780997330.728638:0:63418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55f100 x1867507127053824/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1780997350 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.728645:0:63418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3495:x1867507127053824:12345-0@lo:38:llog_process_th.0 00000020:00000040:3.0:1780997330.728657:0:63418:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff96888ac53380) now 15 - find 00010000:00000040:3.0:1780997330.728665:0:63418:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1780997330.728671:0:63418:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3858 last 0 00000020:00000040:3.0:1780997330.728679:0:63418:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689bc96a800 with handle 0x30fd811c0305c4b8 to hash 00000020:00000040:3.0:1780997330.728719:0:63418:0:(genops.c:889:class_export_get()) GET export ffff9689bc96a800 refcount=3 00000020:00000040:3.0:1780997330.728723:0:63418:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff96888ac53380) now 16 - export 00000100:00100000:0.0:1780997330.728873:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127054720 00000100:00100000:0.0:1780997330.728880:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127054720 00000020:00000040:0.0:1780997330.728881:0:8241:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b530 00000020:00000040:0.0:1780997330.728885:0:8241:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968889698800 refcount=5 00000100:00000040:0.0:1780997330.728902:0:8241:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1780997330.728919:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127054208 00000100:00100000:0.0:1780997330.728922:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127054208 00000020:00000040:0.0:1780997330.728923:0:8241:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b4ea 00000020:00000040:0.0:1780997330.728926:0:8241:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79c9000 refcount=7 00000020:00000040:3.0:1780997330.728951:0:63418:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc96a800 : new refcount 2 00000020:00000080:3.0:1780997330.728953:0:63418:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x30fd811c0305c4b8 00000020:00000040:3.0:1780997330.728955:0:63418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c4b8 00000020:00000040:3.0:1780997330.728957:0:63418:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc96a800 refcount=3 00000001:00000040:3.0:1780997330.728967:0:63418:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.206.151@tcp 00000001:00000040:3.0:1780997330.728972:0:63418:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9689b7f19800) : new refcount 15 00000020:00000040:3.0:1780997330.728975:0:63418:0:(genops.c:889:class_export_get()) GET export ffff9689bc96a800 refcount=4 00000001:00000040:3.0:1780997330.728983:0:63418:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9689b7f19800) : new refcount 16 00000001:00000040:3.0:1780997330.728987:0:63418:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9689b7f19800) : new refcount 15 00000004:00100000:3.0:1780997330.728994:0:63418:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:3.0:1780997330.729006:0:63418:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff968885f66a80 for nid 0@lo - ref 6 00000020:00000040:3.0:1780997330.729017:0:63418:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff96888ac53380) now 17 - import 00000020:00000040:3.0:1780997330.729024:0:63418:0:(genops.c:1244:class_import_put()) import ffff9689bc96c000 refcount=1 obd=lustre-MDT0000 00000100:00100000:0.0:1780997330.729152:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4154 00000100:00000040:0.0:1780997330.729155:0:8241:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968889698800 : new rpc_count 1 00000100:00000040:0.0:1780997330.729159:0:8241:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bc960380 x1867507127054720/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:661/0 lens 224/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.729169:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127054720:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780997330.729181:0:8241:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127054720 00000100:00000040:0.0:1780997330.729185:0:8241:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:0.0:1780997330.729188:0:8241:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.729211:0:8241:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689bfb1fb80 x1867507127054720/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.729224:0:8241:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 54 to 0@lo 00000100:00000040:0.0:1780997330.729228:0:8241:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc960380 x1867507127054720/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:661/0 lens 224/224 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.729235:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127054720:12345-0@lo:400:kworker.0 Request processed in 67us (2323us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997330.729241:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4154 00000100:00000040:0.0:1780997330.729243:0:8241:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968889698800 : new rpc_count 0 00000020:00000040:0.0:1780997330.729249:0:8241:0:(genops.c:900:class_export_put()) PUTting export ffff968889698800 : new refcount 4 00000100:00100000:0.0:1780997330.729256:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4155 00000100:00000040:0.0:1780997330.729258:0:8241:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689b79c9000 : new rpc_count 1 00000100:00000040:0.0:1780997330.729261:0:8241:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bc960e00 x1867507127054208/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:661/0 lens 224/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.729290:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127054208:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780997330.729299:0:8241:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1867507127054208 00000100:00000040:0.0:1780997330.729304:0:8241:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:0.0:1780997330.729307:0:8241:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.729322:0:8241:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689bfb1dc00 x1867507127054208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.729333:0:8241:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 54 to 0@lo 00000100:00000040:0.0:1780997330.729337:0:8241:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc960e00 x1867507127054208/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:661/0 lens 224/224 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.729344:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127054208:12345-0@lo:400:kworker.0 Request processed in 75us (2195us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997330.729349:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4155 00000100:00000040:0.0:1780997330.729351:0:8241:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689b79c9000 : new rpc_count 0 00000020:00000040:0.0:1780997330.729363:0:8241:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79c9000 : new refcount 6 00000100:00080000:0.0:1780997330.729384:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1780997330.729388:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff96888ac53380) now 17 - evictor 00000100:00080000:0.0:1780997330.729391:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1780997330.729393:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9689ba680000) now 10 - evictor 00000100:00080000:0.0:1780997330.729395:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1780997330.729397:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00100000:0.0:1780997330.729407:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127054336 00000100:00100000:0.0:1780997330.729411:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127054336 00000020:00000040:0.0:1780997330.729413:0:9596:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c03055399 00000100:00100000:0.0:1780997330.729429:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127054848 00000100:00100000:0.0:1780997330.729432:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127054848 00000020:00000040:0.0:1780997330.729433:0:9596:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b53e 00000100:00100000:0.0:1780997330.729449:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6058 00000100:00000040:0.0:1780997330.729454:0:9596:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55ca80 x1867507127054336/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780997350 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.729462:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3495:x1867507127054336:12345-0@lo:8:kworker.0 00000020:00000040:0.0:1780997330.729472:0:9596:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 7 - find 00010000:00000040:0.0:1780997330.729476:0:9596:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:0.0:1780997330.729478:0:9596:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9689aeba3380) now 7 - find 00000100:00000040:0.0:1780997330.729486:0:9596:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:0.0:1780997330.729488:0:9596:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:0.0:1780997330.729491:0:9596:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.729507:0:9596:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9689bfb1ce00 x1867507127054336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997355 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.729524:0:9596:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 54 to 0@lo 00000100:00000040:0.0:1780997330.729528:0:9596:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55ca80 x1867507127054336/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780997350 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.729536:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3495:x1867507127054336:12345-0@lo:8:kworker.0 Request processed in 73us (1551us total) trans 0 rc -11/-11 00000100:00100000:0.0:1780997330.729551:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6058 00000100:00100000:0.0:1780997330.729563:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6059 00000100:00000040:0.0:1780997330.729567:0:9596:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55e680 x1867507127054848/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780997350 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.729575:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3495:x1867507127054848:12345-0@lo:8:kworker.0 00000020:00000040:0.0:1780997330.729583:0:9596:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 7 - find 00010000:00000040:0.0:1780997330.729586:0:9596:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:0.0:1780997330.729588:0:9596:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9689aeba3380) now 7 - find 00000100:00000040:0.0:1780997330.729596:0:9596:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:0.0:1780997330.729598:0:9596:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:0.0:1780997330.729600:0:9596:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.729615:0:9596:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9689bfb1e680 x1867507127054848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997355 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.729626:0:9596:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 54 to 0@lo 00000100:00000040:0.0:1780997330.729630:0:9596:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55e680 x1867507127054848/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780997350 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.729637:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3495:x1867507127054848:12345-0@lo:8:kworker.0 Request processed in 62us (1589us total) trans 0 rc -11/-11 00000100:00100000:0.0:1780997330.729642:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6059 00000100:00000040:0.0:1780997330.729705:0:3495:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969473 00000100:00000040:0.0:1780997330.729712:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfb1ce00 x1867507127054336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997355 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997330.729722:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00000040:1.0:1780997330.729888:0:25172:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1867507127054464 00000100:00000040:1.0:1780997330.729894:0:25172:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:1.0:1780997330.729898:0:25172:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.729918:0:25172:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689bfb1c700 x1867507127054464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.729930:0:25172:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 54 to 0@lo 00000100:00000040:1.0:1780997330.729934:0:25172:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689aebba680 x1867507127054464/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:661/0 lens 224/224 e 0 to 0 dl 1780997341 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.729941:0:25172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3498:x1867507127054464:12345-0@lo:400:kworker.0 Request processed in 2254us (2619us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997330.729948:0:25172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727 00000100:00000040:1.0:1780997330.729950:0:25172:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689ae564000 : new rpc_count 0 00000020:00000040:1.0:1780997330.729957:0:25172:0:(genops.c:900:class_export_put()) PUTting export ffff9689ae564000 : new refcount 4 00000100:00000040:1.0:1780997330.729997:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:1.0:1780997330.730003:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfb1c700 x1867507127054464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.730012:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1c700 x1867507127054464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.730032:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127054464:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.730046:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1780997330.730051:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bc963100 x1867507127055104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.730057:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc963100 x1867507127055104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.730063:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3498:1867507127055104:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.730071:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:1.0:1780997330.730074:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfb1dc00 x1867507127054208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.730080:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1dc00 x1867507127054208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.730085:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127054208:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.730094:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:1.0:1780997330.730097:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bc960000 x1867507127054976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.730104:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc960000 x1867507127054976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.730110:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127054976:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.730115:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfb1c700 x1867507127054464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.730125:0:3498:0:(genops.c:1244:class_import_put()) import ffff9689a69f7000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1780997330.730138:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bc963100 x1867507127055104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.730144:0:3498:0:(genops.c:1244:class_import_put()) import ffff96898616b000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1780997330.730149:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfb1dc00 x1867507127054208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.730155:0:3498:0:(genops.c:1244:class_import_put()) import ffff9689ae566000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1780997330.730158:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bc960000 x1867507127054976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.730164:0:3498:0:(genops.c:1244:class_import_put()) import ffff968886bc8000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1780997330.730188:0:3497:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1780997330.730193:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b1163100 x1867507127053952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.730200:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1163100 x1867507127053952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.730205:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3497:1867507127053952:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.730215:0:3497:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1780997330.730218:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfb1ca80 x1867507127054592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.730224:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1ca80 x1867507127054592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.730230:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3497:1867507127054592:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.730240:0:3497:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1780997330.730243:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfb1df80 x1867507127054080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.730250:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1df80 x1867507127054080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.730261:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507127054080:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.730288:0:3497:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1780997330.730292:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfb1fb80 x1867507127054720/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997330.730299:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1fb80 x1867507127054720/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.730305:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127054720:0@lo:400:kworker.0 00000100:00000040:1.0:1780997330.730310:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b1163100 x1867507127053952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.730319:0:3497:0:(genops.c:1244:class_import_put()) import ffff9689bcdfb800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1780997330.730324:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfb1ca80 x1867507127054592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.730330:0:3497:0:(genops.c:1244:class_import_put()) import ffff96888b416000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1780997330.730334:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfb1df80 x1867507127054080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.730341:0:3497:0:(genops.c:1244:class_import_put()) import ffff968885ce2000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1780997330.730345:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfb1fb80 x1867507127054720/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.730351:0:3497:0:(genops.c:1244:class_import_put()) import ffff9689869cf800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00080000:0.0:1780997330.733014:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:0.0:1780997330.733027:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1ce00 x1867507127054336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997355 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.733051:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127054336:0@lo:8:kworker.0 00000100:00000040:0.0:1780997330.733084:0:3495:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294969456 00000100:00000040:0.0:1780997330.733089:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfb1e680 x1867507127054848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997355 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997330.733099:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780997330.733102:0:3495:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:0.0:1780997330.733106:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1e680 x1867507127054848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997355 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.733113:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507127054848:0@lo:8:kworker.0 00000100:00000040:0.0:1780997330.733119:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfb1ce00 x1867507127054336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997355 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997330.733131:0:3495:0:(genops.c:1244:class_import_put()) import ffff968990cc0800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1780997330.733139:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfb1e680 x1867507127054848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780997355 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997330.733145:0:3495:0:(genops.c:1244:class_import_put()) import ffff96888a815000 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000020:00000040:2.0:1780997330.733239:0:92697:0:(genops.c:889:class_export_get()) GET export ffff9689bca5c800 refcount=4 00000020:00000040:2.0:1780997330.733254:0:92697:0:(genops.c:889:class_export_get()) GET export ffff9689bca5c800 refcount=5 00000100:00000040:2.0:1780997330.733348:0:92697:0:(lustre_peer.c:111:class_add_uuid()) found uuid 192.168.206.151@tcp 192.168.206.151@tcp cnt=1 00000020:01000004:2.0:1780997330.733371:0:92697:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1780997330.733386:0:92697:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff968990fe19c0) 00000020:00000040:2.0:1780997330.733393:0:92697:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689ad6cd800 with handle 0x30fd811c0305c4bf to hash 00000020:00000040:2.0:1780997330.733399:0:92697:0:(genops.c:900:class_export_put()) PUTting export ffff9689ad6cd800 : new refcount 1 00000020:00000040:2.0:1780997330.733413:0:92697:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff968990fe19c0) now 2 - obd_device_list 00000020:00000080:2.0:1780997330.733418:0:92697:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type lwp with refcount 2 00000020:01000004:2.0:1780997330.733582:0:92697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96888a990000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1780997330.733587:0:92697:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96888a990000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1780997330.733589:0:92697:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96888a990000 3 00000020:00000040:2.0:1780997330.733606:0:92697:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff968990fe19c0) now 3 - import 00000020:00000040:2.0:1780997330.733610:0:92697:0:(genops.c:1244:class_import_put()) import ffff9689bcc14800 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1780997330.733621:0:92697:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:2.0:1780997330.733624:0:92697:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 55 to 0@lo 00000100:00000040:2.0:1780997330.733626:0:92697:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.206.151@tcp -> ffff96898a59b400 00010000:00080000:2.0:1780997330.733630:0:92697:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9689bcc14800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.151@tcp at head 00000020:00000040:3.0:1780997330.734218:0:63418:0:(genops.c:889:class_export_get()) GET export ffff9689bc96a800 refcount=5 00000100:00000040:3.0:1780997330.734224:0:63418:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9689bc96a800 : new rpc_count 1 00000100:00000040:3.0:1780997330.734228:0:63418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 56 to 0@lo 00000100:00000040:3.0:1780997330.734231:0:63418:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 56 to 0@lo 00000020:00000040:3.0:1780997330.734234:0:63418:0:(genops.c:889:class_export_get()) GET export ffff9689bc96a800 refcount=6 00000100:00000040:3.0:1780997330.734242:0:63418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 57 to 0@lo 00000100:00080000:3.0:1780997330.734251:0:63418:0:(import.c:65:import_set_state_nolock()) ffff9689bc96c000 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1780997330.734257:0:63418:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc96a800 : new refcount 5 00000020:00000040:3.0:1780997330.734260:0:63418:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff96888ac53380) now 16 - find 00010000:00000040:3.0:1780997330.734290:0:63418:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127053824 00000100:00000040:3.0:1780997330.734299:0:63418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 58 to 0@lo 00000100:00000040:3.0:1780997330.734317:0:63418:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00010000:2.0:1780997330.735237:0:92697:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000100:00000040:3.0:1780997330.735289:0:63418:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9689b1161880 x1867507127053824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1780997340 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780997330.735356:0:92697:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff968990fe19c0) now 4 - setup 00000020:00000080:2.0:1780997330.735359:0:92697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1780997330.735406:0:92697:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000040:2.0:1780997330.735411:0:92697:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689ad6cc800 with handle 0x30fd811c0305c4c6 to hash 00000020:00000040:2.0:1780997330.735417:0:92697:0:(genops.c:889:class_export_get()) GET export ffff9689ad6cc800 refcount=3 00000020:00000040:2.0:1780997330.735421:0:92697:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff968990fe19c0) now 5 - export 00000020:00000040:2.0:1780997330.735423:0:92697:0:(genops.c:900:class_export_put()) PUTting export ffff9689ad6cc800 : new refcount 2 00000020:00000080:2.0:1780997330.735425:0:92697:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x30fd811c0305c4c6 00000020:00000040:2.0:1780997330.735428:0:92697:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c4c6 00000020:00000040:2.0:1780997330.735430:0:92697:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689ad6cc800 refcount=3 00000100:00080000:2.0:1780997330.735443:0:92697:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:2.0:1780997330.735447:0:92697:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 59 to 0@lo 00000020:00000040:2.0:1780997330.735449:0:92697:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c4c6 00000020:00000040:2.0:1780997330.735451:0:92697:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689ad6cc800 refcount=4 00000100:00000040:2.0:1780997330.735453:0:92697:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 60 to 0@lo 00000020:00000040:2.0:1780997330.735455:0:92697:0:(genops.c:900:class_export_put()) PUTting export ffff9689ad6cc800 : new refcount 3 00000100:00080000:2.0:1780997330.735458:0:92697:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9689bcc14800 using connection 192.168.206.151@tcp/0@lo 00000020:00000040:2.0:1780997330.735472:0:92697:0:(genops.c:1231:class_import_get()) import ffff9689bcc14800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:2.0:1780997330.735494:0:92697:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96888d28c700 x1867507127055232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780997330.735507:0:92697:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006f61a136] to pc [ptlrpcd_rcv+-1] req@ffff96888d28c700 x1867507127055232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.735826:0:63418:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 59 to 0@lo 00000100:00000040:3.0:1780997330.735836:0:63418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55f100 x1867507127053824/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1780997350 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.735845:0:63418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3495:x1867507127053824:12345-0@lo:38:llog_process_th.0 Request processed in 7198us (7937us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997330.735855:0:63418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00000040:3.0:1780997330.735859:0:63418:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc96a800 : new rpc_count 0 00000020:00000040:3.0:1780997330.735868:0:63418:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc96a800 : new refcount 4 00000100:00000040:0.0:1780997330.735936:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888d28c700 x1867507127055232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.735948:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888d28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3495:1867507127055232:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1780997330.735979:0:3495:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff96888d28c700 x1867507127055232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1780997340 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.735987:0:3495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.736012:0:3495:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaad180 x1867507127055232 msgsize 520 00000100:00100000:0.0:1780997330.736016:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997330.736037:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888d28c700 x1867507127055232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1780997340 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.736057:0:3495:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00080000:2.0:1780997330.737570:0:92697:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:2.0:1780997330.737580:0:92697:0:(genops.c:1231:class_import_get()) import ffff9689bcc14800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:3.0:1780997330.738064:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127055232 00000100:00100000:3.0:1780997330.738513:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127055232 00000020:00000040:3.0:1780997330.738516:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00000040:1.0:1780997330.738929:0:36:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (3863) 00000020:00000040:2.0:1780997330.739113:0:92697:0:(genops.c:889:class_export_get()) GET export ffff9689ad6cc800 refcount=4 00000020:00000040:2.0:1780997330.739127:0:92697:0:(genops.c:889:class_export_get()) GET export ffff9689ad6cc800 refcount=5 00000100:00100000:3.0:1780997330.739184:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00000040:3.0:1780997330.739195:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaad180 x1867507127055232/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1780997350 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.739207:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3495:x1867507127055232:12345-0@lo:38:llog_process_th.0 00000040:00080000:2.0:1780997330.739228:0:92697:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:00000040:3.0:1780997330.739261:0:63417:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9689ba680000) now 10 - find 00010000:00000040:3.0:1780997330.739290:0:63417:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1780997330.739297:0:63417:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3858 last 0 00000020:00000040:3.0:1780997330.739316:0:63417:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689bc96b000 with handle 0x30fd811c0305c4cd to hash 00000020:00000040:1.0:1780997330.739847:0:92700:0:(genops.c:900:class_export_put()) PUTting export ffff9689ad6cc800 : new refcount 4 00000020:00000040:3.0:1780997330.739991:0:63417:0:(genops.c:889:class_export_get()) GET export ffff9689bc96b000 refcount=3 00000020:00000040:3.0:1780997330.739996:0:63417:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9689ba680000) now 11 - export 00000020:00000040:3.0:1780997330.740000:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc96b000 : new refcount 2 00000020:00000080:3.0:1780997330.740002:0:63417:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x30fd811c0305c4cd 00000020:00000040:3.0:1780997330.740004:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c4cd 00000020:00000040:3.0:1780997330.740006:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc96b000 refcount=3 00000001:00000040:3.0:1780997330.740018:0:63417:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.206.151@tcp 00000001:00000040:3.0:1780997330.740024:0:63417:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9689b7f19800) : new refcount 16 00000020:00000040:3.0:1780997330.740027:0:63417:0:(genops.c:889:class_export_get()) GET export ffff9689bc96b000 refcount=4 00000001:00000040:3.0:1780997330.740029:0:63417:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9689b7f19800) : new refcount 17 00000001:00000040:3.0:1780997330.740032:0:63417:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9689b7f19800) : new refcount 16 00000004:00100000:3.0:1780997330.740036:0:63417:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:3.0:1780997330.740046:0:63417:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff968886e8d000 for nid 0@lo - ref 4 00000020:00000040:3.0:1780997330.740054:0:63417:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9689ba680000) now 12 - import 00000020:00000040:3.0:1780997330.740059:0:63417:0:(genops.c:1244:class_import_put()) import ffff9689bc96e000 refcount=1 obd=lustre-MDT0001 00000020:00000040:3.0:1780997330.740065:0:63417:0:(genops.c:889:class_export_get()) GET export ffff9689bc96b000 refcount=5 00000100:00000040:3.0:1780997330.740067:0:63417:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9689bc96b000 : new rpc_count 1 00000100:00000040:3.0:1780997330.740072:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 60 to 0@lo 00000100:00000040:3.0:1780997330.740074:0:63417:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 60 to 0@lo 00000020:00000040:3.0:1780997330.740084:0:63417:0:(genops.c:889:class_export_get()) GET export ffff9689bc96b000 refcount=6 00000020:00000040:1.0:1780997330.740327:0:92699:0:(genops.c:889:class_export_get()) GET export ffff9689bca5c800 refcount=6 00000020:00000040:1.0:1780997330.740340:0:92699:0:(genops.c:889:class_export_get()) GET export ffff9689bca5c800 refcount=7 00000020:00000040:1.0:1780997330.740343:0:92699:0:(genops.c:900:class_export_put()) PUTting export ffff9689bca5c800 : new refcount 6 00000100:00100000:0.0:1780997330.740497:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:0.0:1780997330.740502:0:3495:0:(client.c:3241:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:0.0:1780997330.740510:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b1161880 x1867507127053824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997330.740524:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000020:00000040:0.0:1780997330.740526:0:3495:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c4b1 00000020:00000040:0.0:1780997330.740528:0:3495:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bca5c800 refcount=7 00000100:00080000:0.0:1780997330.740535:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:0.0:1780997330.740537:0:3495:0:(genops.c:900:class_export_put()) PUTting export ffff9689bca5c800 : new refcount 6 00000100:00080000:0.0:1780997330.740540:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1780997330.740544:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689ad6ca000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000040:0.0:1780997330.740553:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1161880 x1867507127053824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997340 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.740561:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3495:1867507127053824:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1780997330.740570:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b1161880 x1867507127053824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997340 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997330.740581:0:3495:0:(genops.c:1244:class_import_put()) import ffff9689ad6ca000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1780997330.740885:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 61 to 0@lo 00000100:00080000:3.0:1780997330.740895:0:63417:0:(import.c:65:import_set_state_nolock()) ffff9689bc96e000 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1780997330.740899:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc96b000 : new refcount 5 00000020:00000040:3.0:1780997330.740902:0:63417:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9689ba680000) now 12 - find 00010000:00000040:3.0:1780997330.741050:0:63417:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127055232 00000100:00000040:3.0:1780997330.741060:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:3.0:1780997330.741066:0:63417:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.741196:0:63417:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff96888d28c700 x1867507127055232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1780997340 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.741238:0:63417:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 61 to 0@lo 00000100:00000040:3.0:1780997330.741244:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaad180 x1867507127055232/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1780997350 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.741254:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3495:x1867507127055232:12345-0@lo:38:llog_process_th.0 Request processed in 2048us (5240us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997330.741263:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000100:00000040:3.0:1780997330.741282:0:63417:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc96b000 : new rpc_count 0 00000020:00000040:3.0:1780997330.741294:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc96b000 : new refcount 4 00000020:01000000:3.0:1780997330.741321:0:92686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:3.0:1780997330.741358:0:92686:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00000020:00000040:3.0:1780997330.741371:0:92686:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff968983ce2000 refcount=3 00010000:00010000:3.0:1780997330.741379:0:92686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c0305c49c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c4a3 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997330.741389:0:92686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff968983ce2000/0x30fd811c0305c49c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c4a3 expref: -99 pid: 92686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780997330.741450:0:92686:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1780997330.741452:0:92686:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780997330.741458:0:92686:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997330.741459:0:92686:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997330.741460:0:92686:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997330.741462:0:92686:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997330.741463:0:92686:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780997330.741465:0:92686:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997330.741467:0:92686:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780997330.741472:0:92686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1780997330.741474:0:92686:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1780997330.741476:0:92686:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780997330.741477:0:92686:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997330.741477:0:92686:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997330.741478:0:92686:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997330.741479:0:92686:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997330.741480:0:92686:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780997330.741481:0:92686:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997330.741482:0:92686:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:3.0:1780997330.741489:0:92686:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 10000000:01000000:3.0:1780997330.741509:0:92686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:3.0:1780997330.741524:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689a568b480 x1867507127055360/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.741539:0:92686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689a568b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127055360:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1780997330.741587:0:92686:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689a568b480 x1867507127055360/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.741595:0:92686:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997330.741630:0:92686:0:(events.c:343:request_in_callback()) incoming req@ffff96888753a050 x1867507127055360 msgsize 4848 00000100:00100000:3.0:1780997330.741635:0:92686:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997330.741637:0:92686:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1780997330.741803:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:1.0:1780997330.741815:0:3495:0:(client.c:3241:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:1.0:1780997330.741821:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff96888d28c700 x1867507127055232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997330.741831:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 19 00000020:00000040:1.0:1780997330.741834:0:3495:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c4c6 00000020:00000040:1.0:1780997330.741836:0:3495:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689ad6cc800 refcount=5 00000100:00080000:1.0:1780997330.741841:0:3495:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:1.0:1780997330.741844:0:3495:0:(genops.c:900:class_export_put()) PUTting export ffff9689ad6cc800 : new refcount 4 00000100:00080000:1.0:1780997330.741847:0:3495:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1780997330.741850:0:3495:0:(import.c:65:import_set_state_nolock()) ffff9689bcc14800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:1.0:1780997330.741856:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888d28c700 x1867507127055232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997340 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997330.741862:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96888d28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3495:1867507127055232:0@lo:38:llog_process_th.0 00000100:00000040:1.0:1780997330.741867:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff96888d28c700 x1867507127055232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780997340 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997330.741876:0:3495:0:(genops.c:1244:class_import_put()) import ffff9689bcc14800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:3.0:1780997330.742875:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689a568b480 x1867507127055360/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.742905:0:92686:0:(client.c:2692:ptlrpc_set_wait()) set ffff968982993a80 going to sleep for 11 seconds 00000100:00100000:2.0:1780997330.743464:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127055360 00000100:00100000:2.0:1780997330.743473:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127055360 00000020:00000040:2.0:1780997330.743476:0:90247:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:2.0:1780997330.743479:0:90247:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=23 00000100:00000040:2.0:1780997330.743501:0:90247:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780997330.743538:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00000040:2.0:1780997330.743542:0:90247:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:2.0:1780997330.743548:0:90247:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff96888753a050 x1867507127055360/t0(0) o253->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 4848/0 e 0 to 0 dl 1780997341 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.743561:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888753a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:92686:x1867507127055360:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1780997330.743594:0:90247:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1780997330.743613:0:90247:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1780997330.750939:0:90247:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1780997330.750959:0:90247:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1780997330.751056:0:90248:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780997330.751061:0:90248:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:1.0:1780997330.751073:0:90248:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff9689a5f8fe00 count: 4 00000020:00000040:1.0:1780997330.751084:0:90248:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689a5a42200 with handle 0x30fd811c0305c4d4 to hash 00010000:00010000:1.0:1780997330.751092:0:90248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.751112:0:90248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689ba455600/0x30fd811c0305b5a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e55 expref: 8 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.751120:0:90248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b5c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b5bc expref: 23 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.751143:0:90248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9689ba454400/0x30fd811c0305b5df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305b5d8 expref: 23 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.751150:0:90248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.751156:0:90248:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9689a5f8fe00) refcount = 4 00010000:00000040:1.0:1780997330.751159:0:90248:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1780997330.751162:0:90248:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689ba454400/0x30fd811c0305b5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x30fd811c0305b5d8 expref: 23 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.751169:0:90248:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b5c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x30fd811c0305b5bc expref: 23 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.751176:0:90248:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689ba455600/0x30fd811c0305b5a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e55 expref: 8 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.751181:0:90248:0:(ldlm_resource.c:1868:ldlm_resource_dump()) Waiting locks: 00010000:00000040:1.0:1780997330.751183:0:90248:0:(ldlm_resource.c:1870:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1780997330.751205:0:90248:0:(genops.c:1231:class_import_get()) import ffff968990f90800 refcount=2 obd=MGS 00010000:00010000:1.0:1780997330.751223:0:90248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689ba454400/0x30fd811c0305b5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b5d8 expref: 23 pid: 90245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.751238:0:90248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689ba454400/0x30fd811c0305b5df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b5d8 expref: 23 pid: 90245 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1780997330.751253:0:90248:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689aebb8a80 x1867507127055488/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997330.751265:0:90248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aebb8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90248:1867507127055488:0@lo:104: 00000100:00000040:1.0:1780997330.751342:0:90248:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9689aebb8a80 x1867507127055488/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.751351:0:90248:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.751390:0:90248:0:(events.c:343:request_in_callback()) incoming req@ffff9689aebbad80 x1867507127055488 msgsize 328 00000100:00100000:1.0:1780997330.751395:0:90248:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997330.751414:0:90248:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689aebb8a80 x1867507127055488/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:1.0:1780997330.751442:0:90248:0:(genops.c:1231:class_import_get()) import ffff968990f90800 refcount=3 obd=MGS 00010000:00010000:1.0:1780997330.751452:0:90248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b5c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x30fd811c0305b5bc expref: 23 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.751459:0:90248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b5c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x30fd811c0305b5bc expref: 23 pid: 90246 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1780997330.751468:0:90248:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689aebb9500 x1867507127055616/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997330.751475:0:90248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689aebb9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90248:1867507127055616:0@lo:104: 00000100:00000040:1.0:1780997330.751486:0:90248:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9689aebb9500 x1867507127055616/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.751493:0:90248:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997330.751505:0:90248:0:(events.c:343:request_in_callback()) incoming req@ffff9689aebbb100 x1867507127055616 msgsize 328 00000100:00100000:1.0:1780997330.751509:0:90248:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997330.751521:0:90248:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689aebb9500 x1867507127055616/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:1.0:1780997330.751534:0:90248:0:(genops.c:1231:class_import_get()) import ffff96888a811800 refcount=2 obd=MGS 00010000:00010000:1.0:1780997330.751543:0:90248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9689ba455600/0x30fd811c0305b5a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e55 expref: 8 pid: 90246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.751552:0:90248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9689ba455600/0x30fd811c0305b5a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e55 expref: 8 pid: 90246 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1780997330.751578:0:90248:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1161880 x1867507127055744/t0(0) o104->MGS@192.168.206.51@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997330.751586:0:90248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90248:1867507127055744:192.168.206.51@tcp:104: 00000100:00000040:1.0:1780997330.751598:0:90248:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9689b1161880 x1867507127055744/t0(0) o104->MGS@192.168.206.51@tcp:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.751605:0:90248:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00100000:1.0:1780997330.751653:0:90248:0:(client.c:2692:ptlrpc_set_wait()) set ffff968986034480 going to sleep for 11 seconds 00000100:00100000:0.0:1780997330.751777:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127055488 00000100:00100000:0.0:1780997330.751785:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127055488 00000020:00000040:0.0:1780997330.751788:0:9303:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0300e63a 00000020:00000040:0.0:1780997330.751791:0:9303:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689869cd000 refcount=3 00000100:00000040:0.0:1780997330.751813:0:9303:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:0.0:1780997330.752013:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127055616 00000100:00100000:0.0:1780997330.752018:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127055616 00000020:00000040:0.0:1780997330.752026:0:9303:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0300e63a 00000020:00000040:0.0:1780997330.752028:0:9303:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689869cd000 refcount=4 00000100:00100000:0.0:1780997330.752048:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00000040:0.0:1780997330.752052:0:9303:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689869cd000 : new rpc_count 1 00000100:00000040:0.0:1780997330.752057:0:9303:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689aebbad80 x1867507127055488/t0(0) o104->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/0 e 0 to 0 dl 1780997341 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997330.752069:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:90248:x1867507127055488:12345-0@lo:104: 00000020:00000040:0.0:1780997330.752077:0:9303:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689bcbb2c00 refcount=2 00010000:00010000:0.0:1780997330.752085:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b5df expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1780997330.752106:0:9303:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:0.0:1780997330.752111:0:9303:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.752132:0:9303:0:(events.c:155:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9689aebb8a80 x1867507127055488/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997330.752152:0:9303:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 61 to 0@lo 00010000:00010000:0.0:1780997330.752167:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:0.0:1780997330.752172:0:9303:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689aebbad80 x1867507127055488/t0(0) o104->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/224 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997330.752180:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+4:90248:x1867507127055488:12345-0@lo:104: Request processed in 113us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997330.752187:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00000040:0.0:1780997330.752190:0:9303:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689869cd000 : new rpc_count 0 00000020:00000040:0.0:1780997330.752200:0:9303:0:(genops.c:900:class_export_put()) PUTting export ffff9689869cd000 : new refcount 3 00000100:00100000:0.0:1780997330.752212:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00000040:0.0:1780997330.752214:0:9303:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689869cd000 : new rpc_count 1 00000100:00000040:0.0:1780997330.752217:0:9303:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689aebbb100 x1867507127055616/t0(0) o104->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/0 e 0 to 0 dl 1780997341 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997330.752237:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:90248:x1867507127055616:12345-0@lo:104: 00000020:00000040:0.0:1780997330.752243:0:9303:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff968889ffd200 refcount=2 00010000:00010000:0.0:1780997330.752248:0:9303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b5c3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1780997330.752259:0:9303:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:0.0:1780997330.752262:0:9303:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.752301:0:9303:0:(events.c:155:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9689aebb9500 x1867507127055616/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997330.752313:0:9303:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 61 to 0@lo 00010000:00010000:0.0:1780997330.752325:0:9303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00000040:0.0:1780997330.752328:0:9303:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689aebbb100 x1867507127055616/t0(0) o104->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/224 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997330.752337:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+3:90248:x1867507127055616:12345-0@lo:104: Request processed in 101us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997330.752343:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00000040:0.0:1780997330.752345:0:9303:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689869cd000 : new rpc_count 0 00000020:00000040:0.0:1780997330.752351:0:9303:0:(genops.c:900:class_export_put()) PUTting export ffff9689869cd000 : new refcount 2 00010000:00010000:0.0:1780997330.752370:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780997330.752376:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b5df expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997330.752383:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689bcbb2c00 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:0.0:1780997330.752387:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b5df expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1780997330.752392:0:14480:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689bcbb2c00 refcount=3 00010000:00010000:0.0:1780997330.752402:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b5df expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997330.752409:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b5df expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997330.752415:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:0.0:1780997330.752418:0:14480:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:0.0:1780997330.752421:0:14480:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:0.0:1780997330.752427:0:14480:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9689a5fc2600) refs 2 00000020:00000040:0.0:1780997330.752432:0:14480:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff9689bcbb2c00 with handle 0x30fd811c0305b5d8 from hash 00000020:00000040:0.0:1780997330.752442:0:14480:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00010000:00010000:0.0:1780997330.752453:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b5df expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997330.752459:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:0.0:1780997330.752469:0:14480:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001cca9eff] to pc [ptlrpcd_00_00+0] req@ffff9689bfaab800 x1867507127055872/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1780997330.752488:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b5df expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997330.752494:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9689bcbb2c00/0x30fd811c0305b5d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b5df expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997330.752506:0:14480:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780997330.752510:0:14480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x30fd811c0305b5c3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997330.752515:0:14480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff968889ffd200 already unused, calling callback (ffffffffc14fac20) 10000000:00010000:0.0:1780997330.752518:0:14480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x30fd811c0305b5c3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1780997330.752533:0:14480:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff968889ffd200 refcount=3 00010000:00010000:0.0:1780997330.752536:0:14480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x30fd811c0305b5c3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780997330.752542:0:14480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x30fd811c0305b5c3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780997330.752547:0:14480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:0.0:1780997330.752550:0:14480:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=3) 10000000:00000040:0.0:1780997330.752552:0:14480:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:0.0:1780997330.752554:0:14480:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9689ba3f5600) refs 2 00000020:00000040:0.0:1780997330.752558:0:14480:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff968889ffd200 with handle 0x30fd811c0305b5bc from hash 00000020:00000040:0.0:1780997330.752563:0:14480:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=6 obd=MGC192.168.206.151@tcp 00010000:00010000:0.0:1780997330.752571:0:14480:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b5c3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997330.752577:0:14480:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:0.0:1780997330.752584:0:14480:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000071e29c3c] to pc [ptlrpcd_00_01+1] req@ffff9689bfaa8380 x1867507127056000/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1780997330.752594:0:14480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b5c3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997330.752600:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff968889ffd200/0x30fd811c0305b5bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x30fd811c0305b5c3 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1780997330.752607:0:14480:0:(ldlm_resource.c:1678:ldlm_resource_putref()) putref res: ffff96898d864300 count: 0 00010000:00010000:0.0:1780997330.752618:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997330.752620:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997330.752621:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780997330.752632:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1780997330.752643:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfaab800 x1867507127055872/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.752654:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127055872:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1780997330.752671:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfaab800 x1867507127055872/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.752677:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.752705:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaa8a80 x1867507127055872 msgsize 328 00000100:00100000:0.0:1780997330.752709:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997330.752724:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfaab800 x1867507127055872/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.752742:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:0.0:1780997330.752746:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bfaa8380 x1867507127056000/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.752754:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127056000:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1780997330.752764:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bfaa8380 x1867507127056000/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.752771:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.752782:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaa8000 x1867507127056000 msgsize 328 00000100:00100000:0.0:1780997330.752787:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997330.752800:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bfaa8380 x1867507127056000/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.752822:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127055872 00000100:00100000:0.0:1780997330.752826:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127055872 00000020:00000040:0.0:1780997330.752828:0:6336:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:0.0:1780997330.752830:0:6336:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=24 00000100:00000040:0.0:1780997330.752842:0:6336:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:0.0:1780997330.752848:0:6336:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689ba454400 refcount=5 00010000:00010000:0.0:1780997330.752853:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689ba454400/0x30fd811c0305b5df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b5d8 expref: 24 pid: 90245 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997330.752881:0:6336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127056000 00000100:00100000:0.0:1780997330.752885:0:6336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127056000 00000020:00000040:0.0:1780997330.752887:0:6336:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:0.0:1780997330.752889:0:6336:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=25 00000020:00000040:0.0:1780997330.752897:0:6336:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689ba455c00 refcount=5 00010000:00010000:0.0:1780997330.752901:0:6336:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b5c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b5bc expref: 25 pid: 90246 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780997330.752921:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00000100:00000040:0.0:1780997330.752923:0:6336:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 2 00000100:00000040:0.0:1780997330.752927:0:6336:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaa8a80 x1867507127055872/t0(0) o103->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/0 e 0 to 0 dl 1780997341 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.752937:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+25:3496:x1867507127055872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997330.752948:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:0.0:1780997330.752950:0:6336:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689ba454400 refcount=5 00010000:00000040:0.0:1780997330.752953:0:6336:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff9689a5f8fe00 count: 5 00010000:00010000:0.0:1780997330.752957:0:6336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689ba454400/0x30fd811c0305b5df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b5d8 expref: 25 pid: 90245 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997330.752967:0:6336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689ba454400/0x30fd811c0305b5df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b5d8 expref: 25 pid: 90245 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1780997330.752977:0:6336:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff9689ba454400 with handle 0x30fd811c0305b5df from hash 00010000:00000040:0.0:1780997330.752982:0:6336:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9689a5a42200 00010000:00010000:0.0:1780997330.752986:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:0.0:1780997330.752990:0:6336:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:0.0:1780997330.752994:0:6336:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.753011:0:6336:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689bfaab800 x1867507127055872/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.753033:0:6336:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 61 to 0@lo 00000100:00000040:0.0:1780997330.753038:0:6336:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaa8a80 x1867507127055872/t0(0) o103->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/224 e 0 to 0 dl 1780997341 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.753046:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+25:3496:x1867507127055872:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997330.753052:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00000100:00000040:0.0:1780997330.753055:0:6336:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 1 00000020:00000040:0.0:1780997330.753060:0:6336:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 24 00000100:00100000:0.0:1780997330.753068:0:6336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00000040:0.0:1780997330.753070:0:6336:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 2 00000100:00000040:0.0:1780997330.753074:0:6336:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaa8000 x1867507127056000/t0(0) o103->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/0 e 0 to 0 dl 1780997341 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.753084:0:6336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+24:3496:x1867507127056000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780997330.753092:0:6336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:0.0:1780997330.753094:0:6336:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689ba455c00 refcount=5 00010000:00000040:0.0:1780997330.753097:0:6336:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff9689a5f8fe00 count: 5 00010000:00010000:0.0:1780997330.753100:0:6336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b5c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x30fd811c0305b5bc expref: 24 pid: 90246 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780997330.753109:0:6336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b5c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x30fd811c0305b5bc expref: 24 pid: 90246 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1780997330.753117:0:6336:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff9689ba455c00 with handle 0x30fd811c0305b5c3 from hash 00010000:00000040:0.0:1780997330.753119:0:6336:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9689a5a42200 00010000:00010000:0.0:1780997330.753122:0:6336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:0.0:1780997330.753125:0:6336:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:0.0:1780997330.753129:0:6336:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.753150:0:6336:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689bfaa8380 x1867507127056000/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.753162:0:6336:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 61 to 0@lo 00000100:00000040:0.0:1780997330.753167:0:6336:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaa8000 x1867507127056000/t0(0) o103->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 328/224 e 0 to 0 dl 1780997341 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.753175:0:6336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+24:3496:x1867507127056000:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997330.753181:0:6336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00000040:0.0:1780997330.753183:0:6336:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 1 00000020:00000040:0.0:1780997330.753189:0:6336:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 23 00000100:00000040:0.0:1780997330.753228:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfaa8380 x1867507127056000/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.753239:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaa8380 x1867507127056000/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.753247:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127056000:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1780997330.753257:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689bfaab800 x1867507127055872/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.753264:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaab800 x1867507127055872/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.753291:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfaab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127055872:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1780997330.753296:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfaa8380 x1867507127056000/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997330.753305:0:3496:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:0.0:1780997330.753313:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bfaab800 x1867507127055872/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997330.753331:0:3496:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997330.753593:0:3489:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1161880 x1867507127055744/t0(0) o104->MGS@192.168.206.51@tcp:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997330.753718:0:90248:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689aebb8a80 x1867507127055488/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1780997330.753779:0:90248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba454400/0x30fd811c0305b5df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b5d8 expref: 23 pid: 90245 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.753786:0:90248:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff968982cc7800 : new locks_count 17 00000020:00000040:1.0:1780997330.753789:0:90248:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 22 00000100:00000040:1.0:1780997330.753796:0:90248:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689aebb8a80 x1867507127055488/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997330.753803:0:90248:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aebb8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90248:1867507127055488:0@lo:104: 00000100:00000040:1.0:1780997330.753816:0:90248:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689aebb9500 x1867507127055616/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1780997330.753822:0:90248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455c00/0x30fd811c0305b5c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x30fd811c0305b5bc expref: 22 pid: 90246 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.753828:0:90248:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff968982cc7800 : new locks_count 16 00000020:00000040:1.0:1780997330.753829:0:90248:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 21 00000100:00000040:1.0:1780997330.753834:0:90248:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689aebb9500 x1867507127055616/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780997330.753853:0:90248:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689aebb9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90248:1867507127055616:0@lo:104: 00010000:00000040:0.0:1780997330.754241:0:90247:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127055360 00000100:00000040:0.0:1780997330.754250:0:90247:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:0.0:1780997330.754255:0:90247:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997330.754308:0:90247:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff9689a568b480 x1867507127055360/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997330.754330:0:90247:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 61 to 0@lo 00000100:00000040:0.0:1780997330.754336:0:90247:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888753a050 x1867507127055360/t0(0) o253->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:661/0 lens 4848/4768 e 0 to 0 dl 1780997341 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997330.754345:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888753a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:92686:x1867507127055360:12345-0@lo:253:mount.lustre.0 Request processed in 10787us (12724us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997330.754354:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00000040:0.0:1780997330.754356:0:90247:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:0.0:1780997330.754367:0:90247:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 20 00000100:00000040:3.0:1780997330.754448:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689a568b480 x1867507127055360/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997330.754464:0:92686:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a568b480 x1867507127055360/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997330.754471:0:92686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689a568b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:92686:1867507127055360:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1780997330.754478:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689a568b480 x1867507127055360/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1780997330.754489:0:92686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1780997330.754492:0:92686:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1780997330.754494:0:92686:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780997330.754496:0:92686:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780997330.754497:0:92686:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780997330.754499:0:92686:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780997330.754500:0:92686:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780997330.754502:0:92686:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780997330.754504:0:92686:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780997330.754505:0:92686:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:3.0:1780997330.754507:0:92686:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689a568b480 x1867507127055360/t0(0) o253->MGC192.168.206.151@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997330.754515:0:92686:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000020:02000000:3.0:1780997330.754526:0:92686:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00000040:1.0:1780997330.760942:0:3491:0:(events.c:155:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9689b1161880 x1867507127055744/t0(0) o104->MGS@192.168.206.51@tcp:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997330.761058:0:90248:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b1161880 x1867507127055744/t0(0) o104->MGS@192.168.206.51@tcp:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997330.761072:0:90248:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1161880 x1867507127055744/t0(0) o104->MGS@192.168.206.51@tcp:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780997330.761080:0:90248:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90248:1867507127055744:192.168.206.51@tcp:104: 00000100:00000040:0.0:1780997330.761091:0:90248:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689aebb8a80 x1867507127055488/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1780997330.761104:0:90248:0:(genops.c:1244:class_import_put()) import ffff968990f90800 refcount=2 obd=MGS 00000100:00000040:0.0:1780997330.761116:0:90248:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689aebb9500 x1867507127055616/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1780997330.761122:0:90248:0:(genops.c:1244:class_import_put()) import ffff968990f90800 refcount=1 obd=MGS 00000100:00000040:0.0:1780997330.761127:0:90248:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b1161880 x1867507127055744/t0(0) o104->MGS@192.168.206.51@tcp:15/16 lens 328/224 e 0 to 0 dl 1780997346 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1780997330.761148:0:90248:0:(genops.c:1244:class_import_put()) import ffff96888a811800 refcount=1 obd=MGS 00010000:00010000:0.0:1780997330.761161:0:90248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000040:3.0:1780997330.764599:0:92686:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00002000:00000040:3.0:1780997330.764628:0:92686:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00002000:00000040:3.0:1780997330.764677:0:92686:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00002000:00000040:3.0:1780997330.765154:0:92686:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00002000:00000040:3.0:1780997330.765195:0:92686:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00002000:00000040:3.0:1780997330.765232:0:92686:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00002000:00000040:3.0:1780997330.765256:0:92686:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00000100:00000040:1.0:1780997330.765706:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689b620b850 x1867507110487040 msgsize 328 00000100:00100000:1.0:1780997330.765717:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:1.0:1780997330.765720:0:3490:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:2.0:1780997330.765898:0:6338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110487040 00000100:00100000:2.0:1780997330.765908:0:6338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110487040 00000020:00000040:2.0:1780997330.765911:0:6338:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b47a 00000020:00000040:2.0:1780997330.765915:0:6338:0:(lustre_handles.c:131:class_handle2object()) GET export ffff96888a811000 refcount=9 00000100:00000040:2.0:1780997330.765936:0:6338:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:2.0:1780997330.765946:0:6338:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689ba455600 refcount=4 00010000:00010000:2.0:1780997330.765953:0:6338:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9689ba455600/0x30fd811c0305b5a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e55 expref: 9 pid: 90246 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780997330.765987:0:6338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2619 00000100:00000040:2.0:1780997330.765992:0:6338:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff96888a811000 : new rpc_count 1 00000100:00000040:2.0:1780997330.766002:0:6338:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b620b850 x1867507110487040/t0(0) o103->cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp:661/0 lens 328/0 e 0 to 0 dl 1780997341 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.766016:0:6338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b620b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2395:x1867507110487040:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780997330.766032:0:6338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:2.0:1780997330.766035:0:6338:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689ba455600 refcount=4 00010000:00000040:2.0:1780997330.766039:0:6338:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff9689a5f8fe00 count: 3 00010000:00010000:2.0:1780997330.766043:0:6338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9689ba455600/0x30fd811c0305b5a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e55 expref: 9 pid: 90246 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997330.766057:0:6338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9689ba455600/0x30fd811c0305b5a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e55 expref: 9 pid: 90246 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1780997330.766072:0:6338:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff9689ba455600 with handle 0x30fd811c0305b5a0 from hash 00010000:00010000:2.0:1780997330.766078:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689ba455600/0x30fd811c0305b5a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae8e55 expref: 9 pid: 90246 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780997330.766085:0:6338:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff96888a811000 : new locks_count 3 00000020:00000040:2.0:1780997330.766088:0:6338:0:(genops.c:900:class_export_put()) PUTting export ffff96888a811000 : new refcount 8 00010000:00000040:2.0:1780997330.766110:0:6338:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9689a5a42200 00010000:00010000:2.0:1780997330.766117:0:6338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780997330.766126:0:6338:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9689a5f8fe00) refcount = 2 00010000:00010000:2.0:1780997330.766130:0:6338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1780997330.766147:0:6338:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015086250s 00000020:00000040:2.0:1780997330.766151:0:6338:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689a5a42200 refcount=5 00010000:00010000:2.0:1780997330.766154:0:6338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997330.766162:0:6338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997330.766169:0:6338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997330.766176:0:6338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997330.766182:0:6338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9689a5a42200 already unused, calling callback (ffffffffc0ecc850) 00010000:00010000:2.0:1780997330.766186:0:6338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1780997330.766192:0:6338:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689a5a42200 refcount=6 00010000:00010000:2.0:1780997330.766197:0:6338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1780997330.766216:0:6338:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff9689a5a42200 with handle 0x30fd811c0305c4d4 from hash 00010000:00010000:2.0:1780997330.766222:0:6338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997330.766239:0:6338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:2.0:1780997330.766248:0:6338:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997330.766254:0:6338:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997330.766324:0:6338:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 8 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997330.766329:0:6338:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b620b850 x1867507110487040/t0(0) o103->cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp:661/0 lens 328/224 e 0 to 0 dl 1780997341 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997330.766339:0:6338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b620b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:2395:x1867507110487040:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 326us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997330.766348:0:6338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2619 00000100:00000040:2.0:1780997330.766351:0:6338:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff96888a811000 : new rpc_count 0 00000020:00000040:2.0:1780997330.766361:0:6338:0:(genops.c:900:class_export_put()) PUTting export ffff96888a811000 : new refcount 7 00010000:00010000:1.0:1780997330.766489:0:90248:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.766498:0:90248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997330.766504:0:90248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9689a5a42200/0x30fd811c0305c4d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780997330.766509:0:90248:0:(ldlm_resource.c:1678:ldlm_resource_putref()) putref res: ffff9689a5f8fe00 count: 0 00002000:00000040:3.0:1780997330.766922:0:92686:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00002000:00000040:3.0:1780997330.767006:0:92686:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00002000:00000040:3.0:1780997330.767059:0:92686:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 00002000:00000040:2.0:1780997330.767961:0:92686:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00010000:00080000:2.0:1780997330.768073:0:92686:0:(ldlm_lib.c:3037:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294969477 00010000:00080000:2.0:1780997330.768905:0:92703:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-OST0000: started recovery thread pid 92703 00010000:02000000:2.0:1780997330.768921:0:92703:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00000020:01000004:3.0:1780997330.769718:0:92686:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:3.0:1780997330.769734:0:92686:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff968982993b40 : new refcount 2 00000040:00000040:3.0:1780997330.769751:0:92686:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff968982993b40 : new refcount 1 00000020:00000040:3.0:1780997330.769783:0:92686:0:(genops.c:900:class_export_put()) PUTting export ffff96888a991800 : new refcount 1 00000020:00000040:3.0:1780997330.769793:0:92686:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.206.151@tcp (ffff9689b6283380) now 6 - mgc_fs 10000000:01000000:3.0:1780997330.769796:0:92686:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1780997330.769817:0:92686:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1780997330.769843:0:92686:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1780997330.770756:0:92686:0:(tgt_mount.c:2299:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1780997330.770991:0:92686:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:2.0:1780997330.790334:0:92703:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:2.0:1780997330.790341:0:92703:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:2.0:1780997331.686786:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1780997331.720046:0:92752:0:(tgt_mount.c:2299:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1780997331.720318:0:92752:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00000040:0.0:1780997331.852819:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff968887538c50 x1867507110487168 msgsize 328 00000100:00100000:0.0:1780997331.852836:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:0.0:1780997331.852838:0:3491:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:2.0:1780997331.861755:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110487168 00000100:00100000:2.0:1780997331.861772:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110487168 00000020:00000040:2.0:1780997331.861775:0:90250:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b47a 00000020:00000040:2.0:1780997331.861780:0:90250:0:(lustre_handles.c:131:class_handle2object()) GET export ffff96888a811000 refcount=8 00000100:00000040:2.0:1780997331.861814:0:90250:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780997331.861856:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 206 00000100:00000040:2.0:1780997331.861861:0:90250:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff96888a811000 : new rpc_count 1 00000100:00000040:2.0:1780997331.861871:0:90250:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968887538c50 x1867507110487168/t0(0) o101->cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp:662/0 lens 328/0 e 0 to 0 dl 1780997342 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997331.861919:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968887538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+8:70253:x1867507110487168:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997331.861937:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:2.0:1780997331.861955:0:90250:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689bcbb3400 with handle 0x30fd811c0305c4db to hash 00010000:00010000:2.0:1780997331.861961:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb3400/0x30fd811c0305c4db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x90d0c14f46ae91dc expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780997331.861970:0:90250:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff96888a811000 : new locks_count 4 00000020:00000040:2.0:1780997331.861972:0:90250:0:(genops.c:889:class_export_get()) GET export ffff96888a811000 refcount=9 00010000:00000040:2.0:1780997331.861991:0:90250:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9689896ff900) refcount = 1 00010000:00010000:2.0:1780997331.861997:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb3400/0x30fd811c0305c4db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91dc expref: 9 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997331.862008:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb3400/0x30fd811c0305c4db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91dc expref: 9 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997331.862017:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3400, rc 0) 00010000:00000040:2.0:1780997331.862021:0:90250:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507110487168 00000100:00000040:2.0:1780997331.862033:0:90250:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997331.862039:0:90250:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997331.862145:0:90250:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 8 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997331.862151:0:90250:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968887538c50 x1867507110487168/t0(0) o101->cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp:662/0 lens 328/344 e 0 to 0 dl 1780997342 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997331.862160:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968887538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110487168:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 245us (9342us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997331.862166:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 206 00000100:00000040:2.0:1780997331.862169:0:90250:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff96888a811000 : new rpc_count 0 00000020:00000040:2.0:1780997331.862186:0:90250:0:(genops.c:900:class_export_put()) PUTting export ffff96888a811000 : new refcount 8 00000100:00000040:3.0:1780997331.873865:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689bcbbac50 x1867507110487296 msgsize 304 00000100:00100000:3.0:1780997331.873880:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:3.0:1780997331.873882:0:3489:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:3.0:1780997331.873920:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110487296 00000100:00100000:3.0:1780997331.873931:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110487296 00000020:00000040:3.0:1780997331.873934:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b47a 00000020:00000040:3.0:1780997331.873938:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff96888a811000 refcount=9 00000100:00000040:3.0:1780997331.873961:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780997331.873996:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 207 00000100:00000040:3.0:1780997331.874000:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff96888a811000 : new rpc_count 1 00000100:00000040:3.0:1780997331.874008:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bcbbac50 x1867507110487296/t0(0) o256->cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp:662/0 lens 304/0 e 0 to 0 dl 1780997342 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997331.874021:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110487296:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780997331.874045:0:90245:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:3.0:1780997331.874060:0:90245:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:3.0:1780997331.874066:0:90245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780997331.874069:0:90245:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:3.0:1780997331.874091:0:90245:0:(genops.c:889:class_export_get()) GET export ffff96888a811000 refcount=10 00000020:00000040:3.0:1780997331.876389:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff96888a811000 : new refcount 9 00010000:00000040:3.0:1780997331.876410:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507110487296 00000100:00000040:3.0:1780997331.876427:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997331.876433:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997331.876468:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 8 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997331.876483:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bcbbac50 x1867507110487296/t0(0) o256->cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp:662/0 lens 304/240 e 0 to 0 dl 1780997342 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997331.876494:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:70253:x1867507110487296:12345-192.168.206.51@tcp:256:ll_cfg_requeue.0 Request processed in 2474us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997331.876504:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 207 00000100:00000040:3.0:1780997331.876508:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff96888a811000 : new rpc_count 0 00000020:00000040:3.0:1780997331.876521:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff96888a811000 : new refcount 8 00000100:00000040:3.0:1780997331.879942:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689a568b480 x1867507110487424 msgsize 520 00000100:00100000:3.0:1780997331.879958:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997331.879999:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110487424 00000100:00100000:3.0:1780997331.880008:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110487424 00000020:00000040:3.0:1780997331.880011:0:25175:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b894 00000100:00100000:3.0:1780997331.880613:0:25175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6060 00000100:00000040:3.0:1780997331.880633:0:25175:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689a568b480 x1867507110487424/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780997351 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997331.880646:0:25175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689a568b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2393:x1867507110487424:12345-192.168.206.51@tcp:8:ll_cfg_requeue.0 00000020:00000040:3.0:1780997331.880665:0:25175:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 7 - find 00010000:00000040:3.0:1780997331.880677:0:25175:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0465af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1780997331.880683:0:25175:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'e4805cfa-ac6d-4d67-bb97-a6c06740fcd0' at ffff9689bc9e6000, cookie 0x30fd811c0305c487 00010000:00080000:3.0:1780997331.880699:0:25175:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp recovering/t4294969457 exp ffff9689bc9e6000 cur 3859 last 1780997330 00010000:02000400:3.0:1780997331.880708:0:25175:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:3.0:1780997331.880715:0:25175:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:3.0:1780997331.880723:0:25175:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9689b7f19800) : new refcount 17 00000020:00000040:3.0:1780997331.880728:0:25175:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=4 00000001:00000040:3.0:1780997331.880730:0:25175:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9689b7f19800) : new refcount 18 00000001:00000040:3.0:1780997331.880734:0:25175:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9689b7f19800) : new refcount 17 00002000:00100000:3.0:1780997331.880748:0:25175:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e4805cfa-ac6d-4d67-bb97-a6c06740fcd0/ffff9689bc9e6000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1780997331.880760:0:25175:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:3.0:1780997331.880772:0:25175:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9689bb4f6060 for nid 192.168.206.51@tcp - ref 2 00000020:00000040:3.0:1780997331.880868:0:25175:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 8 - import 00000020:00000040:3.0:1780997331.880877:0:25175:0:(genops.c:1244:class_import_put()) import ffff9689bc96b800 refcount=1 obd=lustre-OST0000 00000020:00000040:3.0:1780997331.880885:0:25175:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=5 00000100:00000040:3.0:1780997331.880887:0:25175:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997331.880897:0:25175:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997331.880899:0:25175:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff968885c88580 refcount 9 to 192.168.206.51@tcp 00000020:00000040:3.0:1780997331.880902:0:25175:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=6 00000100:00000040:3.0:1780997331.880908:0:25175:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00000100:00080000:3.0:1780997331.880917:0:25175:0:(import.c:65:import_set_state_nolock()) ffff9689bc96b800 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1780997331.880922:0:25175:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 5 00000020:00000040:3.0:1780997331.880925:0:25175:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9689aeba3380) now 8 - find 00010000:00000040:3.0:1780997331.880937:0:25175:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 0, xid 1867507110487424 00000100:00000040:3.0:1780997331.880946:0:25175:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997331.880952:0:25175:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997331.880995:0:25175:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997331.881002:0:25175:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689a568b480 x1867507110487424/t0(0) o8->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:0/0 lens 520/416 e 0 to 0 dl 1780997351 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997331.881010:0:25175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689a568b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2393:x1867507110487424:12345-192.168.206.51@tcp:8:ll_cfg_requeue.0 Request processed in 365us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997331.881017:0:25175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6060 00000100:00000040:3.0:1780997331.881020:0:25175:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997331.881029:0:25175:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 4 00000100:00000040:1.0:1780997331.895681:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689b1163100 x1867507110457984 msgsize 440 00000100:00100000:1.0:1780997331.895707:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997331.895749:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110457984 00000100:00100000:1.0:1780997331.895759:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110457984 00000020:00000040:1.0:1780997331.895762:0:24155:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997331.895767:0:24155:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=5 00000100:00000040:1.0:1780997331.895794:0:24155:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997331.895835:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1048 00000100:00000040:1.0:1780997331.895839:0:24155:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997331.895847:0:24155:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b1163100 x1867507110457984/t0(4294969478) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:662/0 lens 440/0 e 0 to 0 dl 1780997342 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997331.895876:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2393:x1867507110457984:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:1.0:1780997331.895888:0:24155:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1163100 x1867507110457984/t0(4294969478) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:662/0 lens 440/0 e 0 to 0 dl 1780997342 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997331.895897:0:24155:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969478, current: 4294969478, replaying 00010000:00000040:1.0:1780997331.895907:0:24155:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997331.895919:0:24155:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1163100 x1867507110457984/t0(4294969478) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:662/0 lens 440/0 e 0 to 0 dl 1780997342 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997331.895928:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2393:x1867507110457984:12345-192.168.206.51@tcp:10:dd.0 Request processed in 56us (249us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997331.895935:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1048 00000100:00000040:1.0:1780997331.895938:0:24155:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:0.0:1780997331.898327:0:92703:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 10000000:00000040:1.0:1780997332.325934:0:6348:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9689ba3f5600) refs 2 10000000:01000000:1.0:1780997332.325946:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1780997332.325949:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9689a5877000 from 125 10000000:01000000:1.0:1780997332.325953:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:1.0:1780997332.325965:0:6348:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:1.0:1780997332.326000:0:6348:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689a5a43200 with handle 0x30fd811c0305c4e2 to hash 00010000:00010000:1.0:1780997332.326010:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a5a43200/0x30fd811c0305c4e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997332.326020:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689a5a43200/0x30fd811c0305c4e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997332.326032:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689a5a43200/0x30fd811c0305c4e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1780997332.326060:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1163480 x1867507127056128/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.326090:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1163480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127056128:0@lo:101:ll_cfg_requeue.0 00000100:00000040:1.0:1780997332.326117:0:6348:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b1163480 x1867507127056128/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.326125:0:6348:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997332.326166:0:6348:0:(events.c:343:request_in_callback()) incoming req@ffff9689bcbb8450 x1867507127056128 msgsize 328 00000100:00100000:1.0:1780997332.326170:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997332.326172:0:6348:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780997332.326190:0:6348:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689b1163480 x1867507127056128/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.326218:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886cc7240 going to sleep for 11 seconds 00000100:00100000:2.0:1780997332.327034:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127056128 00000100:00100000:2.0:1780997332.327043:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127056128 00000020:00000040:2.0:1780997332.327046:0:90250:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:2.0:1780997332.327049:0:90250:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=21 00000100:00000040:2.0:1780997332.327069:0:90250:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780997332.327096:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00000040:2.0:1780997332.327100:0:90250:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:2.0:1780997332.327106:0:90250:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bcbb8450 x1867507127056128/t0(0) o101->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997332.327119:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+21:6348:x1867507127056128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780997332.327132:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1780997332.327140:0:90250:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff9689896ff900 count: 2 00000020:00000040:2.0:1780997332.327145:0:90250:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689bcbb3000 with handle 0x30fd811c0305c4e9 to hash 00010000:00010000:2.0:1780997332.327149:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9689bcbb3000/0x30fd811c0305c4e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305c4e2 expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780997332.327157:0:90250:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff968982cc7800 : new locks_count 17 00000020:00000040:2.0:1780997332.327159:0:90250:0:(genops.c:889:class_export_get()) GET export ffff968982cc7800 refcount=22 00010000:00000040:2.0:1780997332.327173:0:90250:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9689896ff900) refcount = 2 00010000:00000040:2.0:1780997332.327176:0:90250:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1780997332.327181:0:90250:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bcbb3400/0x30fd811c0305c4db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91dc expref: 8 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997332.327189:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9689bcbb3000/0x30fd811c0305c4e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305c4e2 expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997332.327199:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9689bcbb3000/0x30fd811c0305c4e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305c4e2 expref: 22 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780997332.327219:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9689bcbb3000, rc 0) 00010000:00000040:2.0:1780997332.327223:0:90250:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127056128 00000100:00000040:2.0:1780997332.327232:0:90250:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:2.0:1780997332.327236:0:90250:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997332.327259:0:90250:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9689b1163480 x1867507127056128/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997332.327305:0:90250:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 61 to 0@lo 00000100:00000040:2.0:1780997332.327309:0:90250:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bcbb8450 x1867507127056128/t0(0) o101->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:663/0 lens 328/344 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997332.327318:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127056128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997332.327324:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00000040:2.0:1780997332.327327:0:90250:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:2.0:1780997332.327337:0:90250:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 21 00000100:00000040:1.0:1780997332.328783:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b1163480 x1867507127056128/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.328796:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1163480 x1867507127056128/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.328805:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1163480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127056128:0@lo:101:ll_cfg_requeue.0 00000100:00000040:1.0:1780997332.328813:0:6348:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1163480 x1867507127056128/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997332.328825:0:6348:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689a5a43200 refcount=4 00010000:00000040:1.0:1780997332.328830:0:6348:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9689a5a43200, remote cookie: 0x30fd811c0305c4e9, flags: 0x0 00010000:00000040:1.0:1780997332.328836:0:6348:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff968888a35600) refcount = 1 00010000:00010000:1.0:1780997332.328842:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689a5a43200/0x30fd811c0305c4e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c4e9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997332.328852:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689a5a43200/0x30fd811c0305c4e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305c4e9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1780997332.328871:0:6348:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b1163480 x1867507127056128/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997332.328881:0:6348:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 10000000:00000040:1.0:1780997332.328888:0:6348:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9689ba3f5600) refs 3 00000020:00000040:1.0:1780997332.328891:0:6348:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689a5a43200 refcount=3 00000020:00000040:1.0:1780997332.328904:0:6348:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:1.0:1780997332.328919:0:6348:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:1.0:1780997332.328932:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1163480 x1867507127056256/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.328943:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1163480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127056256:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1780997332.328964:0:6348:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b1163480 x1867507127056256/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.328972:0:6348:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997332.328998:0:6348:0:(events.c:343:request_in_callback()) incoming req@ffff9689bcbb8050 x1867507127056256 msgsize 304 00000100:00100000:1.0:1780997332.329002:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997332.329004:0:6348:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780997332.329016:0:6348:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689b1163480 x1867507127056256/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.329038:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff968886cc7240 going to sleep for 11 seconds 00000100:00100000:3.0:1780997332.332069:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127056256 00000100:00100000:3.0:1780997332.332090:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127056256 00000020:00000040:3.0:1780997332.332093:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:3.0:1780997332.332114:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=22 00000100:00000040:3.0:1780997332.332143:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780997332.332341:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00000040:3.0:1780997332.332345:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:3.0:1780997332.332353:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bcbb8050 x1867507127056256/t0(0) o256->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:663/0 lens 304/0 e 0 to 0 dl 1780997343 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997332.332368:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127056256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780997332.332393:0:90245:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:3.0:1780997332.332407:0:90245:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:3.0:1780997332.332414:0:90245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780997332.332417:0:90245:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:3.0:1780997332.332424:0:90245:0:(genops.c:889:class_export_get()) GET export ffff968982cc7800 refcount=23 00000020:00000040:3.0:1780997332.332510:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 22 00010000:00000040:3.0:1780997332.332524:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127056256 00000100:00000040:3.0:1780997332.332536:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:3.0:1780997332.332543:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997332.332564:0:90245:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff9689b1163480 x1867507127056256/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997332.332597:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 61 to 0@lo 00000100:00000040:3.0:1780997332.332602:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bcbb8050 x1867507127056256/t0(0) o256->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:663/0 lens 304/240 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997332.332612:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127056256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 247us (3611us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997332.332619:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00000040:3.0:1780997332.332622:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:3.0:1780997332.332632:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 21 00000100:00000040:1.0:1780997332.334338:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff9689b1163480 x1867507127056256/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.334351:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff9689b1163480 x1867507127056256/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.334360:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1163480 x1867507127056256/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.334367:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1163480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127056256:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1780997332.334387:0:6348:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1163480 x1867507127056256/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1780997332.334401:0:6348:0:(mgc_request.c:1601:mgc_process_recover_log()) Latest version 125, more 0. 10000000:00000040:1.0:1780997332.334417:0:6348:0:(mgc_request.c:1442:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1780997332.334430:0:6348:0:(lustre_peer.c:213:class_check_uuid()) check if uuid 192.168.206.151@tcp has 192.168.206.151@tcp. 10000000:00000040:1.0:1780997332.334445:0:6348:0:(mgc_request.c:1471:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:1.0:1780997332.334449:0:6348:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff96888a815000 already not connected (conn 6, was 0): DISCONN 00000100:00000040:1.0:1780997332.334460:0:6348:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:1.0:1780997332.334463:0:6348:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:1.0:1780997332.334465:0:6348:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.206.151@tcp -> ffff96898a59b400 00010000:00080000:1.0:1780997332.334469:0:6348:0:(ldlm_lib.c:85:import_set_conn()) imp ffff96888a815000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.206.151@tcp, moved to head 00010000:00000040:1.0:1780997332.334473:0:6348:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 61 to 0@lo 00000100:00080000:1.0:1780997332.334478:0:6348:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:1.0:1780997332.334482:0:6348:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 60 to 0@lo 00000100:00000040:1.0:1780997332.334484:0:6348:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 61 to 0@lo 00000020:00000040:1.0:1780997332.334487:0:6348:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b537 00000020:00000040:1.0:1780997332.334491:0:6348:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689891ac800 refcount=4 00000100:00000040:1.0:1780997332.334494:0:6348:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 60 to 0@lo 00000100:00000040:1.0:1780997332.334496:0:6348:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 61 to 0@lo 00000020:00000040:1.0:1780997332.334499:0:6348:0:(genops.c:900:class_export_put()) PUTting export ffff9689891ac800 : new refcount 3 00000100:00080000:1.0:1780997332.334502:0:6348:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96888a815000 using connection 192.168.206.151@tcp/0@lo 00000020:00000040:1.0:1780997332.334516:0:6348:0:(genops.c:1231:class_import_get()) import ffff96888a815000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:1.0:1780997332.334539:0:6348:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b1161880 x1867507127056384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780997332.334554:0:6348:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000601df19] to pc [ptlrpcd_rcv+-1] req@ffff9689b1161880 x1867507127056384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1780997332.334585:0:6348:0:(mgc_request.c:1488:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1780997332.334601:0:6348:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b1163480 x1867507127056256/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997332.334611:0:6348:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:1.0:1780997332.334615:0:6348:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 10000000:01000000:1.0:1780997332.334640:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:1.0:1780997332.335354:0:6348:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689a5a43200 refcount=3 00010000:00010000:1.0:1780997332.335365:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a5a43200/0x30fd811c0305c4e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c4e9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997332.335377:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689a5a43200/0x30fd811c0305c4e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c4e9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:1.0:1780997332.335387:0:6348:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9689a5fc2600) refs 2 10000000:00000040:1.0:1780997332.335390:0:6348:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9689ba3f5600) refs 3 10000000:01000000:1.0:1780997332.335393:0:6348:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1780997332.335395:0:6348:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff968886f5e000 from 125 10000000:01000000:1.0:1780997332.335399:0:6348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:1.0:1780997332.335404:0:6348:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00010000:00000040:1.0:1780997332.335421:0:6348:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff968888a35600 count: 2 00000020:00000040:1.0:1780997332.335429:0:6348:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9689a5a43000 with handle 0x30fd811c0305c4f0 to hash 00010000:00010000:1.0:1780997332.335435:0:6348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a5a43000/0x30fd811c0305c4f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997332.335442:0:6348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9689a5a43000/0x30fd811c0305c4f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997332.335451:0:6348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9689a5a43000/0x30fd811c0305c4f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1780997332.335470:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1163480 x1867507127056512/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.335496:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1163480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127056512:0@lo:101:ll_cfg_requeue.0 00000100:00000040:1.0:1780997332.335522:0:6348:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b1163480 x1867507127056512/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.335530:0:6348:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997332.335567:0:6348:0:(events.c:343:request_in_callback()) incoming req@ffff9689bcbba050 x1867507127056512 msgsize 328 00000100:00100000:1.0:1780997332.335585:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997332.335587:0:6348:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780997332.335610:0:6348:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689b1163480 x1867507127056512/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.335634:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689871086c0 going to sleep for 11 seconds 00000100:00000040:1.0:1780997332.335666:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1161880 x1867507127056384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.335676:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507127056384:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1780997332.335699:0:3495:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b1161880 x1867507127056384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997357 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.335706:0:3495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997332.335721:0:3495:0:(events.c:343:request_in_callback()) incoming req@ffff9689bc960000 x1867507127056384 msgsize 520 00000100:00100000:1.0:1780997332.335725:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997332.335739:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1161880 x1867507127056384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997357 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.335749:0:3495:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7928 usecs (8 jiffies) 00000100:00100000:3.0:1780997332.338089:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127056512 00000100:00100000:3.0:1780997332.338103:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127056512 00000020:00000040:3.0:1780997332.338107:0:90250:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:3.0:1780997332.338122:0:90250:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=22 00000100:00000040:3.0:1780997332.338148:0:90250:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780997332.338214:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00000040:3.0:1780997332.338219:0:90250:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:3.0:1780997332.338225:0:90250:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bcbba050 x1867507127056512/t0(0) o101->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997332.338238:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+22:6348:x1867507127056512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780997332.338254:0:90250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1780997332.338264:0:90250:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff9689896ff900 count: 3 00000020:00000040:3.0:1780997332.338293:0:90250:0:(lustre_handles.c:77:class_handle_hash()) added object ffff96898d6dac00 with handle 0x30fd811c0305c4f7 to hash 00010000:00010000:3.0:1780997332.338298:0:90250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96898d6dac00/0x30fd811c0305c4f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30fd811c0305c4f0 expref: -99 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780997332.338306:0:90250:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff968982cc7800 : new locks_count 18 00000020:00000040:3.0:1780997332.338309:0:90250:0:(genops.c:889:class_export_get()) GET export ffff968982cc7800 refcount=23 00010000:00000040:3.0:1780997332.338327:0:90250:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9689896ff900) refcount = 3 00010000:00000040:3.0:1780997332.338329:0:90250:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1780997332.338333:0:90250:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bcbb3000/0x30fd811c0305c4e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305c4e2 expref: 23 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780997332.338342:0:90250:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9689bcbb3400/0x30fd811c0305c4db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x90d0c14f46ae91dc expref: 8 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997332.338350:0:90250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96898d6dac00/0x30fd811c0305c4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x30fd811c0305c4f0 expref: 23 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997332.338360:0:90250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96898d6dac00/0x30fd811c0305c4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x30fd811c0305c4f0 expref: 23 pid: 90250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997332.338369:0:90250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96898d6dac00, rc 0) 00010000:00000040:3.0:1780997332.338377:0:90250:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127056512 00000100:00000040:3.0:1780997332.338387:0:90250:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:3.0:1780997332.338392:0:90250:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997332.338433:0:90250:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9689b1163480 x1867507127056512/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997332.338465:0:90250:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 61 to 0@lo 00000100:00000040:3.0:1780997332.338470:0:90250:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bcbba050 x1867507127056512/t0(0) o101->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:663/0 lens 328/344 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997332.338478:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507127056512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (2910us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997332.338485:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00000040:3.0:1780997332.338488:0:90250:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:3.0:1780997332.338498:0:90250:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 22 00000100:00100000:3.0:1780997332.338528:0:25173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127056384 00000100:00100000:3.0:1780997332.338532:0:25173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127056384 00000020:00000040:3.0:1780997332.338534:0:25173:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b53e 00000100:00100000:3.0:1780997332.338553:0:25173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6061 00000100:00000040:3.0:1780997332.338558:0:25173:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bc960000 x1867507127056384/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780997352 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997332.338567:0:25173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3495:x1867507127056384:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:3.0:1780997332.338582:0:25173:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 8 - find 00010000:00000040:3.0:1780997332.338590:0:25173:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1780997332.338596:0:25173:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff9689bc9e3000, cookie 0x30fd811c0305c479 00010000:00080000:3.0:1780997332.338601:0:25173:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff9689bc9e3000 cur 3859 last 1780997330 00000001:00000040:3.0:1780997332.338612:0:25173:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.206.151@tcp 00000001:00000040:3.0:1780997332.338615:0:25173:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9689b7f19800) : new refcount 18 00000020:00000040:3.0:1780997332.338619:0:25173:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e3000 refcount=4 00000001:00000040:3.0:1780997332.338627:0:25173:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9689b7f19800) : new refcount 19 00000001:00000040:3.0:1780997332.338631:0:25173:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9689b7f19800) : new refcount 18 00002000:00100000:3.0:1780997332.338635:0:25173:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9689bc9e3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1780997332.338639:0:25173:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1780997332.338642:0:25173:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:3.0:1780997332.338651:0:25173:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9689bb4f6f00 for nid 0@lo - ref 2 00000020:00000040:3.0:1780997332.338754:0:25173:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 9 - import 00000020:00000040:3.0:1780997332.338761:0:25173:0:(genops.c:1244:class_import_put()) import ffff9689bc969000 refcount=1 obd=lustre-OST0000 00000020:00000040:3.0:1780997332.338767:0:25173:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e3000 refcount=5 00000100:00000040:3.0:1780997332.338769:0:25173:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9689bc9e3000 : new rpc_count 1 00000100:00000040:3.0:1780997332.338773:0:25173:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:3.0:1780997332.338776:0:25173:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 62 to 0@lo 00000020:00000040:3.0:1780997332.338778:0:25173:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e3000 refcount=6 00000100:00000040:3.0:1780997332.338784:0:25173:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 63 to 0@lo 00000100:00080000:3.0:1780997332.338794:0:25173:0:(import.c:65:import_set_state_nolock()) ffff9689bc969000 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1780997332.338799:0:25173:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e3000 : new refcount 5 00000020:00000040:3.0:1780997332.338801:0:25173:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9689aeba3380) now 9 - find 00010000:00000040:3.0:1780997332.338809:0:25173:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969456, transno 0, xid 1867507127056384 00000100:00000040:3.0:1780997332.338814:0:25173:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 64 to 0@lo 00000100:00000040:3.0:1780997332.338818:0:25173:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997332.338838:0:25173:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9689b1161880 x1867507127056384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997357 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997332.338858:0:25173:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 63 to 0@lo 00000100:00000040:3.0:1780997332.338862:0:25173:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc960000 x1867507127056384/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1780997352 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997332.338870:0:25173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507127056384:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 304us (3148us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997332.338877:0:25173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6061 00000100:00000040:3.0:1780997332.338886:0:25173:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e3000 : new rpc_count 0 00000020:00000040:3.0:1780997332.338892:0:25173:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e3000 : new refcount 4 00010000:00080000:3.0:1780997332.338932:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689b1161880 x1867507127056384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780997357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997332.338941:0:3495:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294969456 00000100:00000040:3.0:1780997332.338945:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b1161880 x1867507127056384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780997357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997332.338955:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:3.0:1780997332.338957:0:3495:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b537 00000020:00000040:3.0:1780997332.338960:0:3495:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689891ac800 refcount=4 00000020:00000040:3.0:1780997332.338966:0:3495:0:(genops.c:900:class_export_put()) PUTting export ffff9689891ac800 : new refcount 3 00000100:00080000:3.0:1780997332.338970:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1780997332.338974:0:3495:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1780997332.338977:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969456 gen 2 00000100:00000040:3.0:1780997332.338980:0:3495:0:(client.c:3241:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:3.0:1780997332.338982:0:3495:0:(recover.c:53:ptlrpc_replay_next()) import ffff96888a815000 from lustre-OST0000_UUID committed 4294969456 last 0 00000100:00080000:3.0:1780997332.338986:0:3495:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:3.0:1780997332.338989:0:3495:0:(genops.c:1231:class_import_get()) import ffff96888a815000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1780997332.339104:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1161880 x1867507127056384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780997357 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997332.339111:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507127056384:0@lo:8:ll_cfg_requeue.0 00000100:00000040:3.0:1780997332.339118:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b1161880 x1867507127056384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780997357 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997332.339128:0:3495:0:(genops.c:1244:class_import_put()) import ffff96888a815000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00010000:00080000:3.0:1780997332.339147:0:92777:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1780997332.339151:0:92777:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:3.0:1780997332.339160:0:92777:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:3.0:1780997332.339195:0:92777:0:(import.c:65:import_set_state_nolock()) ffff96888a815000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:3.0:1780997332.339202:0:92777:0:(genops.c:1231:class_import_get()) import ffff96888a815000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1780997332.339223:0:92777:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000601df19] to pc [ptlrpcd_rcv+-1] req@ffff9689b1161880 x1867507127056640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997332.339236:0:92777:0:(genops.c:1244:class_import_put()) import ffff96888a815000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1780997332.339245:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1161880 x1867507127056640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997332.339255:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3495:1867507127056640:0@lo:400:ldlm_lock_repla.0 00000100:00000040:3.0:1780997332.339294:0:3495:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff9689b1161880 x1867507127056640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997348 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997332.339301:0:3495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997332.339320:0:3495:0:(events.c:343:request_in_callback()) incoming req@ffff9689b7f12680 x1867507127056640 msgsize 224 00000100:00100000:3.0:1780997332.339325:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997332.339339:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1161880 x1867507127056640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997348 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997332.339349:0:3495:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7837 usecs (8 jiffies) 00000100:00100000:3.0:1780997332.339368:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127056640 00000100:00100000:3.0:1780997332.339372:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127056640 00000020:00000040:3.0:1780997332.339374:0:25177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c479 00000020:00000040:3.0:1780997332.339376:0:25177:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e3000 refcount=5 00000100:00000040:3.0:1780997332.339389:0:25177:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1780997332.339412:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00000040:3.0:1780997332.339415:0:25177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e3000 : new rpc_count 1 00000100:00000040:3.0:1780997332.339419:0:25177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b7f12680 x1867507127056640/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:663/0 lens 224/0 e 0 to 0 dl 1780997343 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997332.339428:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b7f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507127056640:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:3.0:1780997332.339443:0:25177:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b7f12680 x1867507127056640/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:663/0 lens 224/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1780997332.339450:0:25177:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e3000 : new rpc_count 2 00010000:00080000:3.0:1780997332.339454:0:25177:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff9689b7f12680 x1867507127056640/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:663/0 lens 224/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997332.339466:0:25177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b7f12680 x1867507127056640/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:663/0 lens 224/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997332.339474:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b7f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3495:x1867507127056640:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 47us (152us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.339480:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00000040:3.0:1780997332.339482:0:25177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e3000 : new rpc_count 1 00000100:00000040:1.0:1780997332.340149:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b1163480 x1867507127056512/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.340160:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1163480 x1867507127056512/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.340167:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1163480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127056512:0@lo:101:ll_cfg_requeue.0 00000100:00000040:1.0:1780997332.340183:0:6348:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1163480 x1867507127056512/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997332.340194:0:6348:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689a5a43000 refcount=4 00010000:00000040:1.0:1780997332.340200:0:6348:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9689a5a43000, remote cookie: 0x30fd811c0305c4f7, flags: 0x0 00010000:00000040:1.0:1780997332.340206:0:6348:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff968888a35600) refcount = 2 00010000:00000040:1.0:1780997332.340210:0:6348:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1780997332.340214:0:6348:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.206.151@tcp lock: ffff9689a5a43200/0x30fd811c0305c4e2 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305c4e9 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997332.340222:0:6348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9689a5a43000/0x30fd811c0305c4f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c4f7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780997332.340231:0:6348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9689a5a43000/0x30fd811c0305c4f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x30fd811c0305c4f7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1780997332.340241:0:6348:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b1163480 x1867507127056512/t0(0) o101->MGC192.168.206.151@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780997348 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997332.340251:0:6348:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 10000000:00000040:1.0:1780997332.340259:0:6348:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9689a5fc2600) refs 3 00000020:00000040:1.0:1780997332.340261:0:6348:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689a5a43000 refcount=3 00000020:00000040:1.0:1780997332.340309:0:6348:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:1.0:1780997332.340327:0:6348:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=5 obd=MGC192.168.206.151@tcp 00000100:00000040:1.0:1780997332.340341:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689bc963100 x1867507127056768/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.340350:0:6348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bc963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127056768:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1780997332.340370:0:6348:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689bc963100 x1867507127056768/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.340377:0:6348:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997332.340406:0:6348:0:(events.c:343:request_in_callback()) incoming req@ffff9689bcbbbc50 x1867507127056768 msgsize 304 00000100:00100000:1.0:1780997332.340411:0:6348:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997332.340413:0:6348:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780997332.340431:0:6348:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9689bc963100 x1867507127056768/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.340457:0:6348:0:(client.c:2692:ptlrpc_set_wait()) set ffff9689871086c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780997332.342729:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127056768 00000100:00100000:3.0:1780997332.342743:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127056768 00000020:00000040:3.0:1780997332.342747:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:3.0:1780997332.342751:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=23 00000100:00000040:3.0:1780997332.342782:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780997332.342926:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00000040:3.0:1780997332.342931:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:3.0:1780997332.342938:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bcbbbc50 x1867507127056768/t0(0) o256->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:663/0 lens 304/0 e 0 to 0 dl 1780997343 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997332.342952:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507127056768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780997332.342992:0:90245:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:3.0:1780997332.343010:0:90245:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:3.0:1780997332.343016:0:90245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780997332.343019:0:90245:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:3.0:1780997332.343027:0:90245:0:(genops.c:889:class_export_get()) GET export ffff968982cc7800 refcount=24 00000020:00000040:3.0:1780997332.343116:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 23 00010000:00000040:3.0:1780997332.343138:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127056768 00000100:00000040:3.0:1780997332.343149:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 64 to 0@lo 00000100:00000040:3.0:1780997332.343156:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997332.343174:0:90245:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff9689bc963100 x1867507127056768/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997332.343189:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 63 to 0@lo 00000100:00000040:3.0:1780997332.343194:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bcbbbc50 x1867507127056768/t0(0) o256->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:663/0 lens 304/240 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997332.343203:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:6348:x1867507127056768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 254us (2794us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997332.343210:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00000040:3.0:1780997332.343213:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:3.0:1780997332.343223:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 22 00000100:00000040:3.0:1780997332.343286:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff9689bc963100 x1867507127056768/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997332.343297:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff9689bc963100 x1867507127056768/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997332.343306:0:6348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc963100 x1867507127056768/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997332.343314:0:6348:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bc963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:6348:1867507127056768:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1780997332.343322:0:6348:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689bc963100 x1867507127056768/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1780997332.343333:0:6348:0:(mgc_request.c:1601:mgc_process_recover_log()) Latest version 125, more 0. 10000000:00000040:3.0:1780997332.343344:0:6348:0:(mgc_request.c:1442:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1780997332.343359:0:6348:0:(lustre_peer.c:213:class_check_uuid()) check if uuid 192.168.206.151@tcp has 192.168.206.151@tcp. 10000000:00000040:3.0:1780997332.343374:0:6348:0:(mgc_request.c:1471:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00080000:3.0:1780997332.343384:0:6348:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff968990cc0800 already not connected (conn 6, was 0): DISCONN 00000100:00000040:3.0:1780997332.343395:0:6348:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 64 to 0@lo 00000100:00000040:3.0:1780997332.343397:0:6348:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 64 to 0@lo 00000100:00000040:3.0:1780997332.343400:0:6348:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.206.151@tcp -> ffff96898a59b400 00010000:00080000:3.0:1780997332.343403:0:6348:0:(ldlm_lib.c:85:import_set_conn()) imp ffff968990cc0800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.206.151@tcp, moved to head 00010000:00000040:3.0:1780997332.343407:0:6348:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 63 to 0@lo 00000100:00080000:3.0:1780997332.343411:0:6348:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:3.0:1780997332.343417:0:6348:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:3.0:1780997332.343419:0:6348:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 63 to 0@lo 00000020:00000040:3.0:1780997332.343422:0:6348:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c03055384 00000020:00000040:3.0:1780997332.343424:0:6348:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79cc800 refcount=4 00000100:00000040:3.0:1780997332.343427:0:6348:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 62 to 0@lo 00000100:00000040:3.0:1780997332.343429:0:6348:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 63 to 0@lo 00000020:00000040:3.0:1780997332.343431:0:6348:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79cc800 : new refcount 3 00000100:00080000:3.0:1780997332.343433:0:6348:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff968990cc0800 using connection 192.168.206.151@tcp/0@lo 00000020:00000040:3.0:1780997332.343449:0:6348:0:(genops.c:1231:class_import_get()) import ffff968990cc0800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1780997332.343468:0:6348:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9689b100b480 x1867507127056896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780997332.343481:0:6348:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000087efb803] to pc [ptlrpcd_rcv+-1] req@ffff9689b100b480 x1867507127056896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1780997332.343498:0:6348:0:(mgc_request.c:1488:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1780997332.343504:0:6348:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689bc963100 x1867507127056768/t0(0) o256->MGC192.168.206.151@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780997348 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997332.343513:0:6348:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000020:00000040:3.0:1780997332.343516:0:6348:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 10000000:01000000:3.0:1780997332.343540:0:6348:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:3.0:1780997332.343546:0:6348:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9689a5a43000 refcount=3 00010000:00010000:3.0:1780997332.343553:0:6348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9689a5a43000/0x30fd811c0305c4f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c4f7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780997332.343568:0:6348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9689a5a43000/0x30fd811c0305c4f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x30fd811c0305c4f7 expref: -99 pid: 6348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1780997332.344331:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b100b480 x1867507127056896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997332.344345:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b100b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127056896:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1780997332.344370:0:3495:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b100b480 x1867507127056896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997357 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997332.344377:0:3495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997332.344398:0:3495:0:(events.c:343:request_in_callback()) incoming req@ffff96888d28df80 x1867507127056896 msgsize 520 00000100:00100000:2.0:1780997332.344402:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780997332.344421:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b100b480 x1867507127056896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997357 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997332.344431:0:3495:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5287 usecs (6 jiffies) 00000100:00100000:2.0:1780997332.344464:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127056896 00000100:00100000:2.0:1780997332.344469:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127056896 00000020:00000040:2.0:1780997332.344471:0:25178:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c03055399 00000100:00100000:2.0:1780997332.344494:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6062 00000100:00000040:2.0:1780997332.344499:0:25178:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff96888d28df80 x1867507127056896/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780997352 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997332.344506:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3495:x1867507127056896:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:2.0:1780997332.344520:0:25178:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 9 - find 00010000:00000040:2.0:1780997332.344528:0:25178:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1780997332.344534:0:25178:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9689bc9e6800, cookie 0x30fd811c0305c480 00010000:00080000:2.0:1780997332.344538:0:25178:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9689bc9e6800 cur 3859 last 1780997330 00000001:00000040:2.0:1780997332.344548:0:25178:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.206.151@tcp 00000001:00000040:2.0:1780997332.344552:0:25178:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9689b7f19800) : new refcount 19 00000020:00000040:2.0:1780997332.344555:0:25178:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6800 refcount=4 00000001:00000040:2.0:1780997332.344557:0:25178:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9689b7f19800) : new refcount 20 00000001:00000040:2.0:1780997332.344560:0:25178:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9689b7f19800) : new refcount 19 00002000:00100000:2.0:1780997332.344564:0:25178:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9689bc9e6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113601 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1780997332.344567:0:25178:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1780997332.344570:0:25178:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:2.0:1780997332.344577:0:25178:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9689bb4f6f00 for nid 0@lo - ref 3 00000020:00000040:2.0:1780997332.344584:0:25178:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 10 - import 00000020:00000040:2.0:1780997332.344589:0:25178:0:(genops.c:1244:class_import_put()) import ffff9689ad6c8800 refcount=1 obd=lustre-OST0000 00000020:00000040:2.0:1780997332.344594:0:25178:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6800 refcount=5 00000100:00000040:2.0:1780997332.344596:0:25178:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9689bc9e6800 : new rpc_count 1 00000100:00000040:2.0:1780997332.344600:0:25178:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 64 to 0@lo 00000100:00000040:2.0:1780997332.344602:0:25178:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff96898a59b400 refcount 64 to 0@lo 00000020:00000040:2.0:1780997332.344604:0:25178:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6800 refcount=6 00000100:00000040:2.0:1780997332.344609:0:25178:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00080000:2.0:1780997332.344622:0:25178:0:(import.c:65:import_set_state_nolock()) ffff9689ad6c8800 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1780997332.344627:0:25178:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6800 : new refcount 5 00000020:00000040:2.0:1780997332.344630:0:25178:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9689aeba3380) now 10 - find 00010000:00000040:2.0:1780997332.344640:0:25178:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969473, transno 0, xid 1867507127056896 00000100:00000040:2.0:1780997332.344782:0:25178:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:2.0:1780997332.344787:0:25178:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997332.344805:0:25178:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9689b100b480 x1867507127056896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780997357 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997332.344824:0:25178:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:2.0:1780997332.344829:0:25178:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888d28df80 x1867507127056896/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1780997352 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997332.344837:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3495:x1867507127056896:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 330us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997332.344844:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6062 00000100:00000040:2.0:1780997332.344847:0:25178:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6800 : new rpc_count 0 00000020:00000040:2.0:1780997332.344855:0:25178:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6800 : new refcount 4 00010000:00080000:2.0:1780997332.344883:0:3495:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9689b100b480 x1867507127056896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780997357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997332.344892:0:3495:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969473 00000100:00000040:2.0:1780997332.344896:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b100b480 x1867507127056896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780997357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780997332.344905:0:3495:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:2.0:1780997332.344908:0:3495:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c03055384 00000020:00000040:2.0:1780997332.344911:0:3495:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79cc800 refcount=4 00000020:00000040:2.0:1780997332.344919:0:3495:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79cc800 : new refcount 3 00000100:00080000:2.0:1780997332.344923:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1780997332.344926:0:3495:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1780997332.344929:0:3495:0:(client.c:3131:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969473 gen 2 00000100:00000040:2.0:1780997332.344938:0:3495:0:(client.c:3241:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:2.0:1780997332.344941:0:3495:0:(recover.c:53:ptlrpc_replay_next()) import ffff968990cc0800 from lustre-OST0000_UUID committed 4294969473 last 0 00000100:00080000:2.0:1780997332.344944:0:3495:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:2.0:1780997332.344947:0:3495:0:(genops.c:1231:class_import_get()) import ffff968990cc0800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1780997332.345051:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b100b480 x1867507127056896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780997357 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997332.345059:0:3495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b100b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127056896:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1780997332.345064:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b100b480 x1867507127056896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780997357 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780997332.345072:0:3495:0:(genops.c:1244:class_import_put()) import ffff968990cc0800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00010000:00080000:2.0:1780997332.345100:0:92778:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1780997332.345105:0:92778:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:2.0:1780997332.345111:0:92778:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:2.0:1780997332.345151:0:92778:0:(import.c:65:import_set_state_nolock()) ffff968990cc0800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:2.0:1780997332.345157:0:92778:0:(genops.c:1231:class_import_get()) import ffff968990cc0800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1780997332.345175:0:92778:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009c39027c] to pc [ptlrpcd_rcv+-1] req@ffff96888d28e680 x1867507127057024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780997332.345188:0:92778:0:(genops.c:1244:class_import_put()) import ffff968990cc0800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1780997332.345198:0:3495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff96888d28e680 x1867507127057024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997332.345207:0:3495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96888d28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3495:1867507127057024:0@lo:400:ldlm_lock_repla.0 00000100:00000040:2.0:1780997332.345222:0:3495:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff96888d28e680 x1867507127057024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997348 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997332.345229:0:3495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997332.345250:0:3495:0:(events.c:343:request_in_callback()) incoming req@ffff96888d28d180 x1867507127057024 msgsize 224 00000100:00100000:2.0:1780997332.345254:0:3495:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780997332.345296:0:3495:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff96888d28e680 x1867507127057024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997348 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997332.345306:0:3495:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5277 usecs (6 jiffies) 00000100:00100000:1.0:1780997332.345448:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127057024 00000100:00100000:1.0:1780997332.345455:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127057024 00000020:00000040:1.0:1780997332.345457:0:8230:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c480 00000020:00000040:1.0:1780997332.345460:0:8230:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6800 refcount=5 00000100:00100000:1.0:1780997332.345500:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729 00000100:00000040:1.0:1780997332.345504:0:8230:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6800 : new rpc_count 1 00000100:00000040:1.0:1780997332.345508:0:8230:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff96888d28d180 x1867507127057024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:663/0 lens 224/0 e 0 to 0 dl 1780997343 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.345519:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3495:x1867507127057024:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:1.0:1780997332.345528:0:8230:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff96888d28d180 x1867507127057024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:663/0 lens 224/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1780997332.345536:0:8230:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6800 : new rpc_count 2 00010000:00080000:1.0:1780997332.345540:0:8230:0:(ldlm_lib.c:3121:target_queue_recovery_request()) @@@ queue final req req@ffff96888d28d180 x1867507127057024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:663/0 lens 224/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.345548:0:8230:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888d28d180 x1867507127057024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:663/0 lens 224/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.345556:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3495:x1867507127057024:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 39us (304us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.345561:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729 00000100:00000040:1.0:1780997332.345564:0:8230:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6800 : new rpc_count 1 10000000:00000040:3.0:1780997332.349764:0:6348:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9689a5fc2600) refs 3 00010000:00080000:0.0:1780997332.350185:0:92703:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00000040:0.0:1780997332.350191:0:92703:0:(ldlm_lib.c:2861:target_recovery_thread()) 1: request replay stage - 1 clients from t4294969478 00010000:00080000:0.0:1780997332.350194:0:92703:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 4294969478 00010000:00080000:0.0:1780997332.350199:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969478, next_transno: 4294969478 00010000:00080000:0.0:1780997332.350202:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969478) 00010000:00080000:0.0:1780997332.350217:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110457984 t4294969478 from 192.168.206.51@tcp req@ffff9689b1163100 x1867507110457984/t0(4294969478) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:662/0 lens 440/0 e 0 to 0 dl 1780997342 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.350244:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1163100 x1867507110457984/t0(4294969478) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:662/0 lens 440/0 e 0 to 0 dl 1780997342 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780997332.350306:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x624:0x0] 00000001:00000040:0.0:1780997332.350949:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 1 00000020:00000040:0.0:1780997332.350954:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=6 00010000:00000040:0.0:1780997332.351005:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969478, xid 1867507110457984 00000100:00000040:0.0:1780997332.351016:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997332.351023:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997332.351071:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:0.0:1780997332.351086:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00000040:0.0:1780997332.351093:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:0.0:1780997332.351103:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 5 00010000:00080000:0.0:1780997332.351107:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969479 00010000:00080000:0.0:1780997332.351120:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969479 00000100:00000040:3.0:1780997332.354416:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689b1009c00 x1867507110458752 msgsize 440 00000100:00100000:3.0:1780997332.354438:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997332.354567:0:24143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110458752 00000100:00100000:2.0:1780997332.354579:0:24143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110458752 00000020:00000040:2.0:1780997332.354583:0:24143:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:2.0:1780997332.354589:0:24143:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=6 00000100:00000040:2.0:1780997332.354622:0:24143:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780997332.354694:0:24143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1049 00000100:00000040:2.0:1780997332.354699:0:24143:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:2.0:1780997332.354707:0:24143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b1009c00 x1867507110458752/t0(4294969479) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.354722:0:24143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110458752:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:2.0:1780997332.354734:0:24143:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1009c00 x1867507110458752/t0(4294969479) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780997332.354744:0:24143:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969479, current: 4294969479, replaying 00010000:00000040:2.0:1780997332.354748:0:24143:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:2.0:1780997332.354761:0:24143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1009c00 x1867507110458752/t0(4294969479) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.354770:0:24143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110458752:12345-192.168.206.51@tcp:10:dd.0 Request processed in 51us (356us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780997332.354778:0:24143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1049 00000100:00000040:2.0:1780997332.354781:0:24143:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:2.0:1780997332.354802:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969479, next_transno: 4294969479 00010000:00080000:2.0:1780997332.354806:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969479) 00010000:00080000:2.0:1780997332.354828:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110458752 t4294969479 from 192.168.206.51@tcp req@ffff9689b1009c00 x1867507110458752/t0(4294969479) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.354844:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1009c00 x1867507110458752/t0(4294969479) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1780997332.355062:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x623:0x0] 00000001:00000040:2.0:1780997332.355263:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 2 00000020:00000040:2.0:1780997332.355337:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=7 00010000:00000040:2.0:1780997332.355383:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969479, xid 1867507110458752 00000100:00000040:2.0:1780997332.355394:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997332.355401:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997332.355547:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:2.0:1780997332.355558:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780997332.355564:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:2.0:1780997332.355573:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 6 00010000:00080000:2.0:1780997332.355576:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969480 00010000:00080000:2.0:1780997332.355580:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969480 00000100:00000040:0.0:1780997332.362561:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaab800 x1867507110460160 msgsize 440 00000100:00100000:0.0:1780997332.362577:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997332.363074:0:23854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110460160 00000100:00100000:3.0:1780997332.363088:0:23854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110460160 00000020:00000040:3.0:1780997332.363092:0:23854:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:3.0:1780997332.363097:0:23854:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=7 00000100:00000040:3.0:1780997332.363127:0:23854:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780997332.363187:0:23854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1050 00000100:00000040:3.0:1780997332.363192:0:23854:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997332.363201:0:23854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaab800 x1867507110460160/t0(4294969480) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.363217:0:23854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2393:x1867507110460160:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:3.0:1780997332.363230:0:23854:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaab800 x1867507110460160/t0(4294969480) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.363240:0:23854:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969480, current: 4294969480, replaying 00010000:00000040:3.0:1780997332.363244:0:23854:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:3.0:1780997332.363261:0:23854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaab800 x1867507110460160/t0(4294969480) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.363345:0:23854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2393:x1867507110460160:12345-192.168.206.51@tcp:10:dd.0 Request processed in 131us (783us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.363354:0:23854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1050 00000100:00000040:3.0:1780997332.363367:0:23854:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:3.0:1780997332.363422:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969480, next_transno: 4294969480 00010000:00080000:3.0:1780997332.363426:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969480) 00010000:00080000:3.0:1780997332.363436:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110460160 t4294969480 from 192.168.206.51@tcp req@ffff9689bfaab800 x1867507110460160/t0(4294969480) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.363455:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaab800 x1867507110460160/t0(4294969480) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1780997332.363484:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x622:0x0] 00000001:00000040:3.0:1780997332.364118:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 3 00000020:00000040:3.0:1780997332.364123:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=8 00010000:00000040:3.0:1780997332.364165:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969480, xid 1867507110460160 00000100:00000040:3.0:1780997332.364175:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997332.364181:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997332.364226:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:3.0:1780997332.364235:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780997332.364241:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.364252:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 7 00010000:00080000:3.0:1780997332.364256:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969481 00010000:00080000:3.0:1780997332.364260:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969481 00000100:00000040:2.0:1780997332.368400:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff96888d28c700 x1867507110460928 msgsize 440 00000100:00100000:2.0:1780997332.368418:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997332.368701:0:8236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110460928 00000100:00100000:3.0:1780997332.368711:0:8236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110460928 00000020:00000040:3.0:1780997332.368715:0:8236:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:3.0:1780997332.368719:0:8236:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=8 00000100:00000040:3.0:1780997332.368747:0:8236:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780997332.368793:0:8236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1051 00000100:00000040:3.0:1780997332.368798:0:8236:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997332.368805:0:8236:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff96888d28c700 x1867507110460928/t0(4294969481) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.368836:0:8236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2393:x1867507110460928:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:3.0:1780997332.368850:0:8236:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff96888d28c700 x1867507110460928/t0(4294969481) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.368859:0:8236:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969481, current: 4294969481, replaying 00010000:00000040:3.0:1780997332.368863:0:8236:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:3.0:1780997332.368884:0:8236:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888d28c700 x1867507110460928/t0(4294969481) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.368893:0:8236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+8:2393:x1867507110460928:12345-192.168.206.51@tcp:10:dd.0 Request processed in 61us (495us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.368900:0:8236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1051 00000100:00000040:3.0:1780997332.368903:0:8236:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:2.0:1780997332.369321:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969481, next_transno: 4294969481 00010000:00080000:2.0:1780997332.369327:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969481) 00010000:00080000:2.0:1780997332.369337:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110460928 t4294969481 from 192.168.206.51@tcp req@ffff96888d28c700 x1867507110460928/t0(4294969481) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.369355:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff96888d28c700 x1867507110460928/t0(4294969481) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1780997332.369384:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x625:0x0] 00000001:00000040:2.0:1780997332.369568:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 4 00000020:00000040:2.0:1780997332.369572:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=9 00010000:00000040:2.0:1780997332.369617:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969481, xid 1867507110460928 00000100:00000040:2.0:1780997332.369628:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997332.369635:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997332.369717:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:2.0:1780997332.369727:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780997332.369733:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:2.0:1780997332.369747:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 8 00010000:00080000:2.0:1780997332.369751:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969482 00010000:00080000:2.0:1780997332.369755:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969482 00000100:00000040:3.0:1780997332.374705:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689b1008700 x1867507110462208 msgsize 440 00000100:00100000:3.0:1780997332.374727:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997332.377215:0:8237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110462208 00000100:00100000:2.0:1780997332.377229:0:8237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110462208 00000020:00000040:2.0:1780997332.377232:0:8237:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:2.0:1780997332.377237:0:8237:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=9 00000100:00000040:2.0:1780997332.377264:0:8237:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780997332.377332:0:8237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1052 00000100:00000040:2.0:1780997332.377337:0:8237:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:2.0:1780997332.377346:0:8237:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b1008700 x1867507110462208/t0(4294969482) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.377361:0:8237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2393:x1867507110462208:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:2.0:1780997332.377374:0:8237:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1008700 x1867507110462208/t0(4294969482) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780997332.377384:0:8237:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969482, current: 4294969482, replaying 00010000:00000040:2.0:1780997332.377387:0:8237:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:2.0:1780997332.377407:0:8237:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1008700 x1867507110462208/t0(4294969482) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.377417:0:8237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+9:2393:x1867507110462208:12345-192.168.206.51@tcp:10:dd.0 Request processed in 60us (2713us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780997332.377438:0:8237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1052 00000100:00000040:2.0:1780997332.377442:0:8237:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:3.0:1780997332.377707:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969482, next_transno: 4294969482 00010000:00080000:3.0:1780997332.377714:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969482) 00010000:00080000:3.0:1780997332.377723:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110462208 t4294969482 from 192.168.206.51@tcp req@ffff9689b1008700 x1867507110462208/t0(4294969482) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.377739:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1008700 x1867507110462208/t0(4294969482) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1780997332.377771:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x626:0x0] 00000001:00000040:3.0:1780997332.377951:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 5 00000020:00000040:3.0:1780997332.377955:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=10 00010000:00000040:3.0:1780997332.377999:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969482, xid 1867507110462208 00000100:00000040:3.0:1780997332.378010:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997332.378024:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997332.378080:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:3.0:1780997332.378091:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780997332.378097:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.378106:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 9 00010000:00080000:3.0:1780997332.378111:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00010000:00080000:3.0:1780997332.378114:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00000100:00000040:3.0:1780997332.385573:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689b100b100 x1867507110463616 msgsize 440 00000100:00100000:3.0:1780997332.385591:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997332.385639:0:8238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110463616 00000100:00100000:3.0:1780997332.385649:0:8238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110463616 00000020:00000040:3.0:1780997332.385652:0:8238:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:3.0:1780997332.385656:0:8238:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=10 00000100:00000040:3.0:1780997332.385682:0:8238:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780997332.385741:0:8238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1053 00000100:00000040:3.0:1780997332.385745:0:8238:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997332.385754:0:8238:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b100b100 x1867507110463616/t0(4294969483) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.385769:0:8238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2393:x1867507110463616:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:3.0:1780997332.385781:0:8238:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b100b100 x1867507110463616/t0(4294969483) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.385789:0:8238:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969483, current: 4294969483, replaying 00010000:00000040:3.0:1780997332.385793:0:8238:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:3.0:1780997332.385804:0:8238:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b100b100 x1867507110463616/t0(4294969483) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.385812:0:8238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+10:2393:x1867507110463616:12345-192.168.206.51@tcp:10:dd.0 Request processed in 46us (241us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.385829:0:8238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1053 00000100:00000040:3.0:1780997332.385832:0:8238:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:3.0:1780997332.385852:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969483, next_transno: 4294969483 00010000:00080000:3.0:1780997332.385855:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969483) 00010000:00080000:3.0:1780997332.385862:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110463616 t4294969483 from 192.168.206.51@tcp req@ffff9689b100b100 x1867507110463616/t0(4294969483) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.385876:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b100b100 x1867507110463616/t0(4294969483) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1780997332.385905:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x628:0x0] 00000001:00000040:3.0:1780997332.386088:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 6 00000020:00000040:3.0:1780997332.386092:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=11 00010000:00000040:3.0:1780997332.386122:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969483, xid 1867507110463616 00000100:00000040:3.0:1780997332.386131:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997332.386136:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997332.386174:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:3.0:1780997332.386181:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780997332.386186:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.386195:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 10 00010000:00080000:3.0:1780997332.386199:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00010000:00080000:3.0:1780997332.386202:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00000100:00000040:3.0:1780997332.389213:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689b100aa00 x1867507110465152 msgsize 440 00000100:00100000:3.0:1780997332.389230:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.389356:0:24142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110465152 00000100:00100000:1.0:1780997332.389378:0:24142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110465152 00000020:00000040:1.0:1780997332.389381:0:24142:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.389385:0:24142:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=11 00000100:00000040:1.0:1780997332.389410:0:24142:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997332.389465:0:24142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1054 00000100:00000040:1.0:1780997332.389469:0:24142:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.389478:0:24142:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b100aa00 x1867507110465152/t0(4294969484) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.389492:0:24142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2393:x1867507110465152:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:1.0:1780997332.389503:0:24142:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b100aa00 x1867507110465152/t0(4294969484) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997332.389512:0:24142:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969484, current: 4294969484, replaying 00010000:00000040:1.0:1780997332.389516:0:24142:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.389528:0:24142:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b100aa00 x1867507110465152/t0(4294969484) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.389534:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969484, next_transno: 4294969484 00000100:00100000:1.0:1780997332.389539:0:24142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2393:x1867507110465152:12345-192.168.206.51@tcp:10:dd.0 Request processed in 48us (325us total) trans 0 rc 0/-999 00010000:00080000:3.0:1780997332.389540:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969484) 00000100:00100000:1.0:1780997332.389551:0:24142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1054 00010000:00080000:3.0:1780997332.389555:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110465152 t4294969484 from 192.168.206.51@tcp req@ffff9689b100aa00 x1867507110465152/t0(4294969484) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00000040:1.0:1780997332.389556:0:24142:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00000020:00000040:3.0:1780997332.389586:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b100aa00 x1867507110465152/t0(4294969484) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1780997332.389621:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x627:0x0] 00000001:00000040:3.0:1780997332.389790:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 7 00000020:00000040:3.0:1780997332.389794:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=12 00010000:00000040:3.0:1780997332.389823:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969484, xid 1867507110465152 00000100:00000040:3.0:1780997332.389833:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997332.389838:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997332.389883:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:3.0:1780997332.389892:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780997332.389897:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.389905:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 11 00010000:00080000:3.0:1780997332.389909:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00010000:00080000:3.0:1780997332.389912:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00000100:00000040:3.0:1780997332.392948:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689b100ad80 x1867507110466048 msgsize 440 00000100:00100000:3.0:1780997332.392961:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997332.393366:0:23857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110466048 00000100:00100000:0.0:1780997332.393376:0:23857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110466048 00000020:00000040:0.0:1780997332.393379:0:23857:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:0.0:1780997332.393385:0:23857:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=12 00000100:00000040:0.0:1780997332.393417:0:23857:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780997332.393467:0:23857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1055 00000100:00000040:0.0:1780997332.393472:0:23857:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:0.0:1780997332.393479:0:23857:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b100ad80 x1867507110466048/t0(4294969485) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997332.393492:0:23857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b100ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:2393:x1867507110466048:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:0.0:1780997332.393504:0:23857:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b100ad80 x1867507110466048/t0(4294969485) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780997332.393513:0:23857:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969485, current: 4294969485, replaying 00010000:00000040:0.0:1780997332.393517:0:23857:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:0.0:1780997332.393537:0:23857:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b100ad80 x1867507110466048/t0(4294969485) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997332.393547:0:23857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b100ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+12:2393:x1867507110466048:12345-192.168.206.51@tcp:10:dd.0 Request processed in 58us (600us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997332.393553:0:23857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1055 00000100:00000040:0.0:1780997332.393557:0:23857:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:1.0:1780997332.393608:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969485, next_transno: 4294969485 00010000:00080000:1.0:1780997332.393613:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969485) 00010000:00080000:1.0:1780997332.393621:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110466048 t4294969485 from 192.168.206.51@tcp req@ffff9689b100ad80 x1867507110466048/t0(4294969485) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780997332.393638:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b100ad80 x1867507110466048/t0(4294969485) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1780997332.393680:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x62a:0x0] 00000001:00000040:1.0:1780997332.393871:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 8 00000020:00000040:1.0:1780997332.393875:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=13 00010000:00000040:1.0:1780997332.393914:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969485, xid 1867507110466048 00000100:00000040:1.0:1780997332.393924:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:1.0:1780997332.393929:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:1.0:1780997332.393981:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:1.0:1780997332.393989:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1780997332.393994:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:1.0:1780997332.394003:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 12 00010000:00080000:1.0:1780997332.394007:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00010000:00080000:1.0:1780997332.394011:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00000100:00000040:0.0:1780997332.399607:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaa8380 x1867507110466304 msgsize 440 00000100:00100000:0.0:1780997332.399621:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.399702:0:24144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110466304 00000100:00100000:1.0:1780997332.399713:0:24144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110466304 00000020:00000040:1.0:1780997332.399717:0:24144:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.399721:0:24144:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=13 00000100:00000040:1.0:1780997332.399748:0:24144:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997332.399800:0:24144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1056 00000100:00000040:1.0:1780997332.399805:0:24144:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.399812:0:24144:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaa8380 x1867507110466304/t0(4294969486) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.399826:0:24144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:2393:x1867507110466304:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:1.0:1780997332.399838:0:24144:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaa8380 x1867507110466304/t0(4294969486) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997332.399847:0:24144:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969486, current: 4294969486, replaying 00010000:00000040:1.0:1780997332.399850:0:24144:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.399869:0:24144:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaa8380 x1867507110466304/t0(4294969486) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.399895:0:24144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+13:2393:x1867507110466304:12345-192.168.206.51@tcp:10:dd.0 Request processed in 71us (289us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.399902:0:24144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1056 00000100:00000040:1.0:1780997332.399905:0:24144:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:0.0:1780997332.400100:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969486, next_transno: 4294969486 00010000:00080000:0.0:1780997332.400109:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969486) 00010000:00080000:0.0:1780997332.400117:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110466304 t4294969486 from 192.168.206.51@tcp req@ffff9689bfaa8380 x1867507110466304/t0(4294969486) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.400133:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaa8380 x1867507110466304/t0(4294969486) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780997332.400163:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x629:0x0] 00000001:00000040:0.0:1780997332.400365:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 9 00000020:00000040:0.0:1780997332.400369:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=14 00010000:00000040:0.0:1780997332.400398:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969486, xid 1867507110466304 00000100:00000040:0.0:1780997332.400407:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997332.400413:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997332.400458:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:0.0:1780997332.400466:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780997332.400472:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:0.0:1780997332.400481:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 13 00010000:00080000:0.0:1780997332.400485:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00010000:00080000:0.0:1780997332.400489:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00000100:00000040:3.0:1780997332.403164:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689b1008e00 x1867507110468352 msgsize 440 00000100:00100000:3.0:1780997332.403178:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.403241:0:23856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110468352 00000100:00100000:1.0:1780997332.403249:0:23856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110468352 00000020:00000040:1.0:1780997332.403252:0:23856:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.403256:0:23856:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=14 00000100:00000040:1.0:1780997332.403302:0:23856:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997332.403341:0:23856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1057 00000100:00000040:1.0:1780997332.403345:0:23856:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.403352:0:23856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b1008e00 x1867507110468352/t0(4294969487) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.403366:0:23856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:2393:x1867507110468352:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:1.0:1780997332.403377:0:23856:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1008e00 x1867507110468352/t0(4294969487) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997332.403386:0:23856:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969487, current: 4294969487, replaying 00010000:00000040:1.0:1780997332.403390:0:23856:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.403403:0:23856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1008e00 x1867507110468352/t0(4294969487) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.403413:0:23856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+14:2393:x1867507110468352:12345-192.168.206.51@tcp:10:dd.0 Request processed in 49us (250us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.403419:0:23856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1057 00000100:00000040:1.0:1780997332.403423:0:23856:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:3.0:1780997332.403476:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969487, next_transno: 4294969487 00010000:00080000:3.0:1780997332.403480:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969487) 00010000:00080000:3.0:1780997332.403488:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110468352 t4294969487 from 192.168.206.51@tcp req@ffff9689b1008e00 x1867507110468352/t0(4294969487) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.403503:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1008e00 x1867507110468352/t0(4294969487) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1780997332.403531:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x62b:0x0] 00000001:00000040:3.0:1780997332.403709:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 10 00000020:00000040:3.0:1780997332.403718:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=15 00010000:00000040:3.0:1780997332.403751:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969487, xid 1867507110468352 00000100:00000040:3.0:1780997332.403761:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997332.403767:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997332.403813:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:3.0:1780997332.403821:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780997332.403825:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.403834:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 14 00010000:00080000:3.0:1780997332.403837:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00010000:00080000:3.0:1780997332.403841:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00000100:00000040:1.0:1780997332.415788:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689bc963100 x1867507110468864 msgsize 440 00000100:00100000:1.0:1780997332.415821:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997332.416006:0:23858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110468864 00000100:00100000:2.0:1780997332.416016:0:23858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110468864 00000020:00000040:2.0:1780997332.416019:0:23858:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:2.0:1780997332.416024:0:23858:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=15 00000100:00000040:2.0:1780997332.416049:0:23858:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780997332.416095:0:23858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1058 00000100:00000040:2.0:1780997332.416099:0:23858:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:2.0:1780997332.416107:0:23858:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bc963100 x1867507110468864/t0(4294969488) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.416119:0:23858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+15:2393:x1867507110468864:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:2.0:1780997332.416131:0:23858:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bc963100 x1867507110468864/t0(4294969488) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780997332.416139:0:23858:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969488, current: 4294969488, replaying 00010000:00000040:2.0:1780997332.416143:0:23858:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:2.0:1780997332.416166:0:23858:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc963100 x1867507110468864/t0(4294969488) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.416174:0:23858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+15:2393:x1867507110468864:12345-192.168.206.51@tcp:10:dd.0 Request processed in 56us (387us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780997332.416180:0:23858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1058 00000100:00000040:2.0:1780997332.416183:0:23858:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:1.0:1780997332.416295:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969488, next_transno: 4294969488 00010000:00080000:1.0:1780997332.416299:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969488) 00010000:00080000:1.0:1780997332.416308:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110468864 t4294969488 from 192.168.206.51@tcp req@ffff9689bc963100 x1867507110468864/t0(4294969488) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780997332.416322:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bc963100 x1867507110468864/t0(4294969488) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1780997332.416350:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x62c:0x0] 00000001:00000040:1.0:1780997332.416531:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 11 00000020:00000040:1.0:1780997332.416535:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=16 00010000:00000040:1.0:1780997332.416568:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969488, xid 1867507110468864 00000100:00000040:1.0:1780997332.416577:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:1.0:1780997332.416583:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:1.0:1780997332.416630:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:1.0:1780997332.416637:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1780997332.416642:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:1.0:1780997332.416650:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 15 00010000:00080000:1.0:1780997332.416653:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00010000:00080000:1.0:1780997332.416656:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00000100:00000040:0.0:1780997332.421583:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaa9f80 x1867507110470016 msgsize 440 00000100:00100000:0.0:1780997332.421599:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997332.421738:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110470016 00000100:00100000:3.0:1780997332.421749:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110470016 00000020:00000040:3.0:1780997332.421752:0:24155:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:3.0:1780997332.421756:0:24155:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=16 00000100:00000040:3.0:1780997332.421781:0:24155:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780997332.421829:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1059 00000100:00000040:3.0:1780997332.421833:0:24155:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997332.421841:0:24155:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaa9f80 x1867507110470016/t0(4294969489) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.421855:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+16:2393:x1867507110470016:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:3.0:1780997332.421867:0:24155:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaa9f80 x1867507110470016/t0(4294969489) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.421876:0:24155:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969489, current: 4294969489, replaying 00010000:00000040:3.0:1780997332.421880:0:24155:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:3.0:1780997332.421891:0:24155:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaa9f80 x1867507110470016/t0(4294969489) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.421901:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+16:2393:x1867507110470016:12345-192.168.206.51@tcp:10:dd.0 Request processed in 48us (318us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.421915:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1059 00000100:00000040:3.0:1780997332.421918:0:24155:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:3.0:1780997332.421935:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969489, next_transno: 4294969489 00010000:00080000:3.0:1780997332.421939:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969489) 00010000:00080000:3.0:1780997332.421946:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110470016 t4294969489 from 192.168.206.51@tcp req@ffff9689bfaa9f80 x1867507110470016/t0(4294969489) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.421960:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaa9f80 x1867507110470016/t0(4294969489) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1780997332.421988:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x62e:0x0] 00000001:00000040:3.0:1780997332.422146:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 12 00000020:00000040:3.0:1780997332.422150:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=17 00010000:00000040:3.0:1780997332.422180:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969489, xid 1867507110470016 00000100:00000040:3.0:1780997332.422190:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997332.424492:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997332.424561:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:3.0:1780997332.424578:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780997332.424587:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.424599:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 16 00010000:00080000:3.0:1780997332.424604:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00010000:00080000:3.0:1780997332.424609:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00000100:00000040:0.0:1780997332.427145:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaa8700 x1867507110471808 msgsize 440 00000100:00100000:0.0:1780997332.427161:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.427237:0:24143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110471808 00000100:00100000:1.0:1780997332.427247:0:24143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110471808 00000020:00000040:1.0:1780997332.427250:0:24143:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.427255:0:24143:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=17 00000100:00000040:1.0:1780997332.427305:0:24143:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997332.427341:0:24143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1060 00000100:00000040:1.0:1780997332.427345:0:24143:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.427353:0:24143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaa8700 x1867507110471808/t0(4294969490) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.427378:0:24143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+17:2393:x1867507110471808:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:1.0:1780997332.427389:0:24143:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaa8700 x1867507110471808/t0(4294969490) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997332.427397:0:24143:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969490, current: 4294969490, replaying 00010000:00000040:1.0:1780997332.427401:0:24143:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.427467:0:24143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaa8700 x1867507110471808/t0(4294969490) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.427476:0:24143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+17:2393:x1867507110471808:12345-192.168.206.51@tcp:10:dd.0 Request processed in 101us (332us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.427483:0:24143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1060 00000100:00000040:1.0:1780997332.427486:0:24143:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:1.0:1780997332.428326:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969490, next_transno: 4294969490 00010000:00080000:1.0:1780997332.428331:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969490) 00010000:00080000:1.0:1780997332.428340:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110471808 t4294969490 from 192.168.206.51@tcp req@ffff9689bfaa8700 x1867507110471808/t0(4294969490) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780997332.428356:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaa8700 x1867507110471808/t0(4294969490) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1780997332.428385:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x62d:0x0] 00000001:00000040:1.0:1780997332.428586:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 13 00000020:00000040:1.0:1780997332.428589:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=18 00010000:00000040:1.0:1780997332.428618:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969490, xid 1867507110471808 00000100:00000040:1.0:1780997332.428627:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:1.0:1780997332.428632:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:1.0:1780997332.428775:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:1.0:1780997332.428790:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1780997332.428796:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:1.0:1780997332.428806:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 17 00010000:00080000:1.0:1780997332.428810:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 00010000:00080000:1.0:1780997332.428813:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 00000100:00000040:2.0:1780997332.443383:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff96888d28ed80 x1867507110471936 msgsize 440 00000100:00100000:2.0:1780997332.443400:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997332.443481:0:23854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110471936 00000100:00100000:3.0:1780997332.443491:0:23854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110471936 00000020:00000040:3.0:1780997332.443494:0:23854:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:3.0:1780997332.443498:0:23854:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=18 00000100:00000040:3.0:1780997332.443523:0:23854:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780997332.443575:0:23854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1061 00000100:00000040:3.0:1780997332.443579:0:23854:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997332.443597:0:23854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff96888d28ed80 x1867507110471936/t0(4294969491) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.443623:0:23854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96888d28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+18:2393:x1867507110471936:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:3.0:1780997332.443635:0:23854:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff96888d28ed80 x1867507110471936/t0(4294969491) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.443644:0:23854:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969491, current: 4294969491, replaying 00010000:00000040:3.0:1780997332.443647:0:23854:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:3.0:1780997332.443666:0:23854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff96888d28ed80 x1867507110471936/t0(4294969491) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.443674:0:23854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96888d28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+18:2393:x1867507110471936:12345-192.168.206.51@tcp:10:dd.0 Request processed in 67us (292us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.443680:0:23854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1061 00000100:00000040:3.0:1780997332.443692:0:23854:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:2.0:1780997332.446651:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969491, next_transno: 4294969491 00010000:00080000:2.0:1780997332.446667:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969491) 00010000:00080000:2.0:1780997332.446695:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110471936 t4294969491 from 192.168.206.51@tcp req@ffff96888d28ed80 x1867507110471936/t0(4294969491) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.446720:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff96888d28ed80 x1867507110471936/t0(4294969491) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1780997332.446755:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x62f:0x0] 00000001:00000040:2.0:1780997332.446926:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 14 00000020:00000040:2.0:1780997332.446929:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=19 00010000:00000040:2.0:1780997332.446957:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969491, xid 1867507110471936 00000100:00000040:2.0:1780997332.446966:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997332.446973:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997332.447018:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:2.0:1780997332.447027:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780997332.447034:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:2.0:1780997332.447045:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 18 00010000:00080000:2.0:1780997332.447049:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00010000:00080000:2.0:1780997332.447052:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00000100:00000040:3.0:1780997332.449430:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689b1008a80 x1867507110474880 msgsize 440 00000100:00100000:3.0:1780997332.449446:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997332.449793:0:8236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110474880 00000100:00100000:2.0:1780997332.449804:0:8236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110474880 00000020:00000040:2.0:1780997332.449807:0:8236:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:2.0:1780997332.449811:0:8236:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=19 00000100:00000040:2.0:1780997332.449836:0:8236:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780997332.449883:0:8236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1062 00000100:00000040:2.0:1780997332.449888:0:8236:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:2.0:1780997332.449895:0:8236:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b1008a80 x1867507110474880/t0(4294969492) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.449909:0:8236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+19:2393:x1867507110474880:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:2.0:1780997332.449930:0:8236:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1008a80 x1867507110474880/t0(4294969492) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780997332.449939:0:8236:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969492, current: 4294969492, replaying 00010000:00000040:2.0:1780997332.449942:0:8236:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:2.0:1780997332.449964:0:8236:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1008a80 x1867507110474880/t0(4294969492) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.449974:0:8236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+19:2393:x1867507110474880:12345-192.168.206.51@tcp:10:dd.0 Request processed in 68us (544us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780997332.449980:0:8236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1062 00000100:00000040:2.0:1780997332.449983:0:8236:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:3.0:1780997332.450101:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969492, next_transno: 4294969492 00010000:00080000:3.0:1780997332.450106:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969492) 00010000:00080000:3.0:1780997332.450115:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110474880 t4294969492 from 192.168.206.51@tcp req@ffff9689b1008a80 x1867507110474880/t0(4294969492) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.450131:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1008a80 x1867507110474880/t0(4294969492) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1780997332.450160:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x631:0x0] 00000001:00000040:3.0:1780997332.450345:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 15 00000020:00000040:3.0:1780997332.450350:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=20 00010000:00000040:3.0:1780997332.450381:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969492, xid 1867507110474880 00000100:00000040:3.0:1780997332.450397:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997332.450404:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997332.450451:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:3.0:1780997332.450460:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780997332.450466:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.450476:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 19 00010000:00080000:3.0:1780997332.450480:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00010000:00080000:3.0:1780997332.450483:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00000100:00000040:0.0:1780997332.460943:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaa8a80 x1867507110475520 msgsize 440 00000100:00100000:0.0:1780997332.460961:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.461080:0:8237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110475520 00000100:00100000:1.0:1780997332.461090:0:8237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110475520 00000020:00000040:1.0:1780997332.461094:0:8237:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.461097:0:8237:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=20 00000100:00000040:1.0:1780997332.461133:0:8237:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997332.461185:0:8237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1063 00000100:00000040:1.0:1780997332.461189:0:8237:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.461197:0:8237:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaa8a80 x1867507110475520/t0(4294969493) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.461212:0:8237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+20:2393:x1867507110475520:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:1.0:1780997332.461223:0:8237:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaa8a80 x1867507110475520/t0(4294969493) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997332.461232:0:8237:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969493, current: 4294969493, replaying 00010000:00000040:1.0:1780997332.461236:0:8237:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.461319:0:8237:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaa8a80 x1867507110475520/t0(4294969493) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.461329:0:8237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+20:2393:x1867507110475520:12345-192.168.206.51@tcp:10:dd.0 Request processed in 119us (387us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.461336:0:8237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1063 00000100:00000040:1.0:1780997332.461339:0:8237:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:0.0:1780997332.464787:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969493, next_transno: 4294969493 00010000:00080000:0.0:1780997332.464797:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969493) 00010000:00080000:0.0:1780997332.464814:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110475520 t4294969493 from 192.168.206.51@tcp req@ffff9689bfaa8a80 x1867507110475520/t0(4294969493) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.464867:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaa8a80 x1867507110475520/t0(4294969493) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780997332.464905:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x630:0x0] 00000001:00000040:0.0:1780997332.465086:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 16 00000020:00000040:0.0:1780997332.465091:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=21 00010000:00000040:0.0:1780997332.465125:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969493, xid 1867507110475520 00000100:00000040:0.0:1780997332.465137:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997332.465144:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997332.465251:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:0.0:1780997332.465264:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780997332.465371:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:0.0:1780997332.465384:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 20 00010000:00080000:0.0:1780997332.465388:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00010000:00080000:0.0:1780997332.465392:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00000100:00000040:2.0:1780997332.473238:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaafb80 x1867507110476544 msgsize 440 00000100:00100000:2.0:1780997332.473254:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997332.473413:0:8238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110476544 00000100:00100000:3.0:1780997332.473424:0:8238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110476544 00000020:00000040:3.0:1780997332.473427:0:8238:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:3.0:1780997332.473431:0:8238:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=21 00000100:00000040:3.0:1780997332.473457:0:8238:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780997332.473505:0:8238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1064 00000100:00000040:3.0:1780997332.473509:0:8238:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997332.473517:0:8238:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaafb80 x1867507110476544/t0(4294969494) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.473531:0:8238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+21:2393:x1867507110476544:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:3.0:1780997332.473543:0:8238:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaafb80 x1867507110476544/t0(4294969494) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.473551:0:8238:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969494, current: 4294969494, replaying 00010000:00000040:3.0:1780997332.473554:0:8238:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:3.0:1780997332.473621:0:8238:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaafb80 x1867507110476544/t0(4294969494) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.473631:0:8238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+21:2393:x1867507110476544:12345-192.168.206.51@tcp:10:dd.0 Request processed in 103us (394us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.473637:0:8238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1064 00000100:00000040:3.0:1780997332.473669:0:8238:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:0.0:1780997332.477193:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969494, next_transno: 4294969494 00010000:00080000:0.0:1780997332.477205:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969494) 00010000:00080000:0.0:1780997332.477222:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110476544 t4294969494 from 192.168.206.51@tcp req@ffff9689bfaafb80 x1867507110476544/t0(4294969494) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.477253:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaafb80 x1867507110476544/t0(4294969494) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780997332.477306:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x634:0x0] 00000001:00000040:0.0:1780997332.477486:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 17 00000020:00000040:0.0:1780997332.477490:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=22 00010000:00000040:0.0:1780997332.477522:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969494, xid 1867507110476544 00000100:00000040:0.0:1780997332.477532:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997332.477538:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997332.478116:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:0.0:1780997332.478129:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780997332.478138:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:0.0:1780997332.478150:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 21 00010000:00080000:0.0:1780997332.478154:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00010000:00080000:0.0:1780997332.478158:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00000100:00000040:3.0:1780997332.494654:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689b1009500 x1867507110477056 msgsize 440 00000100:00100000:3.0:1780997332.494671:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997332.494767:0:24142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110477056 00000100:00100000:2.0:1780997332.494778:0:24142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110477056 00000020:00000040:2.0:1780997332.494782:0:24142:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:2.0:1780997332.494788:0:24142:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=22 00000100:00000040:2.0:1780997332.494818:0:24142:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780997332.494868:0:24142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1065 00000100:00000040:2.0:1780997332.494872:0:24142:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:2.0:1780997332.494880:0:24142:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b1009500 x1867507110477056/t0(4294969495) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.494895:0:24142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:2393:x1867507110477056:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:2.0:1780997332.494908:0:24142:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1009500 x1867507110477056/t0(4294969495) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780997332.494919:0:24142:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969495, current: 4294969495, replaying 00010000:00000040:2.0:1780997332.494938:0:24142:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:2.0:1780997332.497913:0:24142:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1009500 x1867507110477056/t0(4294969495) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.497933:0:24142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+22:2393:x1867507110477056:12345-192.168.206.51@tcp:10:dd.0 Request processed in 3039us (3279us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780997332.497947:0:24142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1065 00000100:00000040:2.0:1780997332.497951:0:24142:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:0.0:1780997332.498066:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969495, next_transno: 4294969495 00010000:00080000:0.0:1780997332.498072:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969495) 00010000:00080000:0.0:1780997332.498081:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110477056 t4294969495 from 192.168.206.51@tcp req@ffff9689b1009500 x1867507110477056/t0(4294969495) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.498214:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1009500 x1867507110477056/t0(4294969495) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780997332.498256:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x633:0x0] 00000001:00000040:0.0:1780997332.498457:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 18 00000020:00000040:0.0:1780997332.498461:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=23 00010000:00000040:0.0:1780997332.498571:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969495, xid 1867507110477056 00000100:00000040:0.0:1780997332.498591:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997332.498597:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997332.498657:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:0.0:1780997332.498667:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780997332.498673:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:0.0:1780997332.498695:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 22 00010000:00080000:0.0:1780997332.498699:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00010000:00080000:0.0:1780997332.498703:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00000100:00000040:3.0:1780997332.515605:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689b1009180 x1867507110478080 msgsize 440 00000100:00100000:3.0:1780997332.515631:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.516444:0:23857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110478080 00000100:00100000:1.0:1780997332.516476:0:23857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110478080 00000020:00000040:1.0:1780997332.516479:0:23857:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.516484:0:23857:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=23 00000100:00000040:1.0:1780997332.516510:0:23857:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997332.516568:0:23857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1066 00000100:00000040:1.0:1780997332.516573:0:23857:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.516582:0:23857:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b1009180 x1867507110478080/t0(4294969496) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.516598:0:23857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+23:2393:x1867507110478080:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:1.0:1780997332.516613:0:23857:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1009180 x1867507110478080/t0(4294969496) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997332.516623:0:23857:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969496, current: 4294969496, replaying 00010000:00000040:1.0:1780997332.516627:0:23857:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.516648:0:23857:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1009180 x1867507110478080/t0(4294969496) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.516658:0:23857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+23:2393:x1867507110478080:12345-192.168.206.51@tcp:10:dd.0 Request processed in 64us (1055us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.516666:0:23857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1066 00000100:00000040:1.0:1780997332.516669:0:23857:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:0.0:1780997332.516758:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969496, next_transno: 4294969496 00010000:00080000:0.0:1780997332.516763:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969496) 00010000:00080000:0.0:1780997332.516773:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110478080 t4294969496 from 192.168.206.51@tcp req@ffff9689b1009180 x1867507110478080/t0(4294969496) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.516797:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1009180 x1867507110478080/t0(4294969496) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780997332.516826:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x632:0x0] 00000001:00000040:0.0:1780997332.517007:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 19 00000020:00000040:0.0:1780997332.517011:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=24 00010000:00000040:0.0:1780997332.517042:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969496, xid 1867507110478080 00000100:00000040:0.0:1780997332.517051:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997332.517071:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997332.517124:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:0.0:1780997332.517133:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780997332.517138:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:0.0:1780997332.517147:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 23 00010000:00080000:0.0:1780997332.517151:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00010000:00080000:0.0:1780997332.517154:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00000100:00000040:2.0:1780997332.526658:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55e300 x1867507110478208 msgsize 440 00000100:00100000:2.0:1780997332.526675:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997332.529926:0:24144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110478208 00000100:00100000:0.0:1780997332.529942:0:24144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110478208 00000020:00000040:0.0:1780997332.529945:0:24144:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:0.0:1780997332.529950:0:24144:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=24 00000100:00000040:0.0:1780997332.529993:0:24144:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780997332.530055:0:24144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1067 00000100:00000040:0.0:1780997332.530059:0:24144:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:0.0:1780997332.530067:0:24144:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55e300 x1867507110478208/t0(4294969497) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997332.530081:0:24144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+24:2393:x1867507110478208:12345-192.168.206.51@tcp:10:dd.0 00000020:00000040:0.0:1780997332.530093:0:24144:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bb55e300 x1867507110478208/t0(4294969497) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780997332.530119:0:24144:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969497, current: 4294969497, replaying 00010000:00000040:0.0:1780997332.530123:0:24144:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:0.0:1780997332.530148:0:24144:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55e300 x1867507110478208/t0(4294969497) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997332.530157:0:24144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+24:2393:x1867507110478208:12345-192.168.206.51@tcp:10:dd.0 Request processed in 79us (3499us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997332.530165:0:24144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1067 00000100:00000040:0.0:1780997332.530168:0:24144:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:3.0:1780997332.530334:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969497, next_transno: 4294969497 00010000:00080000:3.0:1780997332.530339:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969497) 00010000:00080000:3.0:1780997332.530347:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110478208 t4294969497 from 192.168.206.51@tcp req@ffff9689bb55e300 x1867507110478208/t0(4294969497) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.530362:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bb55e300 x1867507110478208/t0(4294969497) o10->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 440/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1780997332.530389:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x635:0x0] 00000001:00000040:3.0:1780997332.530565:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 20 00000020:00000040:3.0:1780997332.530569:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=25 00010000:00000040:3.0:1780997332.530601:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969497, xid 1867507110478208 00000100:00000040:3.0:1780997332.530611:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997332.530616:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997332.530677:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:3.0:1780997332.530695:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780997332.530702:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.530713:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 24 00010000:00080000:3.0:1780997332.530718:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00010000:00080000:3.0:1780997332.530722:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00000100:00000040:0.0:1780997332.541050:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfaa8000 x1867507110479232 msgsize 1512 00000100:00100000:0.0:1780997332.541068:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.541164:0:23856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110479232 00000100:00100000:1.0:1780997332.541174:0:23856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110479232 00000020:00000040:1.0:1780997332.541178:0:23856:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.541182:0:23856:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=25 00000100:00000040:1.0:1780997332.541209:0:23856:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997332.541259:0:23856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1068 00000100:00000040:1.0:1780997332.541264:0:23856:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.541300:0:23856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfaa8000 x1867507110479232/t0(4294969498) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.541334:0:23856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2393:x1867507110479232:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:1.0:1780997332.541346:0:23856:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaa8000 x1867507110479232/t0(4294969498) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997332.541354:0:23856:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969498, current: 4294969498, replaying 00010000:00000040:1.0:1780997332.541357:0:23856:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.541367:0:23856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfaa8000 x1867507110479232/t0(4294969498) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.541376:0:23856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+25:2393:x1867507110479232:12345-192.168.206.51@tcp:4:dd.0 Request processed in 46us (326us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.541383:0:23856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1068 00000100:00000040:1.0:1780997332.541386:0:23856:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:0.0:1780997332.541518:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969498, next_transno: 4294969498 00010000:00080000:0.0:1780997332.541522:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969498) 00010000:00080000:0.0:1780997332.541530:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110479232 t4294969498 from 192.168.206.51@tcp req@ffff9689bfaa8000 x1867507110479232/t0(4294969498) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.541546:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfaa8000 x1867507110479232/t0(4294969498) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780997332.541585:0:92703:0:(ofd_dev.c:428:ofd_object_init()) object init, fid = [0x280000401:0x0:0x0] 00002000:00080000:0.0:1780997332.541724:0:92703:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000020:00000040:0.0:1780997332.541793:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1780997332.541820:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:0.0:1780997332.541823:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1780997332.542175:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 21 00000020:00000040:0.0:1780997332.542180:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=26 00010000:00000040:0.0:1780997332.542583:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969498, xid 1867507110479232 00000100:00000040:0.0:1780997332.542595:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997332.542602:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997332.542661:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:0.0:1780997332.542671:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780997332.542789:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:0.0:1780997332.542801:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 25 00010000:00080000:0.0:1780997332.542806:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00010000:00080000:0.0:1780997332.542810:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00000100:00000040:3.0:1780997332.545240:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689b1009f80 x1867507110479488 msgsize 1512 00000100:00100000:3.0:1780997332.545255:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.545366:0:8237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110479488 00000100:00100000:1.0:1780997332.545374:0:8237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110479488 00000020:00000040:1.0:1780997332.545377:0:8237:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.545382:0:8237:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=26 00000100:00000040:1.0:1780997332.545405:0:8237:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997332.545448:0:8237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1069 00000100:00000040:1.0:1780997332.545452:0:8237:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.545459:0:8237:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b1009f80 x1867507110479488/t0(4294969499) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.545471:0:8237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+26:2393:x1867507110479488:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:1.0:1780997332.545481:0:8237:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1009f80 x1867507110479488/t0(4294969499) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997332.545489:0:8237:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969499, current: 4294969499, replaying 00010000:00000040:1.0:1780997332.545499:0:8237:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.545507:0:8237:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1009f80 x1867507110479488/t0(4294969499) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.545516:0:8237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+26:2393:x1867507110479488:12345-192.168.206.51@tcp:4:dd.0 Request processed in 47us (276us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.545523:0:8237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1069 00000100:00000040:1.0:1780997332.545525:0:8237:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:0.0:1780997332.545583:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969499, next_transno: 4294969499 00010000:00080000:0.0:1780997332.545587:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969499) 00010000:00080000:0.0:1780997332.545595:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110479488 t4294969499 from 192.168.206.51@tcp req@ffff9689b1009f80 x1867507110479488/t0(4294969499) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.545616:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1009f80 x1867507110479488/t0(4294969499) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.545713:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1780997332.545742:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:0.0:1780997332.545745:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1780997332.545995:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 22 00000020:00000040:0.0:1780997332.545999:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=27 00010000:00000040:0.0:1780997332.546554:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969499, xid 1867507110479488 00000100:00000040:0.0:1780997332.546566:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997332.546573:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997332.546629:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:0.0:1780997332.546639:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780997332.546646:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:0.0:1780997332.546655:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 26 00010000:00080000:0.0:1780997332.546659:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969500 00010000:00080000:0.0:1780997332.546662:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969500 00000100:00000040:0.0:1780997332.549416:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689aebb9500 x1867507110479744 msgsize 1512 00000100:00100000:0.0:1780997332.549432:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997332.549516:0:8238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110479744 00000100:00100000:3.0:1780997332.549526:0:8238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110479744 00000020:00000040:3.0:1780997332.549529:0:8238:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:3.0:1780997332.549540:0:8238:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=27 00000100:00000040:3.0:1780997332.549561:0:8238:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780997332.549608:0:8238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1070 00000100:00000040:3.0:1780997332.549622:0:8238:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997332.549629:0:8238:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689aebb9500 x1867507110479744/t0(4294969500) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.549643:0:8238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2393:x1867507110479744:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:3.0:1780997332.549655:0:8238:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689aebb9500 x1867507110479744/t0(4294969500) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.549664:0:8238:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969500, current: 4294969500, replaying 00010000:00000040:3.0:1780997332.549668:0:8238:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:3.0:1780997332.549693:0:8238:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689aebb9500 x1867507110479744/t0(4294969500) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.549703:0:8238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+27:2393:x1867507110479744:12345-192.168.206.51@tcp:4:dd.0 Request processed in 62us (287us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.549710:0:8238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1070 00000100:00000040:3.0:1780997332.549713:0:8238:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:0.0:1780997332.549797:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969500, next_transno: 4294969500 00010000:00080000:0.0:1780997332.549802:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969500) 00010000:00080000:0.0:1780997332.549812:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110479744 t4294969500 from 192.168.206.51@tcp req@ffff9689aebb9500 x1867507110479744/t0(4294969500) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.549827:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689aebb9500 x1867507110479744/t0(4294969500) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.549918:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1780997332.549949:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:0.0:1780997332.549953:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000020:00000040:0.0:1780997332.549966:0:92703:0:(tgt_handler.c:2949:tgt_brw_write()) Checksum 1024 from 12345-192.168.206.51@tcp OK: af884a0b 00000001:00000040:0.0:1780997332.550185:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 23 00000020:00000040:0.0:1780997332.550189:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=28 00010000:00000040:0.0:1780997332.550537:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969500, xid 1867507110479744 00000100:00000040:0.0:1780997332.550547:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997332.550554:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997332.550596:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:0.0:1780997332.550604:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780997332.550620:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:0.0:1780997332.550629:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 27 00010000:00080000:0.0:1780997332.550633:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969501 00010000:00080000:0.0:1780997332.550637:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969501 00000100:00000040:0.0:1780997332.568150:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689aebb8a80 x1867507110480000 msgsize 1512 00000100:00100000:0.0:1780997332.568164:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.568241:0:24142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110480000 00000100:00100000:1.0:1780997332.568251:0:24142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110480000 00000020:00000040:1.0:1780997332.568254:0:24142:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.568258:0:24142:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=28 00000100:00000040:1.0:1780997332.568308:0:24142:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997332.568350:0:24142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1071 00000100:00000040:1.0:1780997332.568354:0:24142:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.568361:0:24142:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689aebb8a80 x1867507110480000/t0(4294969501) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.568374:0:24142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689aebb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+28:2393:x1867507110480000:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:1.0:1780997332.568384:0:24142:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689aebb8a80 x1867507110480000/t0(4294969501) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997332.568394:0:24142:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969501, current: 4294969501, replaying 00010000:00000040:1.0:1780997332.568397:0:24142:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.568406:0:24142:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689aebb8a80 x1867507110480000/t0(4294969501) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.568415:0:24142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689aebb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+28:2393:x1867507110480000:12345-192.168.206.51@tcp:4:dd.0 Request processed in 44us (266us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.568421:0:24142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1071 00000100:00000040:1.0:1780997332.568433:0:24142:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:0.0:1780997332.568485:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969501, next_transno: 4294969501 00010000:00080000:0.0:1780997332.568489:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969501) 00010000:00080000:0.0:1780997332.568496:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110480000 t4294969501 from 192.168.206.51@tcp req@ffff9689aebb8a80 x1867507110480000/t0(4294969501) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.568521:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689aebb8a80 x1867507110480000/t0(4294969501) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.568672:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1780997332.568759:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:0.0:1780997332.568764:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1780997332.569114:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 24 00000020:00000040:0.0:1780997332.569118:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=29 00010000:00000040:2.0:1780997332.576908:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969501, xid 1867507110480000 00000100:00000040:2.0:1780997332.576932:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997332.576942:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997332.577118:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:2.0:1780997332.577133:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780997332.577143:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:2.0:1780997332.577158:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 28 00010000:00080000:2.0:1780997332.577164:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969502 00010000:00080000:2.0:1780997332.577168:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969502 00000100:00000040:0.0:1780997332.585205:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9688858b2680 x1867507110480256 msgsize 1512 00000100:00100000:0.0:1780997332.585220:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.587877:0:23857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110480256 00000100:00100000:1.0:1780997332.587892:0:23857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110480256 00000020:00000040:1.0:1780997332.587895:0:23857:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.587900:0:23857:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=29 00000100:00000040:1.0:1780997332.587925:0:23857:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997332.588073:0:23857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1072 00000100:00000040:1.0:1780997332.588077:0:23857:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.588085:0:23857:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9688858b2680 x1867507110480256/t0(4294969502) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.588098:0:23857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2393:x1867507110480256:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:1.0:1780997332.588111:0:23857:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9688858b2680 x1867507110480256/t0(4294969502) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997332.588120:0:23857:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969502, current: 4294969502, replaying 00010000:00000040:1.0:1780997332.588123:0:23857:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.588140:0:23857:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9688858b2680 x1867507110480256/t0(4294969502) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.588151:0:23857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+29:2393:x1867507110480256:12345-192.168.206.51@tcp:4:dd.0 Request processed in 54us (2946us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.588158:0:23857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1072 00000100:00000040:1.0:1780997332.588162:0:23857:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:2.0:1780997332.588197:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969502, next_transno: 4294969502 00010000:00080000:2.0:1780997332.588202:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969502) 00010000:00080000:2.0:1780997332.588210:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110480256 t4294969502 from 192.168.206.51@tcp req@ffff9688858b2680 x1867507110480256/t0(4294969502) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.588226:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9688858b2680 x1867507110480256/t0(4294969502) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.588338:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1780997332.588365:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:2.0:1780997332.588374:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1780997332.588615:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 25 00000020:00000040:2.0:1780997332.588619:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=30 00010000:00000040:2.0:1780997332.589144:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969502, xid 1867507110480256 00000100:00000040:2.0:1780997332.589158:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997332.589164:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997332.589215:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:2.0:1780997332.589224:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780997332.589230:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:2.0:1780997332.589239:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 29 00010000:00080000:2.0:1780997332.589244:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969503 00010000:00080000:2.0:1780997332.589247:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969503 00000100:00000040:1.0:1780997332.594928:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689b1163480 x1867507110480512 msgsize 1512 00000100:00100000:1.0:1780997332.594943:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997332.595007:0:8236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110480512 00000100:00100000:2.0:1780997332.595016:0:8236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110480512 00000020:00000040:2.0:1780997332.595019:0:8236:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:2.0:1780997332.595023:0:8236:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=30 00000100:00000040:2.0:1780997332.595046:0:8236:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780997332.595088:0:8236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1073 00000100:00000040:2.0:1780997332.595092:0:8236:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:2.0:1780997332.595099:0:8236:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b1163480 x1867507110480512/t0(4294969503) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.595113:0:8236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+30:2393:x1867507110480512:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:2.0:1780997332.595123:0:8236:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1163480 x1867507110480512/t0(4294969503) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780997332.595132:0:8236:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969503, current: 4294969503, replaying 00010000:00000040:2.0:1780997332.595135:0:8236:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:2.0:1780997332.595151:0:8236:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1163480 x1867507110480512/t0(4294969503) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.595171:0:8236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+30:2393:x1867507110480512:12345-192.168.206.51@tcp:4:dd.0 Request processed in 60us (243us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780997332.595178:0:8236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1073 00000100:00000040:2.0:1780997332.595180:0:8236:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:3.0:1780997332.595817:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969503, next_transno: 4294969503 00010000:00080000:3.0:1780997332.595824:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969503) 00010000:00080000:3.0:1780997332.595833:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110480512 t4294969503 from 192.168.206.51@tcp req@ffff9689b1163480 x1867507110480512/t0(4294969503) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.595850:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1163480 x1867507110480512/t0(4294969503) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.595940:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1780997332.595965:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:3.0:1780997332.595971:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1780997332.596231:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 26 00000020:00000040:3.0:1780997332.596236:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=31 00010000:00000040:3.0:1780997332.596670:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969503, xid 1867507110480512 00000100:00000040:3.0:1780997332.596680:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997332.596697:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997332.596751:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:3.0:1780997332.596760:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780997332.596765:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.596776:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 30 00010000:00080000:3.0:1780997332.596781:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969504 00010000:00080000:3.0:1780997332.596784:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969504 00000100:00000040:3.0:1780997332.599904:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689b100a300 x1867507110480768 msgsize 1512 00000100:00100000:3.0:1780997332.599921:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997332.600018:0:23858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110480768 00000100:00100000:0.0:1780997332.600027:0:23858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110480768 00000020:00000040:0.0:1780997332.600030:0:23858:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:0.0:1780997332.600035:0:23858:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=31 00000100:00000040:0.0:1780997332.600059:0:23858:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780997332.600105:0:23858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1074 00000100:00000040:0.0:1780997332.600109:0:23858:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:0.0:1780997332.600116:0:23858:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b100a300 x1867507110480768/t0(4294969504) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997332.600130:0:23858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+31:2393:x1867507110480768:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:0.0:1780997332.600142:0:23858:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b100a300 x1867507110480768/t0(4294969504) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780997332.600151:0:23858:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969504, current: 4294969504, replaying 00010000:00000040:0.0:1780997332.600154:0:23858:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:0.0:1780997332.600164:0:23858:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b100a300 x1867507110480768/t0(4294969504) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997332.600173:0:23858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+31:2393:x1867507110480768:12345-192.168.206.51@tcp:4:dd.0 Request processed in 45us (270us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997332.600190:0:23858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1074 00000100:00000040:0.0:1780997332.600193:0:23858:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:3.0:1780997332.600238:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969504, next_transno: 4294969504 00010000:00080000:3.0:1780997332.600242:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969504) 00010000:00080000:3.0:1780997332.600249:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110480768 t4294969504 from 192.168.206.51@tcp req@ffff9689b100a300 x1867507110480768/t0(4294969504) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.600264:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b100a300 x1867507110480768/t0(4294969504) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.600384:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1780997332.600422:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:3.0:1780997332.600426:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1780997332.600668:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 27 00000020:00000040:3.0:1780997332.600673:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=32 00010000:00000040:3.0:1780997332.601041:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969504, xid 1867507110480768 00000100:00000040:3.0:1780997332.601054:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997332.601060:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997332.601116:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:3.0:1780997332.601126:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780997332.601132:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.601143:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 31 00010000:00080000:3.0:1780997332.601148:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969505 00010000:00080000:3.0:1780997332.601151:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969505 00000100:00000040:3.0:1780997332.603470:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689b1009880 x1867507110481024 msgsize 1512 00000100:00100000:3.0:1780997332.603487:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997332.603709:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110481024 00000100:00100000:0.0:1780997332.603719:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110481024 00000020:00000040:0.0:1780997332.603721:0:24155:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:0.0:1780997332.603726:0:24155:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=32 00000100:00000040:0.0:1780997332.603749:0:24155:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780997332.603793:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1075 00000100:00000040:0.0:1780997332.603797:0:24155:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:0.0:1780997332.603803:0:24155:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b1009880 x1867507110481024/t0(4294969505) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997332.603817:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+32:2393:x1867507110481024:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:0.0:1780997332.603830:0:24155:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1009880 x1867507110481024/t0(4294969505) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780997332.603839:0:24155:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969505, current: 4294969505, replaying 00010000:00000040:0.0:1780997332.603843:0:24155:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:0.0:1780997332.603853:0:24155:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1009880 x1867507110481024/t0(4294969505) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997332.603861:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+32:2393:x1867507110481024:12345-192.168.206.51@tcp:4:dd.0 Request processed in 47us (392us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997332.603868:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1075 00000100:00000040:0.0:1780997332.603871:0:24155:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:3.0:1780997332.604028:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969505, next_transno: 4294969505 00010000:00080000:3.0:1780997332.604032:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969505) 00010000:00080000:3.0:1780997332.604040:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110481024 t4294969505 from 192.168.206.51@tcp req@ffff9689b1009880 x1867507110481024/t0(4294969505) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.604056:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b1009880 x1867507110481024/t0(4294969505) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.604170:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1780997332.604201:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:3.0:1780997332.604204:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1780997332.613196:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 28 00000020:00000040:3.0:1780997332.613206:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=33 00010000:00000040:3.0:1780997332.613255:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969505, xid 1867507110481024 00000100:00000040:3.0:1780997332.613295:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997332.613304:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997332.613358:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:3.0:1780997332.613371:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780997332.613380:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.613394:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 32 00010000:00080000:3.0:1780997332.613401:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969506 00010000:00080000:3.0:1780997332.613406:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969506 00000100:00000040:0.0:1780997332.615583:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9688858b1180 x1867507110481280 msgsize 1512 00000100:00100000:0.0:1780997332.615599:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.615708:0:24143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110481280 00000100:00100000:1.0:1780997332.615721:0:24143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110481280 00000020:00000040:1.0:1780997332.615725:0:24143:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.615731:0:24143:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=33 00000100:00000040:1.0:1780997332.615775:0:24143:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997332.615834:0:24143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1076 00000100:00000040:1.0:1780997332.615839:0:24143:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.615846:0:24143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9688858b1180 x1867507110481280/t0(4294969506) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.615860:0:24143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+33:2393:x1867507110481280:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:1.0:1780997332.615873:0:24143:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9688858b1180 x1867507110481280/t0(4294969506) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997332.615881:0:24143:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969506, current: 4294969506, replaying 00010000:00000040:1.0:1780997332.615885:0:24143:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.615903:0:24143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9688858b1180 x1867507110481280/t0(4294969506) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.615913:0:24143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+33:2393:x1867507110481280:12345-192.168.206.51@tcp:4:dd.0 Request processed in 54us (330us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.615920:0:24143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1076 00000100:00000040:1.0:1780997332.615923:0:24143:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:0.0:1780997332.616420:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969506, next_transno: 4294969506 00010000:00080000:0.0:1780997332.616431:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969506) 00010000:00080000:0.0:1780997332.616440:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110481280 t4294969506 from 192.168.206.51@tcp req@ffff9688858b1180 x1867507110481280/t0(4294969506) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.616458:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9688858b1180 x1867507110481280/t0(4294969506) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.616556:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1780997332.616584:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:0.0:1780997332.616587:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1780997332.617422:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 29 00000020:00000040:0.0:1780997332.617427:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=34 00010000:00000040:0.0:1780997332.617480:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969506, xid 1867507110481280 00000100:00000040:0.0:1780997332.617492:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997332.617499:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997332.617593:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:0.0:1780997332.617603:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780997332.617610:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:0.0:1780997332.617625:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 33 00010000:00080000:0.0:1780997332.617629:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969507 00010000:00080000:0.0:1780997332.617632:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969507 00000100:00000040:1.0:1780997332.626200:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfb1e680 x1867507110481536 msgsize 1512 00000100:00100000:1.0:1780997332.626221:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997332.631084:0:23854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110481536 00000100:00100000:3.0:1780997332.631097:0:23854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110481536 00000020:00000040:3.0:1780997332.631100:0:23854:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:3.0:1780997332.631105:0:23854:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=34 00000100:00000040:3.0:1780997332.631135:0:23854:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780997332.631188:0:23854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1077 00000100:00000040:3.0:1780997332.631193:0:23854:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997332.631200:0:23854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfb1e680 x1867507110481536/t0(4294969507) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.631214:0:23854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+34:2393:x1867507110481536:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:3.0:1780997332.631225:0:23854:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfb1e680 x1867507110481536/t0(4294969507) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.631233:0:23854:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969507, current: 4294969507, replaying 00010000:00000040:3.0:1780997332.631237:0:23854:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:3.0:1780997332.631256:0:23854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1e680 x1867507110481536/t0(4294969507) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.631264:0:23854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+34:2393:x1867507110481536:12345-192.168.206.51@tcp:4:dd.0 Request processed in 53us (5066us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.631292:0:23854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1077 00000100:00000040:3.0:1780997332.631296:0:23854:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:2.0:1780997332.631518:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969507, next_transno: 4294969507 00010000:00080000:2.0:1780997332.631523:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969507) 00010000:00080000:2.0:1780997332.631532:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110481536 t4294969507 from 192.168.206.51@tcp req@ffff9689bfb1e680 x1867507110481536/t0(4294969507) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.631547:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfb1e680 x1867507110481536/t0(4294969507) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.631658:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1780997332.631703:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:2.0:1780997332.631706:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1780997332.631941:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 30 00000020:00000040:2.0:1780997332.631945:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=35 00010000:00000040:0.0:1780997332.637911:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969507, xid 1867507110481536 00000100:00000040:0.0:1780997332.637937:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997332.637949:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997332.638023:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:0.0:1780997332.638040:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780997332.638052:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:0.0:1780997332.638071:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 34 00010000:00080000:0.0:1780997332.638077:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969508 00010000:00080000:0.0:1780997332.638082:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969508 00000100:00000040:3.0:1780997332.648110:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689b100bb80 x1867507110481792 msgsize 1512 00000100:00100000:3.0:1780997332.648125:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997332.648374:0:23857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110481792 00000100:00100000:0.0:1780997332.648384:0:23857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110481792 00000020:00000040:0.0:1780997332.648387:0:23857:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:0.0:1780997332.648391:0:23857:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=35 00000100:00000040:0.0:1780997332.648414:0:23857:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780997332.648541:0:23857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1078 00000100:00000040:0.0:1780997332.648545:0:23857:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:0.0:1780997332.648553:0:23857:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b100bb80 x1867507110481792/t0(4294969508) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997332.648568:0:23857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b100bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+35:2393:x1867507110481792:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:0.0:1780997332.648579:0:23857:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b100bb80 x1867507110481792/t0(4294969508) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780997332.648587:0:23857:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969508, current: 4294969508, replaying 00010000:00000040:0.0:1780997332.648591:0:23857:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:0.0:1780997332.648604:0:23857:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b100bb80 x1867507110481792/t0(4294969508) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997332.648612:0:23857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b100bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+35:2393:x1867507110481792:12345-192.168.206.51@tcp:4:dd.0 Request processed in 47us (504us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997332.648620:0:23857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1078 00000100:00000040:0.0:1780997332.648622:0:23857:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:0.0:1780997332.648641:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969508, next_transno: 4294969508 00010000:00080000:0.0:1780997332.648644:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969508) 00010000:00080000:0.0:1780997332.648652:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110481792 t4294969508 from 192.168.206.51@tcp req@ffff9689b100bb80 x1867507110481792/t0(4294969508) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.648668:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b100bb80 x1867507110481792/t0(4294969508) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780997332.648816:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1780997332.648854:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:0.0:1780997332.648857:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1780997332.649166:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 31 00000020:00000040:0.0:1780997332.649170:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=36 00010000:00000040:0.0:1780997332.651713:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969508, xid 1867507110481792 00000100:00000040:0.0:1780997332.651735:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997332.651745:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997332.651815:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:0.0:1780997332.651828:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780997332.651836:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:0.0:1780997332.651850:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 35 00010000:00080000:0.0:1780997332.651856:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969509 00010000:00080000:0.0:1780997332.651860:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969509 00000100:00000040:1.0:1780997332.657934:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfb1ce00 x1867507110482048 msgsize 1512 00000100:00100000:1.0:1780997332.657949:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997332.663164:0:23856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110482048 00000100:00100000:2.0:1780997332.663178:0:23856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110482048 00000020:00000040:2.0:1780997332.663181:0:23856:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:2.0:1780997332.663186:0:23856:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=36 00000100:00000040:2.0:1780997332.663212:0:23856:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780997332.663286:0:23856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1079 00000100:00000040:2.0:1780997332.663292:0:23856:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:2.0:1780997332.663299:0:23856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfb1ce00 x1867507110482048/t0(4294969509) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.663313:0:23856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+36:2393:x1867507110482048:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:2.0:1780997332.663324:0:23856:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfb1ce00 x1867507110482048/t0(4294969509) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780997332.663340:0:23856:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969509, current: 4294969509, replaying 00010000:00000040:2.0:1780997332.663344:0:23856:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:2.0:1780997332.663357:0:23856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1ce00 x1867507110482048/t0(4294969509) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780997332.663366:0:23856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+36:2393:x1867507110482048:12345-192.168.206.51@tcp:4:dd.0 Request processed in 56us (5433us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780997332.663375:0:23856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1079 00000100:00000040:2.0:1780997332.663378:0:23856:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:2.0:1780997332.663395:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969509, next_transno: 4294969509 00010000:00080000:2.0:1780997332.663399:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969509) 00010000:00080000:2.0:1780997332.663406:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110482048 t4294969509 from 192.168.206.51@tcp req@ffff9689bfb1ce00 x1867507110482048/t0(4294969509) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.663421:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfb1ce00 x1867507110482048/t0(4294969509) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.663513:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1780997332.663543:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:2.0:1780997332.663547:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1780997332.664344:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 32 00000020:00000040:2.0:1780997332.664350:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=37 00010000:00000040:2.0:1780997332.664843:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969509, xid 1867507110482048 00000100:00000040:2.0:1780997332.664860:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997332.664867:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997332.664927:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:2.0:1780997332.664938:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780997332.664946:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:2.0:1780997332.664958:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 36 00010000:00080000:2.0:1780997332.664972:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969510 00010000:00080000:2.0:1780997332.664976:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969510 00000100:00000040:2.0:1780997332.667114:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689bb55fb80 x1867507110482304 msgsize 1512 00000100:00100000:2.0:1780997332.667127:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997332.667333:0:8237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110482304 00000100:00100000:3.0:1780997332.667342:0:8237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110482304 00000020:00000040:3.0:1780997332.667345:0:8237:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:3.0:1780997332.667350:0:8237:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=37 00000100:00000040:3.0:1780997332.667373:0:8237:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780997332.667425:0:8237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1080 00000100:00000040:3.0:1780997332.667429:0:8237:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997332.667436:0:8237:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bb55fb80 x1867507110482304/t0(4294969510) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.667449:0:8237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bb55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+37:2393:x1867507110482304:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:3.0:1780997332.667460:0:8237:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bb55fb80 x1867507110482304/t0(4294969510) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.667469:0:8237:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969510, current: 4294969510, replaying 00010000:00000040:3.0:1780997332.667472:0:8237:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:3.0:1780997332.667515:0:8237:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bb55fb80 x1867507110482304/t0(4294969510) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.667524:0:8237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bb55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+37:2393:x1867507110482304:12345-192.168.206.51@tcp:4:dd.0 Request processed in 76us (410us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.667530:0:8237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1080 00000100:00000040:3.0:1780997332.667533:0:8237:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:2.0:1780997332.670130:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969510, next_transno: 4294969510 00010000:00080000:2.0:1780997332.670140:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969510) 00010000:00080000:2.0:1780997332.670155:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110482304 t4294969510 from 192.168.206.51@tcp req@ffff9689bb55fb80 x1867507110482304/t0(4294969510) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.670177:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bb55fb80 x1867507110482304/t0(4294969510) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.670307:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1780997332.670338:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:2.0:1780997332.670341:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1780997332.670596:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 33 00000020:00000040:2.0:1780997332.670601:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=38 00010000:00000040:2.0:1780997332.671987:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969510, xid 1867507110482304 00000100:00000040:2.0:1780997332.672002:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997332.672010:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997332.672060:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:2.0:1780997332.672071:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780997332.672079:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:2.0:1780997332.672090:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 37 00010000:00080000:2.0:1780997332.672096:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969511 00010000:00080000:2.0:1780997332.672099:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969511 00000100:00000040:2.0:1780997332.690016:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689ad8cb100 x1867507110482560 msgsize 1512 00000100:00100000:2.0:1780997332.690035:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997332.690555:0:8238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110482560 00000100:00100000:0.0:1780997332.690566:0:8238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110482560 00000020:00000040:0.0:1780997332.690570:0:8238:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:0.0:1780997332.690574:0:8238:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=38 00000100:00000040:0.0:1780997332.690601:0:8238:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780997332.690653:0:8238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1081 00000100:00000040:0.0:1780997332.690657:0:8238:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:0.0:1780997332.690664:0:8238:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689ad8cb100 x1867507110482560/t0(4294969511) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997332.690676:0:8238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+38:2393:x1867507110482560:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:0.0:1780997332.690697:0:8238:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689ad8cb100 x1867507110482560/t0(4294969511) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780997332.690707:0:8238:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969511, current: 4294969511, replaying 00010000:00000040:0.0:1780997332.690719:0:8238:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:0.0:1780997332.690730:0:8238:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ad8cb100 x1867507110482560/t0(4294969511) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780997332.690738:0:8238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+38:2393:x1867507110482560:12345-192.168.206.51@tcp:4:dd.0 Request processed in 64us (723us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997332.690746:0:8238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1081 00000100:00000040:0.0:1780997332.690749:0:8238:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:2.0:1780997332.690857:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969511, next_transno: 4294969511 00010000:00080000:2.0:1780997332.690868:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969511) 00010000:00080000:2.0:1780997332.690876:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110482560 t4294969511 from 192.168.206.51@tcp req@ffff9689ad8cb100 x1867507110482560/t0(4294969511) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.690892:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689ad8cb100 x1867507110482560/t0(4294969511) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.690982:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1780997332.691011:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:2.0:1780997332.691014:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1780997332.691298:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 34 00000020:00000040:2.0:1780997332.691302:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=39 00010000:00000040:2.0:1780997332.694784:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969511, xid 1867507110482560 00000100:00000040:2.0:1780997332.694805:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997332.694815:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997332.694885:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:2.0:1780997332.694898:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780997332.694908:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:2.0:1780997332.694920:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 38 00010000:00080000:2.0:1780997332.694926:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969512 00010000:00080000:2.0:1780997332.694929:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969512 40000000:00000040:3.0:1780997332.696955:0:92802:0:(lproc_fid.c:544:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 00000100:00000040:1.0:1780997332.702331:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfb1fb80 x1867507110482816 msgsize 1512 00000100:00100000:1.0:1780997332.702345:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997332.702416:0:24142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110482816 00000100:00100000:3.0:1780997332.702426:0:24142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110482816 00000020:00000040:3.0:1780997332.702428:0:24142:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:3.0:1780997332.702432:0:24142:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=39 00000100:00000040:3.0:1780997332.702457:0:24142:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780997332.702500:0:24142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1082 00000100:00000040:3.0:1780997332.702504:0:24142:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997332.702511:0:24142:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfb1fb80 x1867507110482816/t0(4294969512) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.702524:0:24142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+39:2393:x1867507110482816:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:3.0:1780997332.702544:0:24142:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfb1fb80 x1867507110482816/t0(4294969512) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.702553:0:24142:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969512, current: 4294969512, replaying 00010000:00000040:3.0:1780997332.702556:0:24142:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:3.0:1780997332.702567:0:24142:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1fb80 x1867507110482816/t0(4294969512) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.702576:0:24142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+39:2393:x1867507110482816:12345-192.168.206.51@tcp:4:dd.0 Request processed in 53us (246us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.702582:0:24142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1082 00000100:00000040:3.0:1780997332.702586:0:24142:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:2.0:1780997332.702749:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969512, next_transno: 4294969512 00010000:00080000:2.0:1780997332.702754:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969512) 00010000:00080000:2.0:1780997332.702762:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110482816 t4294969512 from 192.168.206.51@tcp req@ffff9689bfb1fb80 x1867507110482816/t0(4294969512) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.702777:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfb1fb80 x1867507110482816/t0(4294969512) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.702874:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1780997332.702901:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:2.0:1780997332.702909:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1780997332.703183:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 35 00000020:00000040:2.0:1780997332.703187:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=40 00010000:00000040:2.0:1780997332.704046:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969512, xid 1867507110482816 00000100:00000040:2.0:1780997332.704061:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997332.704067:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997332.704125:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:2.0:1780997332.704145:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780997332.704153:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:2.0:1780997332.704164:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 39 00010000:00080000:2.0:1780997332.704169:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969513 00010000:00080000:2.0:1780997332.704172:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969513 00000100:00000040:0.0:1780997332.708400:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9688858b1500 x1867507110483072 msgsize 1512 00000100:00100000:0.0:1780997332.708415:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.708577:0:24144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110483072 00000100:00100000:1.0:1780997332.708588:0:24144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110483072 00000020:00000040:1.0:1780997332.708592:0:24144:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.708596:0:24144:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=40 00000100:00000040:1.0:1780997332.708630:0:24144:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997332.708699:0:24144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1083 00000100:00000040:1.0:1780997332.708703:0:24144:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.708711:0:24144:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9688858b1500 x1867507110483072/t0(4294969513) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.708725:0:24144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+40:2393:x1867507110483072:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:1.0:1780997332.708737:0:24144:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9688858b1500 x1867507110483072/t0(4294969513) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997332.708746:0:24144:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969513, current: 4294969513, replaying 00010000:00000040:1.0:1780997332.708749:0:24144:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.708762:0:24144:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9688858b1500 x1867507110483072/t0(4294969513) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.708771:0:24144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+40:2393:x1867507110483072:12345-192.168.206.51@tcp:4:dd.0 Request processed in 49us (371us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.708778:0:24144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1083 00000100:00000040:1.0:1780997332.708781:0:24144:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:2.0:1780997332.709054:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969513, next_transno: 4294969513 00010000:00080000:2.0:1780997332.709058:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969513) 00010000:00080000:2.0:1780997332.709066:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110483072 t4294969513 from 192.168.206.51@tcp req@ffff9688858b1500 x1867507110483072/t0(4294969513) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.709081:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9688858b1500 x1867507110483072/t0(4294969513) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.709167:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1780997332.709195:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:2.0:1780997332.709198:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1780997332.709446:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 36 00000020:00000040:2.0:1780997332.709450:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=41 00010000:00000040:2.0:1780997332.709874:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969513, xid 1867507110483072 00000100:00000040:2.0:1780997332.709888:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997332.709896:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997332.709950:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:2.0:1780997332.709959:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780997332.709969:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:2.0:1780997332.709987:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 40 00010000:00080000:2.0:1780997332.709991:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969514 00010000:00080000:2.0:1780997332.709995:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969514 00010000:00010000:3.0:1780997332.710621:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1780997332.722719:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689ad8c9500 x1867507110483328 msgsize 1512 00000100:00100000:2.0:1780997332.722736:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997332.722836:0:8236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110483328 00000100:00100000:3.0:1780997332.722848:0:8236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110483328 00000020:00000040:3.0:1780997332.722852:0:8236:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:3.0:1780997332.722856:0:8236:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=41 00000100:00000040:3.0:1780997332.722881:0:8236:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780997332.722937:0:8236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1084 00000100:00000040:3.0:1780997332.722941:0:8236:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997332.722948:0:8236:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689ad8c9500 x1867507110483328/t0(4294969514) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.722962:0:8236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+41:2393:x1867507110483328:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:3.0:1780997332.722973:0:8236:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689ad8c9500 x1867507110483328/t0(4294969514) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.722992:0:8236:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969514, current: 4294969514, replaying 00010000:00000040:3.0:1780997332.722995:0:8236:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:3.0:1780997332.723028:0:8236:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ad8c9500 x1867507110483328/t0(4294969514) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.723038:0:8236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+41:2393:x1867507110483328:12345-192.168.206.51@tcp:4:dd.0 Request processed in 79us (320us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.723046:0:8236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1084 00000100:00000040:3.0:1780997332.723049:0:8236:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:1.0:1780997332.723151:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969514, next_transno: 4294969514 00010000:00080000:1.0:1780997332.723156:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969514) 00010000:00080000:1.0:1780997332.723165:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110483328 t4294969514 from 192.168.206.51@tcp req@ffff9689ad8c9500 x1867507110483328/t0(4294969514) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780997332.723181:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689ad8c9500 x1867507110483328/t0(4294969514) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780997332.723316:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1780997332.723345:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:1.0:1780997332.723348:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1780997332.723609:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 37 00000020:00000040:1.0:1780997332.723619:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=42 00010000:00000040:1.0:1780997332.725623:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969514, xid 1867507110483328 00000100:00000040:1.0:1780997332.725642:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:1.0:1780997332.725651:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:1.0:1780997332.725721:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:1.0:1780997332.725734:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1780997332.725744:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:1.0:1780997332.725758:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 41 00010000:00080000:1.0:1780997332.725764:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969515 00010000:00080000:1.0:1780997332.725769:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969515 00000100:00000040:0.0:1780997332.741073:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9688858b0e00 x1867507110483584 msgsize 1512 00000100:00100000:0.0:1780997332.741089:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997332.743562:0:23858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110483584 00000100:00100000:3.0:1780997332.743579:0:23858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110483584 00000020:00000040:3.0:1780997332.743582:0:23858:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:3.0:1780997332.743588:0:23858:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=42 00000100:00000040:3.0:1780997332.743622:0:23858:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780997332.743673:0:23858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1085 00000100:00000040:3.0:1780997332.743677:0:23858:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997332.743692:0:23858:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9688858b0e00 x1867507110483584/t0(4294969515) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.743707:0:23858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9688858b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+42:2393:x1867507110483584:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:3.0:1780997332.743721:0:23858:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9688858b0e00 x1867507110483584/t0(4294969515) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.743731:0:23858:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969515, current: 4294969515, replaying 00010000:00000040:3.0:1780997332.743736:0:23858:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:3.0:1780997332.743752:0:23858:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9688858b0e00 x1867507110483584/t0(4294969515) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.743761:0:23858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9688858b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+42:2393:x1867507110483584:12345-192.168.206.51@tcp:4:dd.0 Request processed in 57us (2690us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.743771:0:23858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1085 00000100:00000040:3.0:1780997332.743777:0:23858:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:2.0:1780997332.744072:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969515, next_transno: 4294969515 00010000:00080000:2.0:1780997332.744077:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969515) 00010000:00080000:2.0:1780997332.744085:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110483584 t4294969515 from 192.168.206.51@tcp req@ffff9688858b0e00 x1867507110483584/t0(4294969515) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.744101:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9688858b0e00 x1867507110483584/t0(4294969515) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780997332.744211:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1780997332.744245:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:2.0:1780997332.744250:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1780997332.744559:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 38 00000020:00000040:2.0:1780997332.744563:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=43 00010000:00000040:2.0:1780997332.745582:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969515, xid 1867507110483584 00000100:00000040:2.0:1780997332.745597:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:2.0:1780997332.745604:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:2.0:1780997332.745735:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:2.0:1780997332.745748:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780997332.745757:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:2.0:1780997332.745767:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 42 00010000:00080000:2.0:1780997332.745772:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969516 00010000:00080000:2.0:1780997332.745776:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969516 00000100:00000040:1.0:1780997332.765699:0:3491:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfb1df80 x1867507110483840 msgsize 1512 00000100:00100000:1.0:1780997332.765715:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997332.766147:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110483840 00000100:00100000:3.0:1780997332.766160:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110483840 00000020:00000040:3.0:1780997332.766164:0:24155:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:3.0:1780997332.766169:0:24155:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=43 00000100:00000040:3.0:1780997332.766198:0:24155:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780997332.766251:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1086 00000100:00000040:3.0:1780997332.766256:0:24155:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:3.0:1780997332.766264:0:24155:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfb1df80 x1867507110483840/t0(4294969516) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.766301:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+43:2393:x1867507110483840:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:3.0:1780997332.766313:0:24155:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfb1df80 x1867507110483840/t0(4294969516) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780997332.766321:0:24155:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969516, current: 4294969516, replaying 00010000:00000040:3.0:1780997332.766324:0:24155:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:3.0:1780997332.766337:0:24155:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1df80 x1867507110483840/t0(4294969516) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780997332.766346:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+43:2393:x1867507110483840:12345-192.168.206.51@tcp:4:dd.0 Request processed in 48us (648us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997332.766352:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1086 00000100:00000040:3.0:1780997332.766355:0:24155:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:3.0:1780997332.766372:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969516, next_transno: 4294969516 00010000:00080000:3.0:1780997332.766376:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969516) 00010000:00080000:3.0:1780997332.766382:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110483840 t4294969516 from 192.168.206.51@tcp req@ffff9689bfb1df80 x1867507110483840/t0(4294969516) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.766397:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfb1df80 x1867507110483840/t0(4294969516) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.766514:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1780997332.766548:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:3.0:1780997332.766552:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1780997332.767169:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 39 00000020:00000040:3.0:1780997332.767174:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=44 00010000:00000040:3.0:1780997332.767205:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969516, xid 1867507110483840 00000100:00000040:3.0:1780997332.767215:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997332.767221:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997332.767326:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:3.0:1780997332.767335:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780997332.767341:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.767349:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 43 00010000:00080000:3.0:1780997332.767353:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969517 00010000:00080000:3.0:1780997332.767357:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969517 00000100:00000040:3.0:1780997332.783746:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689b100a680 x1867507110484096 msgsize 1512 00000100:00100000:3.0:1780997332.783766:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.786991:0:24143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110484096 00000100:00100000:1.0:1780997332.787005:0:24143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110484096 00000020:00000040:1.0:1780997332.787008:0:24143:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.787014:0:24143:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=44 00000100:00000040:1.0:1780997332.787047:0:24143:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780997332.787149:0:24143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1087 00000100:00000040:1.0:1780997332.787155:0:24143:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.787162:0:24143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b100a680 x1867507110484096/t0(4294969517) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.787177:0:24143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b100a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+44:2393:x1867507110484096:12345-192.168.206.51@tcp:4:dd.0 00000020:00000040:1.0:1780997332.787190:0:24143:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b100a680 x1867507110484096/t0(4294969517) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780997332.787199:0:24143:0:(ldlm_lib.c:3212:target_queue_recovery_request()) Next recovery transno: 4294969517, current: 4294969517, replaying 00010000:00000040:1.0:1780997332.787203:0:24143:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.787216:0:24143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b100a680 x1867507110484096/t0(4294969517) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780997332.787239:0:24143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b100a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+44:2393:x1867507110484096:12345-192.168.206.51@tcp:4:dd.0 Request processed in 65us (3496us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.787247:0:24143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1087 00000100:00000040:1.0:1780997332.787251:0:24143:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00010000:00080000:3.0:1780997332.791607:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969517, next_transno: 4294969517 00010000:00080000:3.0:1780997332.791614:0:92703:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969517) 00010000:00080000:3.0:1780997332.791629:0:92703:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1867507110484096 t4294969517 from 192.168.206.51@tcp req@ffff9689b100a680 x1867507110484096/t0(4294969517) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.791654:0:92703:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b100a680 x1867507110484096/t0(4294969517) o4->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 1512/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780997332.791778:0:92703:0:(tgt_handler.c:2888:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1780997332.791808:0:92703:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 9875 MB/s 00000020:00000040:3.0:1780997332.791811:0:92703:0:(tgt_handler.c:1910:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1780997332.795861:0:92703:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9689bc9e6000 : new cb_count 40 00000020:00000040:3.0:1780997332.795869:0:92703:0:(genops.c:889:class_export_get()) GET export ffff9689bc9e6000 refcount=45 00010000:00000040:3.0:1780997332.797496:0:92703:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969477, transno 4294969517, xid 1867507110484096 00000100:00000040:3.0:1780997332.797517:0:92703:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:3.0:1780997332.797526:0:92703:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:3.0:1780997332.797582:0:92703:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00010000:00080000:3.0:1780997332.797596:0:92703:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780997332.797605:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.797618:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 44 00010000:00080000:3.0:1780997332.797624:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969518 00010000:00080000:3.0:1780997332.797627:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969518 00000100:00000040:1.0:1780997332.819669:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfb1ca80 x1867507110487552 msgsize 328 00000100:00100000:1.0:1780997332.819694:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:1.0:1780997332.819730:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfb1dc00 x1867507110487680 msgsize 328 00000100:00100000:1.0:1780997332.819735:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:1.0:1780997332.819753:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfb1c700 x1867507110487808 msgsize 328 00000100:00100000:1.0:1780997332.819757:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:1.0:1780997332.819777:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689b11e6d80 x1867507110487936 msgsize 328 00000100:00100000:1.0:1780997332.819781:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:1.0:1780997332.819796:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689b11e4e00 x1867507110488064 msgsize 328 00000100:00100000:1.0:1780997332.819800:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:1.0:1780997332.819815:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689b11e7480 x1867507110488192 msgsize 328 00000100:00100000:1.0:1780997332.819820:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:1.0:1780997332.819834:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689b11e5f80 x1867507110488320 msgsize 328 00000100:00100000:1.0:1780997332.819839:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:1.0:1780997332.819875:0:3490:0:(events.c:343:request_in_callback()) incoming req@ffff9689b11e5500 x1867507110488448 msgsize 328 00000100:00100000:1.0:1780997332.819880:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997332.819908:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110487552 00000100:00100000:1.0:1780997332.819916:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110487552 00000020:00000040:1.0:1780997332.819919:0:8232:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.819923:0:8232:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=45 00000100:00100000:1.0:1780997332.819964:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110487680 00000100:00100000:1.0:1780997332.819967:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110487680 00000020:00000040:1.0:1780997332.819968:0:8232:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.819970:0:8232:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=46 00000100:00100000:1.0:1780997332.820011:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110487808 00000100:00100000:1.0:1780997332.820014:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110487808 00000020:00000040:1.0:1780997332.820016:0:8232:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.820018:0:8232:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=47 00000100:00100000:1.0:1780997332.820030:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110487936 00000100:00100000:1.0:1780997332.820033:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110487936 00000020:00000040:1.0:1780997332.820034:0:8232:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.820036:0:8232:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=48 00000100:00100000:1.0:1780997332.820048:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110488064 00000100:00100000:1.0:1780997332.820051:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110488064 00000020:00000040:1.0:1780997332.820052:0:8232:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.820054:0:8232:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=49 00000100:00100000:1.0:1780997332.820066:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110488192 00000100:00100000:1.0:1780997332.820068:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110488192 00000020:00000040:1.0:1780997332.820069:0:8232:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.820071:0:8232:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=50 00000100:00100000:1.0:1780997332.820082:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110488320 00000100:00100000:1.0:1780997332.820085:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110488320 00000020:00000040:1.0:1780997332.820086:0:8232:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.820088:0:8232:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=51 00000100:00100000:1.0:1780997332.820108:0:8232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110488448 00000100:00100000:1.0:1780997332.820110:0:8232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110488448 00000020:00000040:1.0:1780997332.820112:0:8232:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c487 00000020:00000040:1.0:1780997332.820114:0:8232:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc9e6000 refcount=52 00000100:00100000:1.0:1780997332.820133:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6063 00000100:00000040:1.0:1780997332.820137:0:8232:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 1 00000100:00000040:1.0:1780997332.820144:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfb1ca80 x1867507110487552/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820158:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110487552:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1780997332.820170:0:8232:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfb1ca80 x1867507110487552/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1780997332.820189:0:8232:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00010000:00080000:1.0:1780997332.820194:0:8232:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689bfb1ca80 x1867507110487552/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.820205:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1ca80 x1867507110487552/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820213:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110487552:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 57us (544us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.820220:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6063 00000100:00000040:1.0:1780997332.820223:0:8232:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00000100:00100000:1.0:1780997332.820233:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6064 00000100:00000040:1.0:1780997332.820236:0:8232:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 2 00000100:00000040:1.0:1780997332.820239:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfb1dc00 x1867507110487680/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820248:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110487680:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1780997332.820255:0:8232:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfb1dc00 x1867507110487680/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1780997332.820261:0:8232:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 3 00010000:00080000:1.0:1780997332.820265:0:8232:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689bfb1dc00 x1867507110487680/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.820301:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1dc00 x1867507110487680/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820309:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110487680:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 63us (578us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.820322:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6064 00000100:00000040:1.0:1780997332.820325:0:8232:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 2 00000100:00100000:1.0:1780997332.820334:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6065 00000100:00000040:1.0:1780997332.820336:0:8232:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 3 00000100:00000040:1.0:1780997332.820339:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfb1c700 x1867507110487808/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820350:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110487808:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1780997332.820358:0:8232:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689bfb1c700 x1867507110487808/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1780997332.820365:0:8232:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 4 00010000:00080000:1.0:1780997332.820368:0:8232:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689bfb1c700 x1867507110487808/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.820377:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb1c700 x1867507110487808/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820385:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110487808:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 37us (631us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.820391:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6065 00000100:00000040:1.0:1780997332.820393:0:8232:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 3 00000100:00100000:1.0:1780997332.820400:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6066 00000100:00000040:1.0:1780997332.820402:0:8232:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 4 00000100:00000040:1.0:1780997332.820406:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b11e6d80 x1867507110487936/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820416:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110487936:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1780997332.820428:0:8232:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b11e6d80 x1867507110487936/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1780997332.820435:0:8232:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 5 00010000:00080000:1.0:1780997332.820439:0:8232:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689b11e6d80 x1867507110487936/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.820447:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b11e6d80 x1867507110487936/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820455:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110487936:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 40us (676us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.820461:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6066 00000100:00000040:1.0:1780997332.820462:0:8232:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 4 00000100:00100000:1.0:1780997332.820471:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6067 00000100:00000040:1.0:1780997332.820473:0:8232:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 5 00000100:00000040:1.0:1780997332.820477:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b11e4e00 x1867507110488064/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820487:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110488064:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1780997332.820493:0:8232:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b11e4e00 x1867507110488064/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1780997332.820499:0:8232:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 6 00010000:00080000:1.0:1780997332.820503:0:8232:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689b11e4e00 x1867507110488064/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.820511:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b11e4e00 x1867507110488064/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820529:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110488064:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 43us (730us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.820535:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6067 00000100:00000040:1.0:1780997332.820537:0:8232:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 5 00000100:00100000:1.0:1780997332.820545:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6068 00000100:00000040:1.0:1780997332.820547:0:8232:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 6 00000100:00000040:1.0:1780997332.820550:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b11e7480 x1867507110488192/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820560:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110488192:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1780997332.820566:0:8232:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b11e7480 x1867507110488192/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1780997332.820573:0:8232:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 7 00010000:00080000:1.0:1780997332.820576:0:8232:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689b11e7480 x1867507110488192/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.820584:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b11e7480 x1867507110488192/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820592:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110488192:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 33us (774us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.820597:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6068 00000100:00000040:1.0:1780997332.820600:0:8232:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 6 00000100:00100000:1.0:1780997332.820606:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6069 00000100:00000040:1.0:1780997332.820608:0:8232:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 7 00000100:00000040:1.0:1780997332.820612:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b11e5f80 x1867507110488320/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820628:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110488320:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1780997332.820635:0:8232:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b11e5f80 x1867507110488320/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1780997332.820641:0:8232:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 8 00010000:00080000:1.0:1780997332.820645:0:8232:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689b11e5f80 x1867507110488320/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.820653:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b11e5f80 x1867507110488320/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820661:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110488320:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 36us (825us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.820666:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6069 00000100:00000040:1.0:1780997332.820669:0:8232:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 7 00000100:00100000:1.0:1780997332.820676:0:8232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6070 00000100:00000040:1.0:1780997332.820678:0:8232:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 8 00000100:00000040:1.0:1780997332.820695:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b11e5500 x1867507110488448/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820706:0:8232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110488448:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1780997332.820712:0:8232:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff9689b11e5500 x1867507110488448/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1780997332.820719:0:8232:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9689bc9e6000 : new rpc_count 9 00010000:00080000:1.0:1780997332.820722:0:8232:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689b11e5500 x1867507110488448/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997332.820742:0:8232:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b11e5500 x1867507110488448/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997332.820751:0:8232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+52:2393:x1867507110488448:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 46us (874us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997332.820756:0:8232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6070 00000100:00000040:1.0:1780997332.820759:0:8232:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 8 00010000:00080000:3.0:1780997332.820935:0:92703:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294969518 00010000:00080000:3.0:1780997332.820940:0:92703:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00010000:00000040:3.0:1780997332.820946:0:92703:0:(ldlm_lib.c:2868:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:3.0:1780997332.820948:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1780997332.820951:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1780997332.820956:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff9689bfb1ca80 x1867507110487552/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1780997332.820963:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1780997332.836354:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 7 00000020:00000040:3.0:1780997332.836376:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 51 00010000:00080000:3.0:1780997332.836380:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1780997332.837764:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1780997332.837792:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff9689bfb1dc00 x1867507110487680/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1780997332.837803:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1780997332.837806:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 6 00000020:00000040:3.0:1780997332.837817:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 50 00010000:00080000:3.0:1780997332.837819:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1780997332.837821:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1780997332.837825:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff9689bfb1c700 x1867507110487808/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1780997332.837851:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1780997332.837853:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 5 00000020:00000040:3.0:1780997332.837859:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 49 00010000:00080000:3.0:1780997332.837861:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1780997332.837862:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1780997332.837867:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff9689b11e6d80 x1867507110487936/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1780997332.837872:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1780997332.837874:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 4 00000020:00000040:3.0:1780997332.837878:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 48 00010000:00080000:3.0:1780997332.837880:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1780997332.837882:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1780997332.837886:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff9689b11e4e00 x1867507110488064/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1780997332.837892:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1780997332.837894:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 3 00000020:00000040:3.0:1780997332.837898:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 47 00010000:00080000:3.0:1780997332.837900:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1780997332.837901:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1780997332.837906:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff9689b11e7480 x1867507110488192/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1780997332.837912:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1780997332.837913:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 2 00000020:00000040:3.0:1780997332.837918:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 46 00010000:00080000:3.0:1780997332.837919:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1780997332.837921:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1780997332.837925:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff9689b11e5f80 x1867507110488320/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1780997332.837941:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1780997332.837942:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 1 00000020:00000040:3.0:1780997332.837947:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 45 00010000:00080000:3.0:1780997332.837949:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1780997332.837950:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1780997332.837955:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff9689b11e5500 x1867507110488448/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:663/0 lens 328/0 e 0 to 0 dl 1780997343 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1780997332.837961:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1780997332.837962:0:92703:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9689bc9e6000 : new rpc_count 0 00000020:00000040:3.0:1780997332.837966:0:92703:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 44 00010000:00080000:3.0:1780997332.837968:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000020:00000040:1.0:1780997333.583409:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osd (ffff968990fe0000) now 12 - health_check_show 00000020:00000040:1.0:1780997333.583423:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osd (ffff968990fe0000) now 12 - health_check_show 00000020:00000040:1.0:1780997333.583426:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osd (ffff9689bfb3cd40) now 10 - health_check_show 00000020:00000040:1.0:1780997333.583429:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osd (ffff9689bfb3cd40) now 10 - health_check_show 00000020:00000040:1.0:1780997333.583432:0:92850:0:(obd_config.c:994:class_incref()) incref MGC192.168.206.151@tcp (ffff9689b6283380) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583434:0:92850:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.206.151@tcp (ffff9689b6283380) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583436:0:92850:0:(obd_config.c:994:class_incref()) incref MGS (ffff968990fe4d40) now 8 - health_check_show 00000020:00000040:1.0:1780997333.583441:0:92850:0:(obd_config.c:1022:class_decref()) Decref MGS (ffff968990fe4d40) now 8 - health_check_show 00000020:00000040:1.0:1780997333.583443:0:92850:0:(obd_config.c:994:class_incref()) incref MDS (ffff9689837799c0) now 4 - health_check_show 00000020:00000040:1.0:1780997333.583451:0:92850:0:(obd_config.c:1022:class_decref()) Decref MDS (ffff9689837799c0) now 4 - health_check_show 00000020:00000040:1.0:1780997333.583454:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-mdtlov (ffff9688858c19c0) now 5 - health_check_show 00000020:00000040:1.0:1780997333.583456:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-mdtlov (ffff9688858c19c0) now 5 - health_check_show 00000020:00000040:1.0:1780997333.583459:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff96888ac53380) now 16 - health_check_show 00000020:00000040:1.0:1780997333.583461:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff96888ac53380) now 16 - health_check_show 00000020:00000040:1.0:1780997333.583463:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDD0000 (ffff96888ac50000) now 5 - health_check_show 00000020:00000040:1.0:1780997333.583465:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0000 (ffff96888ac50000) now 5 - health_check_show 00000020:00000040:1.0:1780997333.583467:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-QMT0000 (ffff96888ac54d40) now 5 - health_check_show 00000020:00000040:1.0:1780997333.583470:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-QMT0000 (ffff96888ac54d40) now 5 - health_check_show 00000020:00000040:1.0:1780997333.583472:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff96888ac519c0) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583475:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff96888ac519c0) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583484:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff9689ba4e4d40) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583486:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff9689ba4e4d40) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583488:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff9689ba4e19c0) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583490:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff9689ba4e19c0) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583493:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff968886ec3380) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583495:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff968886ec3380) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583498:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-mdtlov (ffff9689ba6819c0) now 5 - health_check_show 00000020:00000040:1.0:1780997333.583500:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-mdtlov (ffff9689ba6819c0) now 5 - health_check_show 00000020:00000040:1.0:1780997333.583502:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9689ba680000) now 12 - health_check_show 00000020:00000040:1.0:1780997333.583504:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9689ba680000) now 12 - health_check_show 00000020:00000040:1.0:1780997333.583506:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDD0001 (ffff9689ba683380) now 5 - health_check_show 00000020:00000040:1.0:1780997333.583508:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0001 (ffff9689ba683380) now 5 - health_check_show 00000020:00000040:1.0:1780997333.583510:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff968886ec4d40) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583513:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osd (ffff968886ec4d40) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583515:0:92850:0:(obd_config.c:994:class_incref()) incref OSS (ffff9689ba4e0000) now 4 - health_check_show 00000020:00000040:1.0:1780997333.583522:0:92850:0:(obd_config.c:1022:class_decref()) Decref OSS (ffff9689ba4e0000) now 4 - health_check_show 00000020:00000040:1.0:1780997333.583524:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff9689bfb399c0) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583526:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff9689bfb399c0) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583528:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9689aeba3380) now 10 - health_check_show 00000020:00000040:1.0:1780997333.583595:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9689aeba3380) now 10 - health_check_show 00000020:00000040:1.0:1780997333.583598:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9689ba4e3380) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583600:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff9689ba4e3380) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583603:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff968990fe19c0) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583605:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff968990fe19c0) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583607:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff968990fe3380) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583610:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff968990fe3380) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583612:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osd (ffff9689b62819c0) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583623:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osd (ffff9689b62819c0) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583625:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - health_check_show 00000020:00000040:1.0:1780997333.583652:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - health_check_show 00000020:00000040:1.0:1780997333.583654:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff968886bdb380) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583657:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff968886bdb380) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583659:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff9688858c0000) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583661:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff9688858c0000) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583663:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff9689aeba4d40) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583665:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff9689aeba4d40) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583667:0:92850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff96888ac43380) now 6 - health_check_show 00000020:00000040:1.0:1780997333.583669:0:92850:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff96888ac43380) now 6 - health_check_show 00010000:00010000:0.0:1780997333.737482:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1780997333.925446:0:72371:0:(genops.c:1231:class_import_get()) import ffff9689ae566000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1780997333.925505:0:72371:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003b5d176f] to pc [ptlrpcd_00_02+2] req@ffff9689adb8a680 x1867507127057152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997333.925625:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689adb8a680 x1867507127057152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997333.925641:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127057152:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1780997333.925683:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689adb8a680 x1867507127057152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997349 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997333.925692:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997333.925738:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689b11e5880 x1867507127057152 msgsize 224 00000100:00100000:1.0:1780997333.925743:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997333.925781:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689adb8a680 x1867507127057152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997349 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997333.925796:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 947772 usecs (948 jiffies) 00000100:00100000:0.0:1780997333.925869:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127057152 00000100:00100000:0.0:1780997333.925877:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127057152 00000020:00000040:0.0:1780997333.925880:0:8241:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b4ea 00000020:00000040:0.0:1780997333.925884:0:8241:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79c9000 refcount=7 00000100:00000040:0.0:1780997333.925906:0:8241:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1780997333.925943:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4156 00000100:00000040:0.0:1780997333.925947:0:8241:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689b79c9000 : new rpc_count 1 00000100:00000040:0.0:1780997333.925952:0:8241:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b11e5880 x1867507127057152/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:664/0 lens 224/0 e 0 to 0 dl 1780997344 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997333.925964:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127057152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780997333.925997:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00010000:00000040:0.0:1780997333.926008:0:8241:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1867507127057152 00000100:00000040:0.0:1780997333.926031:0:8241:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:0.0:1780997333.926036:0:8241:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997333.926055:0:8241:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9689adb8a680 x1867507127057152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997349 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997333.926091:0:8241:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:0.0:1780997333.926096:0:8241:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b11e5880 x1867507127057152/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:664/0 lens 224/368 e 0 to 0 dl 1780997344 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997333.926104:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127057152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997333.926111:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4156 00000100:00000040:0.0:1780997333.926114:0:8241:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689b79c9000 : new rpc_count 0 00000020:00000040:0.0:1780997333.926124:0:8241:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79c9000 : new refcount 6 00000100:00000040:2.0:1780997333.928938:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:2.0:1780997333.928958:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689adb8a680 x1867507127057152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1780997333.928973:0:3498:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352839 avail=317136 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023597 state=0: rc = 0 00000100:00000040:2.0:1780997333.928982:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adb8a680 x1867507127057152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997349 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997333.928991:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127057152:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1780997333.928998:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689adb8a680 x1867507127057152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997349 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780997333.929009:0:3498:0:(genops.c:1244:class_import_put()) import ffff9689ae566000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000020:00000040:3.0:1780997333.929152:0:90256:0:(genops.c:1231:class_import_get()) import ffff9689869cf800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1780997333.929193:0:90256:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007f8212ca] to pc [ptlrpcd_00_03+3] req@ffff9689b1008000 x1867507127057280/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997333.929333:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:3.0:1780997333.929342:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b1008000 x1867507127057280/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997333.929355:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b1008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127057280:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1780997333.931867:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b1008000 x1867507127057280/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997349 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997333.931882:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997333.931927:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689b100b800 x1867507127057280 msgsize 224 00000100:00100000:3.0:1780997333.931932:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997333.931960:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b1008000 x1867507127057280/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997349 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997333.931973:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 8001 usecs (9 jiffies) 00000100:00100000:3.0:1780997333.932017:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127057280 00000100:00100000:3.0:1780997333.932037:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127057280 00000020:00000040:3.0:1780997333.932041:0:80061:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b530 00000020:00000040:3.0:1780997333.932045:0:80061:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968889698800 refcount=5 00000100:00000040:3.0:1780997333.932070:0:80061:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1780997333.932100:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4157 00000100:00000040:3.0:1780997333.932104:0:80061:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968889698800 : new rpc_count 1 00000100:00000040:3.0:1780997333.932110:0:80061:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b100b800 x1867507127057280/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:664/0 lens 224/0 e 0 to 0 dl 1780997344 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997333.932124:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127057280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780997333.932161:0:80061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00010000:00000040:3.0:1780997333.932171:0:80061:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127057280 00000100:00000040:3.0:1780997333.932182:0:80061:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:3.0:1780997333.932186:0:80061:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997333.932205:0:80061:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9689b1008000 x1867507127057280/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997349 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997333.932223:0:80061:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:3.0:1780997333.932228:0:80061:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b100b800 x1867507127057280/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:664/0 lens 224/368 e 0 to 0 dl 1780997344 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997333.932236:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127057280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997333.932243:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4157 00000100:00000040:3.0:1780997333.932246:0:80061:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968889698800 : new rpc_count 0 00000020:00000040:3.0:1780997333.932255:0:80061:0:(genops.c:900:class_export_put()) PUTting export ffff968889698800 : new refcount 4 00000100:00000040:3.0:1780997333.932309:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1780997333.932315:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b1008000 x1867507127057280/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1780997333.932326:0:3498:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352898 avail=317195 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023661 state=0: rc = 0 00000100:00000040:3.0:1780997333.932342:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1008000 x1867507127057280/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997349 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997333.932350:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b1008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127057280:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1780997333.932356:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b1008000 x1867507127057280/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780997349 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997333.932365:0:3498:0:(genops.c:1244:class_import_put()) import ffff9689869cf800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:0.0:1780997334.437352:0:90260:0:(genops.c:1231:class_import_get()) import ffff968886bc8000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1780997334.437387:0:90260:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cf4ca83e] to pc [ptlrpcd_00_00+0] req@ffff9689adb8ad80 x1867507127057408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997334.437742:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689adb8ad80 x1867507127057408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997334.437758:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127057408:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1780997334.437788:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689adb8ad80 x1867507127057408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997350 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997334.437797:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997334.437836:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689b1008000 x1867507127057408 msgsize 224 00000100:00100000:3.0:1780997334.437841:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997334.437858:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689adb8ad80 x1867507127057408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997350 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997334.437871:0:3496:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7702 usecs (8 jiffies) 00000100:00100000:0.0:1780997334.438529:0:85815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127057408 00000100:00100000:0.0:1780997334.438537:0:85815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127057408 00000020:00000040:0.0:1780997334.438540:0:85815:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b55a 00000020:00000040:0.0:1780997334.438543:0:85815:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968886bcb000 refcount=5 00000020:00000040:0.0:1780997334.438556:0:85815:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:0.0:1780997334.438586:0:85815:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1780997334.438613:0:85815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00000040:0.0:1780997334.438618:0:85815:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968886bcb000 : new rpc_count 1 00000100:00000040:0.0:1780997334.438624:0:85815:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b1008000 x1867507127057408/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:665/0 lens 224/0 e 0 to 0 dl 1780997345 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997334.438638:0:85815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127057408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780997334.438667:0:85815:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:0.0:1780997334.438687:0:85815:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1867507127057408 00000100:00000040:0.0:1780997334.438705:0:85815:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:0.0:1780997334.438710:0:85815:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997334.438734:0:85815:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9689adb8ad80 x1867507127057408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997350 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997334.438761:0:85815:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:0.0:1780997334.438766:0:85815:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b1008000 x1867507127057408/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:665/0 lens 224/368 e 0 to 0 dl 1780997345 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997334.438775:0:85815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127057408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997334.438781:0:85815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000100:00000040:0.0:1780997334.438784:0:85815:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968886bcb000 : new rpc_count 0 00000100:00000040:3.0:1780997334.438790:0:3496:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000020:00000040:0.0:1780997334.438793:0:85815:0:(genops.c:900:class_export_put()) PUTting export ffff968886bcb000 : new refcount 4 00000100:00000040:3.0:1780997334.438796:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689adb8ad80 x1867507127057408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1780997334.438806:0:3496:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:3.0:1780997334.438809:0:3496:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:3.0:1780997334.438817:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adb8ad80 x1867507127057408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997350 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997334.438825:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127057408:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1780997334.438838:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689adb8ad80 x1867507127057408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997350 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780997334.438848:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1780997334.438849:0:3496:0:(genops.c:1244:class_import_put()) import ffff968886bc8000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000020:00000040:1.0:1780997334.438852:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00010000:00010000:3.0:1780997334.757681:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1780997334.794716:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689bcbba850 x1867507110488576 msgsize 224 00000100:00100000:2.0:1780997334.794732:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:2.0:1780997334.794734:0:3489:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1780997334.794775:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689ad8c9180 x1867507110488832 msgsize 224 00000100:00100000:2.0:1780997334.794780:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:2.0:1780997334.794796:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689ad8c8380 x1867507110488704 msgsize 224 00000100:00100000:2.0:1780997334.794800:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00000040:2.0:1780997334.794820:0:3489:0:(events.c:343:request_in_callback()) incoming req@ffff9689ad8cb480 x1867507110488960 msgsize 224 00000100:00100000:2.0:1780997334.794824:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997334.795332:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110488576 00000100:00100000:0.0:1780997334.795342:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110488576 00000020:00000040:0.0:1780997334.795346:0:90250:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b47a 00000020:00000040:0.0:1780997334.795350:0:90250:0:(lustre_handles.c:131:class_handle2object()) GET export ffff96888a811000 refcount=9 00000100:00000040:0.0:1780997334.795376:0:90250:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780997334.795408:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 212 00000100:00000040:0.0:1780997334.795412:0:90250:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff96888a811000 : new rpc_count 1 00000100:00000040:0.0:1780997334.795421:0:90250:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bcbba850 x1867507110488576/t0(0) o400->cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp:665/0 lens 224/0 e 0 to 0 dl 1780997345 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997334.795435:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2397:x1867507110488576:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000040:0.0:1780997334.795456:0:90250:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507110488576 00000100:00000040:0.0:1780997334.795467:0:90250:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997334.795473:0:90250:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997334.795521:0:90250:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997334.795528:0:90250:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bcbba850 x1867507110488576/t0(0) o400->cf5d474c-5b3a-4e23-b534-5ea64925b132@192.168.206.51@tcp:665/0 lens 224/224 e 0 to 0 dl 1780997345 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997334.795548:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2397:x1867507110488576:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 115us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997334.795555:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 212 00000100:00000040:0.0:1780997334.795558:0:90250:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff96888a811000 : new rpc_count 0 00000020:00000040:0.0:1780997334.795568:0:90250:0:(genops.c:900:class_export_put()) PUTting export ffff96888a811000 : new refcount 8 00000100:00100000:0.0:1780997334.795595:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110488832 00000100:00100000:0.0:1780997334.795599:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110488832 00000020:00000040:0.0:1780997334.795600:0:80049:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305aafd 00000020:00000040:0.0:1780997334.795603:0:80049:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968994767800 refcount=51 00000020:00000040:0.0:1780997334.795614:0:80049:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9689ba680000) now 12 - evictor 00000100:00000040:0.0:1780997334.795626:0:80049:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1780997334.795641:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110488704 00000100:00100000:0.0:1780997334.795643:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110488704 00000020:00000040:0.0:1780997334.795645:0:80049:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b4f1 00000020:00000040:0.0:1780997334.795647:0:80049:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79cb000 refcount=11 00000020:00000040:0.0:1780997334.795653:0:80049:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff96888ac53380) now 16 - evictor 00000100:00100000:0.0:1780997334.795686:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1467 00000100:00000040:0.0:1780997334.795689:0:80049:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968994767800 : new rpc_count 1 00000100:00000040:0.0:1780997334.795694:0:80049:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689ad8c9180 x1867507110488832/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:665/0 lens 224/0 e 0 to 0 dl 1780997345 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997334.795705:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2397:x1867507110488832:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000040:0.0:1780997334.795719:0:80049:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 81604378913, transno 0, xid 1867507110488832 00000100:00000040:0.0:1780997334.795724:0:80049:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997334.795727:0:80049:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997334.795741:0:80049:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997334.795745:0:80049:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ad8c9180 x1867507110488832/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:665/0 lens 224/224 e 0 to 0 dl 1780997345 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997334.795764:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2397:x1867507110488832:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 60us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997334.795770:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1467 00000100:00000040:0.0:1780997334.795772:0:80049:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968994767800 : new rpc_count 0 00000020:00000040:0.0:1780997334.795778:0:80049:0:(genops.c:900:class_export_put()) PUTting export ffff968994767800 : new refcount 50 00000100:00100000:0.0:1780997334.795787:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1468 00000100:00000040:0.0:1780997334.795790:0:80049:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689b79cb000 : new rpc_count 1 00000100:00000040:0.0:1780997334.795794:0:80049:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689ad8c8380 x1867507110488704/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:665/0 lens 224/0 e 0 to 0 dl 1780997345 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997334.795804:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2397:x1867507110488704:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000040:0.0:1780997334.795815:0:80049:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 120259084292, transno 0, xid 1867507110488704 00000100:00000040:0.0:1780997334.795820:0:80049:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997334.795823:0:80049:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:0.0:1780997334.795856:0:80049:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00000100:00000040:0.0:1780997334.795862:0:80049:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ad8c8380 x1867507110488704/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:665/0 lens 224/224 e 0 to 0 dl 1780997345 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997334.795870:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2397:x1867507110488704:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 68us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997334.795876:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1468 00000100:00000040:0.0:1780997334.795878:0:80049:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689b79cb000 : new rpc_count 0 00000020:00000040:0.0:1780997334.795885:0:80049:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79cb000 : new refcount 10 00000100:00100000:1.0:1780997334.796717:0:8230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110488960 00000100:00100000:1.0:1780997334.796725:0:8230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110488960 00000020:00000040:1.0:1780997334.796727:0:8230:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b89b 00000020:00000040:1.0:1780997334.796730:0:8230:0:(lustre_handles.c:131:class_handle2object()) GET export ffff96888b414800 refcount=7 00000020:00000040:1.0:1780997334.796749:0:8230:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00100000:1.0:1780997334.796792:0:8230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2730 00000100:00000040:1.0:1780997334.796795:0:8230:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff96888b414800 : new rpc_count 1 00000100:00000040:1.0:1780997334.796800:0:8230:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689ad8cb480 x1867507110488960/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:665/0 lens 224/0 e 0 to 0 dl 1780997345 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997334.796811:0:8230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2397:x1867507110488960:12345-192.168.206.51@tcp:400:kworker.0 00010000:00000040:1.0:1780997334.796825:0:8230:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507110488960 00000100:00000040:1.0:1780997334.796952:0:8230:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff968885c88580 refcount 11 to 192.168.206.51@tcp 00000100:00000040:1.0:1780997334.796958:0:8230:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.206.51@tcp 00000100:00000040:1.0:1780997334.796996:0:8230:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff968885c88580 refcount 10 to 192.168.206.51@tcp 00000100:00000040:1.0:1780997334.797001:0:8230:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ad8cb480 x1867507110488960/t0(0) o400->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:665/0 lens 224/224 e 0 to 0 dl 1780997345 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997334.797009:0:8230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2397:x1867507110488960:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 200us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997334.797016:0:8230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2730 00000100:00000040:1.0:1780997334.797019:0:8230:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff96888b414800 : new rpc_count 0 00000020:00000040:1.0:1780997334.797026:0:8230:0:(genops.c:900:class_export_put()) PUTting export ffff96888b414800 : new refcount 6 00000100:00080000:1.0:1780997334.797041:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1780997334.797045:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00080000:1.0:1780997334.797048:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1780997334.797050:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff96888ac53380) now 16 - evictor 00000100:00080000:1.0:1780997334.797052:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1780997334.797054:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9689ba680000) now 12 - evictor 00000020:00000040:3.0:1780997335.461370:0:72375:0:(genops.c:1231:class_import_get()) import ffff9689a69f7000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1780997335.461414:0:72375:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000087efb803] to pc [ptlrpcd_00_01+1] req@ffff9689b100b480 x1867507127057536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.461464:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:3.0:1780997335.461480:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689b100b480 x1867507127057536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.461492:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689b100b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127057536:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1780997335.461522:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689b100b480 x1867507127057536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997351 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.461531:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997335.462159:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689ba2e0700 x1867507127057536 msgsize 224 00000100:00100000:3.0:1780997335.462166:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997335.462198:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689b100b480 x1867507127057536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997351 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.462212:0:3496:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5853 usecs (6 jiffies) 00000100:00100000:1.0:1780997335.462414:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127057536 00000100:00100000:1.0:1780997335.462425:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127057536 00000020:00000040:1.0:1780997335.462427:0:8234:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c030553a7 00000020:00000040:1.0:1780997335.462432:0:8234:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689ae564000 refcount=5 00000020:00000040:1.0:1780997335.462446:0:8234:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:1.0:1780997335.462564:0:8234:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1780997335.462590:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00000040:1.0:1780997335.462594:0:8234:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689ae564000 : new rpc_count 1 00000100:00000040:1.0:1780997335.462600:0:8234:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689ba2e0700 x1867507127057536/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:666/0 lens 224/0 e 0 to 0 dl 1780997346 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997335.462612:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127057536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780997335.462642:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1780997335.462652:0:8234:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1867507127057536 00000100:00000040:1.0:1780997335.462662:0:8234:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:1.0:1780997335.462675:0:8234:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00080000:2.0:1780997335.462697:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00000040:1.0:1780997335.462701:0:8234:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9689b100b480 x1867507127057536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780997335.462702:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00000040:1.0:1780997335.462720:0:8234:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:1.0:1780997335.462725:0:8234:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e0700 x1867507127057536/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:666/0 lens 224/368 e 0 to 0 dl 1780997346 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997335.462733:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127057536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997335.462739:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00000040:1.0:1780997335.462742:0:8234:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689ae564000 : new rpc_count 0 00000100:00000040:2.0:1780997335.462744:0:3496:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:2.0:1780997335.462749:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689b100b480 x1867507127057536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997335.462751:0:8234:0:(genops.c:900:class_export_put()) PUTting export ffff9689ae564000 : new refcount 4 00000004:00000040:2.0:1780997335.462759:0:3496:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:2.0:1780997335.462762:0:3496:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:2.0:1780997335.462770:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b100b480 x1867507127057536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997351 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997335.462784:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689b100b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127057536:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1780997335.462791:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689b100b480 x1867507127057536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780997351 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780997335.462801:0:3496:0:(genops.c:1244:class_import_put()) import ffff9689a69f7000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:2.0:1780997335.785304:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1780997335.973369:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1780997335.973389:0:36:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000100:00000040:3.0:1780997335.973419:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS req@ffff9689ba2e2300 x1867507127057664/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780997335.973438:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b0fc76a5] to pc [ptlrpcd_00_02+2] req@ffff9689ba2e2300 x1867507127057664/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997335.973507:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689ba2e2300 x1867507127057664/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997335.973522:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127057664:0@lo:400:kworker.0 00000100:00000040:0.0:1780997335.973566:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689ba2e2300 x1867507127057664/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997335.973575:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997335.973620:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689bcbb9850 x1867507127057664 msgsize 224 00000100:00100000:0.0:1780997335.973625:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997335.973627:0:3498:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1780997335.973656:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689ba2e2300 x1867507127057664/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997335.973732:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127057664 00000100:00100000:1.0:1780997335.973740:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127057664 00000020:00000040:1.0:1780997335.973743:0:90245:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:1.0:1780997335.973746:0:90245:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=23 00000100:00000040:1.0:1780997335.973769:0:90245:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1780997335.973799:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00000040:1.0:1780997335.973803:0:90245:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:1.0:1780997335.973809:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bcbb9850 x1867507127057664/t0(0) o400->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:666/0 lens 224/0 e 0 to 0 dl 1780997346 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997335.973830:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507127057664:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780997335.973847:0:90245:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127057664 00000100:00000040:1.0:1780997335.973857:0:90245:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:1.0:1780997335.973862:0:90245:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997335.973880:0:90245:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689ba2e2300 x1867507127057664/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.976731:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1780997335.976759:0:36:0:(genops.c:1231:class_import_get()) import ffff9689bcdfb800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1780997335.976787:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9689ba2e1c00 x1867507127057792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780997335.976807:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000273367fa] to pc [ptlrpcd_00_03+3] req@ffff9689ba2e1c00 x1867507127057792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997335.978402:0:90245:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:1.0:1780997335.978417:0:90245:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bcbb9850 x1867507127057664/t0(0) o400->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:666/0 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997335.978428:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3498:x1867507127057664:12345-0@lo:400:kworker.0 Request processed in 4601us (4805us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997335.978439:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00000040:1.0:1780997335.978443:0:90245:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:1.0:1780997335.978457:0:90245:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 22 00000100:00000040:3.0:1780997335.979052:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1780997335.979065:0:36:0:(genops.c:1231:class_import_get()) import ffff968885ce2000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1780997335.979083:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9689ba2e0000 x1867507127057920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780997335.979099:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007759ce06] to pc [ptlrpcd_00_00+0] req@ffff9689ba2e0000 x1867507127057920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997335.979178:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689ba2e0000 x1867507127057920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997335.979192:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507127057920:0@lo:400:kworker.0 00000100:00000040:1.0:1780997335.979216:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689ba2e0000 x1867507127057920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997335.979225:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997335.979261:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689b11e4000 x1867507127057920 msgsize 224 00000100:00100000:1.0:1780997335.979265:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997335.979306:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689ba2e0000 x1867507127057920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997335.979318:0:3496:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7825 usecs (8 jiffies) 00000100:00000040:3.0:1780997335.979371:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1780997335.979379:0:36:0:(genops.c:1231:class_import_get()) import ffff9689ae566000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1780997335.979390:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9689ba2e3b80 x1867507127058048/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780997335.979400:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ece507ad] to pc [ptlrpcd_00_01+1] req@ffff9689ba2e3b80 x1867507127058048/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997335.981497:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689ba2e2300 x1867507127057664/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997335.981512:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e2300 x1867507127057664/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997335.981520:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3498:1867507127057664:0@lo:400:kworker.0 00000100:00000040:0.0:1780997335.981528:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689ba2e2300 x1867507127057664/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997335.981539:0:3498:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000100:00100000:0.0:1780997335.981555:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:0.0:1780997335.981562:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689ba2e1c00 x1867507127057792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997335.981574:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507127057792:0@lo:400:kworker.0 00000100:00000040:0.0:1780997335.981600:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689ba2e1c00 x1867507127057792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997335.981608:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997335.981641:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689adb88380 x1867507127057792 msgsize 224 00000100:00100000:0.0:1780997335.981646:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997335.981681:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689ba2e1c00 x1867507127057792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997335.981708:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8538 usecs (9 jiffies) 00000100:00100000:0.0:1780997335.981741:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127057920 00000100:00100000:0.0:1780997335.981748:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127057920 00000020:00000040:0.0:1780997335.981751:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305541e 00000020:00000040:0.0:1780997335.981754:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968983335800 refcount=5 00000020:00000040:0.0:1780997335.981772:0:63417:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9689ba680000) now 12 - evictor 00000100:00000040:0.0:1780997335.981798:0:63417:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1780997335.981823:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127057792 00000100:00100000:0.0:1780997335.981826:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127057792 00000020:00000040:0.0:1780997335.981828:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b687 00000020:00000040:0.0:1780997335.981831:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bfa9f000 refcount=5 00000020:00000040:0.0:1780997335.981837:0:63417:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff96888ac53380) now 16 - evictor 00000100:00100000:0.0:1780997335.981857:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00000040:0.0:1780997335.981862:0:63417:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968983335800 : new rpc_count 1 00000100:00000040:0.0:1780997335.981867:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b11e4000 x1867507127057920/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:666/0 lens 224/0 e 0 to 0 dl 1780997346 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997335.981880:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507127057920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997335.981993:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:1.0:1780997335.982001:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689ba2e3b80 x1867507127058048/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997335.982011:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127058048:0@lo:400:kworker.0 00000100:00000040:1.0:1780997335.982028:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689ba2e3b80 x1867507127058048/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997335.982035:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780997335.982052:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689b11e6a00 x1867507127058048 msgsize 224 00000100:00100000:1.0:1780997335.982056:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780997335.982071:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689ba2e3b80 x1867507127058048/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997335.982080:0:3496:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 945122 usecs (946 jiffies) 00000100:00100000:1.0:1780997335.982101:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00000040:1.0:1780997335.982104:0:63419:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bfa9f000 : new rpc_count 1 00000100:00000040:1.0:1780997335.982109:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689adb88380 x1867507127057792/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:666/0 lens 224/0 e 0 to 0 dl 1780997346 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997335.982122:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507127057792:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780997335.982139:0:63419:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127057792 00000100:00000040:1.0:1780997335.982149:0:63419:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:1.0:1780997335.982154:0:63419:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00000040:0.0:1780997335.982321:0:63417:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127057920 00000100:00000040:0.0:1780997335.982327:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 67 to 0@lo 00000100:00000040:0.0:1780997335.982331:0:63417:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00080000:3.0:1780997335.988314:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997335.988323:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:3.0:1780997335.988327:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1780997335.988338:0:36:0:(genops.c:1231:class_import_get()) import ffff96888b416000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1780997335.988366:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9689ba2e1f80 x1867507127058176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780997335.988398:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006994fc02] to pc [ptlrpcd_00_02+2] req@ffff9689ba2e1f80 x1867507127058176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.988417:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1780997335.988423:0:36:0:(genops.c:1231:class_import_get()) import ffff9689869cf800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1780997335.988433:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff9689ba2e1180 x1867507127058304/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780997335.988441:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ff3618cd] to pc [ptlrpcd_00_03+3] req@ffff9689ba2e1180 x1867507127058304/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780997335.988448:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780997335.988451:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:3.0:1780997335.988454:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1780997335.988460:0:36:0:(genops.c:1231:class_import_get()) import ffff968886bc8000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1780997335.988466:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9689ba2e2300 x1867507127058432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780997335.988474:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b0fc76a5] to pc [ptlrpcd_00_00+0] req@ffff9689ba2e2300 x1867507127058432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.988484:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1780997335.988491:0:36:0:(genops.c:1231:class_import_get()) import ffff96898616b000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1780997335.988498:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff968888607480 x1867507127058560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780997335.988506:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000da7db8cd] to pc [ptlrpcd_00_01+1] req@ffff968888607480 x1867507127058560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.988524:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1780997335.988529:0:36:0:(genops.c:1231:class_import_get()) import ffff9689ad6ca000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1780997335.988538:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff968888606d80 x1867507127058688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780997335.988547:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006a2fb125] to pc [ptlrpcd_00_02+2] req@ffff968888606d80 x1867507127058688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.988554:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1780997335.988558:0:36:0:(genops.c:1231:class_import_get()) import ffff9689bcc14800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:3.0:1780997335.988564:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff968888606a00 x1867507127058816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780997335.988572:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c06c10ff] to pc [ptlrpcd_00_03+3] req@ffff968888606a00 x1867507127058816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.988581:0:36:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 1 (3868) 00000100:00000040:3.0:1780997335.988608:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689ba2e1180 x1867507127058304/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.988620:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127058304:0@lo:400:kworker.0 00000100:00000040:3.0:1780997335.988645:0:3499:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689ba2e1180 x1867507127058304/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.988654:0:3499:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997335.988686:0:3499:0:(events.c:343:request_in_callback()) incoming req@ffff968888604000 x1867507127058304 msgsize 224 00000100:00100000:3.0:1780997335.988690:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997335.988715:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689ba2e1180 x1867507127058304/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.988727:0:3499:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 7853 usecs (8 jiffies) 00000100:00000040:3.0:1780997335.988742:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff968888606a00 x1867507127058816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.988751:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507127058816:0@lo:400:kworker.0 00000100:00000040:3.0:1780997335.988769:0:3499:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff968888606a00 x1867507127058816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.988775:0:3499:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997335.988790:0:3499:0:(events.c:343:request_in_callback()) incoming req@ffff968888604380 x1867507127058816 msgsize 224 00000100:00100000:3.0:1780997335.988793:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997335.988808:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff968888606a00 x1867507127058816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.988817:0:3499:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 7843 usecs (8 jiffies) 00000100:00100000:3.0:1780997335.988829:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00000040:3.0:1780997335.988833:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689ba2e1f80 x1867507127058176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.988840:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507127058176:0@lo:400:kworker.0 00000100:00000040:3.0:1780997335.988851:0:3499:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689ba2e1f80 x1867507127058176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.988856:0:3499:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997335.988867:0:3499:0:(events.c:343:request_in_callback()) incoming req@ffff968888607800 x1867507127058176 msgsize 224 00000100:00100000:3.0:1780997335.988870:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997335.988901:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689ba2e1f80 x1867507127058176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.988911:0:3499:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 137087 usecs (138 jiffies) 00000100:00000040:3.0:1780997335.988916:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff968888606d80 x1867507127058688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.988925:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507127058688:0@lo:400:kworker.0 00000100:00000040:3.0:1780997335.988936:0:3499:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff968888606d80 x1867507127058688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.988947:0:3499:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997335.988961:0:3499:0:(events.c:343:request_in_callback()) incoming req@ffff968888604e00 x1867507127058688 msgsize 224 00000100:00100000:3.0:1780997335.988964:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997335.988971:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff968888606d80 x1867507127058688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.988978:0:3499:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 17797 usecs (18 jiffies) 00000100:00000040:3.0:1780997335.988995:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff968888607480 x1867507127058560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.989004:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507127058560:0@lo:400:kworker.0 00000100:00000040:3.0:1780997335.989016:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff968888607480 x1867507127058560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.989023:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997335.989034:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff968888604a80 x1867507127058560 msgsize 224 00000100:00100000:3.0:1780997335.989038:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997335.989045:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff968888607480 x1867507127058560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.989055:0:3497:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8106 usecs (9 jiffies) 00000100:00100000:3.0:1780997335.989062:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:3.0:1780997335.989067:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689ba2e2300 x1867507127058432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.989075:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127058432:0@lo:400:kworker.0 00000100:00000040:3.0:1780997335.989088:0:3497:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689ba2e2300 x1867507127058432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.989094:0:3497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997335.989111:0:3497:0:(events.c:343:request_in_callback()) incoming req@ffff968888607b80 x1867507127058432 msgsize 224 00000100:00100000:3.0:1780997335.989116:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780997335.989129:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689ba2e2300 x1867507127058432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997351 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.989145:0:3497:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7503 usecs (8 jiffies) 00000100:00100000:3.0:1780997335.989260:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127058048 00000100:00100000:3.0:1780997335.989268:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127058048 00000020:00000040:3.0:1780997335.989290:0:8242:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b4ea 00000020:00000040:3.0:1780997335.989293:0:8242:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79c9000 refcount=7 00000100:00000040:3.0:1780997335.989315:0:8242:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1780997335.989339:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127058304 00000100:00100000:3.0:1780997335.989342:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127058304 00000020:00000040:3.0:1780997335.989344:0:8242:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b530 00000020:00000040:3.0:1780997335.989346:0:8242:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968889698800 refcount=5 00000100:00100000:3.0:1780997335.989370:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4158 00000100:00000040:3.0:1780997335.989374:0:8242:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689b79c9000 : new rpc_count 1 00000100:00000040:3.0:1780997335.989380:0:8242:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689b11e6a00 x1867507127058048/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:666/0 lens 224/0 e 0 to 0 dl 1780997346 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.989392:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127058048:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997335.989413:0:8242:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1867507127058048 00000100:00000040:3.0:1780997335.989423:0:8242:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 68 to 0@lo 00000100:00000040:3.0:1780997335.989428:0:8242:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997335.989447:0:8242:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689ba2e3b80 x1867507127058048/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.989462:0:8242:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 67 to 0@lo 00000100:00000040:3.0:1780997335.989466:0:8242:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b11e6a00 x1867507127058048/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:666/0 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.989474:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127058048:12345-0@lo:400:kworker.0 Request processed in 84us (7419us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997335.989480:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4158 00000100:00000040:3.0:1780997335.989483:0:8242:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689b79c9000 : new rpc_count 0 00000020:00000040:3.0:1780997335.989497:0:8242:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79c9000 : new refcount 6 00000100:00100000:3.0:1780997335.989507:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4159 00000100:00000040:3.0:1780997335.989509:0:8242:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968889698800 : new rpc_count 1 00000100:00000040:3.0:1780997335.989513:0:8242:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968888604000 x1867507127058304/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:666/0 lens 224/0 e 0 to 0 dl 1780997346 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.989522:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127058304:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997335.989534:0:8242:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127058304 00000100:00000040:3.0:1780997335.989541:0:8242:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 68 to 0@lo 00000100:00000040:3.0:1780997335.989544:0:8242:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997335.989558:0:8242:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689ba2e1180 x1867507127058304/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.989574:0:8242:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 67 to 0@lo 00000100:00000040:3.0:1780997335.989577:0:8242:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968888604000 x1867507127058304/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:666/0 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.989585:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127058304:12345-0@lo:400:kworker.0 Request processed in 63us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997335.989590:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4159 00000100:00000040:3.0:1780997335.989593:0:8242:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968889698800 : new rpc_count 0 00000020:00000040:3.0:1780997335.989599:0:8242:0:(genops.c:900:class_export_put()) PUTting export ffff968889698800 : new refcount 4 00000100:00100000:3.0:1780997335.989616:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127058816 00000100:00100000:3.0:1780997335.989620:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127058816 00000020:00000040:3.0:1780997335.989621:0:65272:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c4cd 00000020:00000040:3.0:1780997335.989624:0:65272:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc96b000 refcount=5 00000100:00100000:3.0:1780997335.989647:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127058176 00000100:00100000:3.0:1780997335.989650:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127058176 00000020:00000040:3.0:1780997335.989651:0:65272:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b68e 00000020:00000040:3.0:1780997335.989654:0:65272:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968986145800 refcount=5 00000100:00100000:3.0:1780997335.989676:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127058688 00000100:00100000:3.0:1780997335.989679:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127058688 00000020:00000040:3.0:1780997335.989687:0:65272:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c4b8 00000020:00000040:3.0:1780997335.989689:0:65272:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc96a800 refcount=5 00000100:00100000:3.0:1780997335.989709:0:65272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127058560 00000100:00100000:3.0:1780997335.989712:0:65272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127058560 00000020:00000040:3.0:1780997335.989714:0:65272:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b695 00000020:00000040:3.0:1780997335.989716:0:65272:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968983331000 refcount=5 00000100:00100000:3.0:1780997335.989729:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00000040:3.0:1780997335.989731:0:65272:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc96b000 : new rpc_count 1 00000100:00000040:3.0:1780997335.989735:0:65272:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968888604380 x1867507127058816/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:666/0 lens 224/0 e 0 to 0 dl 1780997346 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.989745:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507127058816:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997335.989755:0:65272:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127058816 00000100:00000040:3.0:1780997335.989760:0:65272:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 68 to 0@lo 00000100:00000040:3.0:1780997335.989763:0:65272:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997335.989779:0:65272:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff968888606a00 x1867507127058816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.989790:0:65272:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 67 to 0@lo 00000100:00000040:3.0:1780997335.989794:0:65272:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968888604380 x1867507127058816/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:666/0 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.989801:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3499:x1867507127058816:12345-0@lo:400:kworker.0 Request processed in 58us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997335.989807:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00000040:3.0:1780997335.989810:0:65272:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc96b000 : new rpc_count 0 00000020:00000040:3.0:1780997335.989815:0:65272:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc96b000 : new refcount 4 00000100:00100000:3.0:1780997335.989824:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00000040:3.0:1780997335.989826:0:65272:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968986145800 : new rpc_count 1 00000100:00000040:3.0:1780997335.989829:0:65272:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968888607800 x1867507127058176/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:666/0 lens 224/0 e 0 to 0 dl 1780997346 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.989851:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507127058176:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997335.989860:0:65272:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127058176 00000100:00000040:3.0:1780997335.989865:0:65272:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 68 to 0@lo 00000100:00000040:3.0:1780997335.989868:0:65272:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997335.989884:0:65272:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689ba2e1f80 x1867507127058176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.989895:0:65272:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 67 to 0@lo 00000100:00000040:3.0:1780997335.989900:0:65272:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968888607800 x1867507127058176/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:666/0 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.989907:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507127058176:12345-0@lo:400:kworker.0 Request processed in 59us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997335.989912:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00000040:3.0:1780997335.989914:0:65272:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968986145800 : new rpc_count 0 00000020:00000040:3.0:1780997335.989920:0:65272:0:(genops.c:900:class_export_put()) PUTting export ffff968986145800 : new refcount 4 00000100:00100000:3.0:1780997335.989928:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00000040:3.0:1780997335.989931:0:65272:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc96a800 : new rpc_count 1 00000100:00000040:3.0:1780997335.989934:0:65272:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968888604e00 x1867507127058688/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:666/0 lens 224/0 e 0 to 0 dl 1780997346 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.989943:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507127058688:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997335.989951:0:65272:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127058688 00000100:00000040:3.0:1780997335.989956:0:65272:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 68 to 0@lo 00000100:00000040:3.0:1780997335.989958:0:65272:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997335.989971:0:65272:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff968888606d80 x1867507127058688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.989982:0:65272:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 67 to 0@lo 00000100:00000040:3.0:1780997335.989994:0:65272:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968888604e00 x1867507127058688/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:666/0 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.990002:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507127058688:12345-0@lo:400:kworker.0 Request processed in 60us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997335.990008:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00000040:3.0:1780997335.990010:0:65272:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc96a800 : new rpc_count 0 00000020:00000040:3.0:1780997335.990016:0:65272:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc96a800 : new refcount 4 00000100:00100000:3.0:1780997335.990025:0:65272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00000040:3.0:1780997335.990027:0:65272:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968983331000 : new rpc_count 1 00000100:00000040:3.0:1780997335.990031:0:65272:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968888604a80 x1867507127058560/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:666/0 lens 224/0 e 0 to 0 dl 1780997346 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.990040:0:65272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507127058560:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997335.990050:0:65272:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127058560 00000100:00000040:3.0:1780997335.990054:0:65272:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 68 to 0@lo 00000100:00000040:3.0:1780997335.990057:0:65272:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997335.990071:0:65272:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff968888607480 x1867507127058560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.990088:0:65272:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 67 to 0@lo 00000100:00000040:3.0:1780997335.990092:0:65272:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968888604a80 x1867507127058560/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:666/0 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.990099:0:65272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3497:x1867507127058560:12345-0@lo:400:kworker.0 Request processed in 60us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997335.990105:0:65272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00000040:3.0:1780997335.990107:0:65272:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968983331000 : new rpc_count 0 00000020:00000040:3.0:1780997335.990112:0:65272:0:(genops.c:900:class_export_put()) PUTting export ffff968983331000 : new refcount 4 00000100:00000040:3.0:1780997335.990155:0:3497:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1780997335.990161:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff968888607480 x1867507127058560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.990176:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968888607480 x1867507127058560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.990183:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3497:1867507127058560:0@lo:400:kworker.0 00000100:00000040:3.0:1780997335.990190:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff968888607480 x1867507127058560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997335.990200:0:3497:0:(genops.c:1244:class_import_put()) import ffff96898616b000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1780997335.990228:0:3496:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:3.0:1780997335.990233:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689ba2e3b80 x1867507127058048/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.990241:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e3b80 x1867507127058048/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.990246:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127058048:0@lo:400:kworker.0 00000100:00000040:0.0:1780997335.990582:0:63417:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689ba2e0000 x1867507127057920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997335.990603:0:63417:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:0.0:1780997335.990609:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689b11e4000 x1867507127057920/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:666/0 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997335.990616:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507127057920:12345-0@lo:400:kworker.0 Request processed in 8739us (11354us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997335.990623:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00000040:0.0:1780997335.990632:0:63417:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968983335800 : new rpc_count 0 00000020:00000040:0.0:1780997335.990640:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff968983335800 : new refcount 4 00000100:00080000:0.0:1780997335.990659:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1780997335.990674:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff96888ac53380) now 16 - evictor 00000100:00080000:0.0:1780997335.990677:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1780997335.990679:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9689ba680000) now 12 - evictor 00000100:00100000:0.0:1780997335.990702:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127058432 00000100:00100000:0.0:1780997335.990707:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127058432 00000020:00000040:0.0:1780997335.990709:0:25179:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b55a 00000020:00000040:0.0:1780997335.990712:0:25179:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968886bcb000 refcount=5 00000100:00100000:0.0:1780997335.990744:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00000040:0.0:1780997335.990746:0:25179:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968886bcb000 : new rpc_count 1 00000100:00000040:0.0:1780997335.990750:0:25179:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff968888607b80 x1867507127058432/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:666/0 lens 224/0 e 0 to 0 dl 1780997346 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997335.990759:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127058432:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780997335.990771:0:25179:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1867507127058432 00000100:00000040:0.0:1780997335.990775:0:25179:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 67 to 0@lo 00000100:00000040:0.0:1780997335.990779:0:25179:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997335.990799:0:25179:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689ba2e2300 x1867507127058432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997335.990817:0:25179:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:0.0:1780997335.990821:0:25179:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968888607b80 x1867507127058432/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:666/0 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997335.990828:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127058432:12345-0@lo:400:kworker.0 Request processed in 70us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997335.990834:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000100:00000040:0.0:1780997335.990836:0:25179:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968886bcb000 : new rpc_count 0 00000020:00000040:0.0:1780997335.990840:0:25179:0:(genops.c:900:class_export_put()) PUTting export ffff968886bcb000 : new refcount 4 00000100:00000040:0.0:1780997335.990873:0:3497:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:0.0:1780997335.990879:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689ba2e2300 x1867507127058432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997335.990953:0:3497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e2300 x1867507127058432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997335.990962:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127058432:0@lo:400:kworker.0 00000100:00000040:0.0:1780997335.990968:0:3497:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689ba2e2300 x1867507127058432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997335.990976:0:3497:0:(genops.c:1244:class_import_put()) import ffff968886bc8000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1780997335.991256:0:3496:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1780997335.991262:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689ba2e0000 x1867507127057920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997335.991370:0:63419:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689ba2e1c00 x1867507127057792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997335.991391:0:63419:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:1.0:1780997335.991396:0:63419:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adb88380 x1867507127057792/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:666/0 lens 224/224 e 0 to 0 dl 1780997346 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997335.991404:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3498:x1867507127057792:12345-0@lo:400:kworker.0 Request processed in 9286us (9762us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997335.991420:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00000040:1.0:1780997335.991422:0:63419:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bfa9f000 : new rpc_count 0 00000020:00000040:1.0:1780997335.991430:0:63419:0:(genops.c:900:class_export_put()) PUTting export ffff9689bfa9f000 : new refcount 4 00000100:00000040:1.0:1780997335.991454:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1780997335.991460:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689ba2e1c00 x1867507127057792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780997335.991468:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e1c00 x1867507127057792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997335.991475:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3498:1867507127057792:0@lo:400:kworker.0 00000100:00000040:1.0:1780997335.991481:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689ba2e1c00 x1867507127057792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780997335.991489:0:3498:0:(genops.c:1244:class_import_put()) import ffff9689bcdfb800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1780997335.991578:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e0000 x1867507127057920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.991585:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507127057920:0@lo:400:kworker.0 00000100:00000040:3.0:1780997335.991593:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689ba2e3b80 x1867507127058048/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997335.991602:0:3496:0:(genops.c:1244:class_import_put()) import ffff9689ae566000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1780997335.991607:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689ba2e0000 x1867507127057920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997335.991625:0:3496:0:(genops.c:1244:class_import_put()) import ffff968885ce2000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1780997335.991650:0:3499:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:3.0:1780997335.991655:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689ba2e1f80 x1867507127058176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.991673:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e1f80 x1867507127058176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.991680:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507127058176:0@lo:400:kworker.0 00000100:00000040:3.0:1780997335.991692:0:3499:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:3.0:1780997335.991696:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff968888606d80 x1867507127058688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.991705:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968888606d80 x1867507127058688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.991711:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507127058688:0@lo:400:kworker.0 00000100:00000040:3.0:1780997335.991721:0:3499:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1780997335.991724:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689ba2e1180 x1867507127058304/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.991731:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e1180 x1867507127058304/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.991738:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127058304:0@lo:400:kworker.0 00000100:00000040:3.0:1780997335.991748:0:3499:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:3.0:1780997335.991752:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff968888606a00 x1867507127058816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997335.991759:0:3499:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff968888606a00 x1867507127058816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997335.991772:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3499:1867507127058816:0@lo:400:kworker.0 00000100:00000040:3.0:1780997335.991778:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689ba2e1f80 x1867507127058176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997335.991785:0:3499:0:(genops.c:1244:class_import_put()) import ffff96888b416000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1780997335.991790:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff968888606d80 x1867507127058688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997335.991797:0:3499:0:(genops.c:1244:class_import_put()) import ffff9689ad6ca000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1780997335.991802:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689ba2e1180 x1867507127058304/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997335.991808:0:3499:0:(genops.c:1244:class_import_put()) import ffff9689869cf800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1780997335.991811:0:3499:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff968888606a00 x1867507127058816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997351 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997335.991817:0:3499:0:(genops.c:1244:class_import_put()) import ffff9689bcc14800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000001:00080000:2.0:1780997336.488528:0:92687:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969517 is committed 00000001:00000040:2.0:1780997336.488536:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 39 00000020:00000040:2.0:1780997336.488540:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 43 00000001:00000040:2.0:1780997336.488547:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 38 00000020:00000040:2.0:1780997336.488549:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 42 00000001:00000040:2.0:1780997336.488553:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 37 00000020:00000040:2.0:1780997336.488555:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 41 00000001:00000040:2.0:1780997336.488561:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 36 00000020:00000040:2.0:1780997336.488563:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 40 00000001:00000040:2.0:1780997336.488567:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 35 00000020:00000040:2.0:1780997336.488569:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 39 00000001:00000040:2.0:1780997336.488573:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 34 00000020:00000040:2.0:1780997336.488575:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 38 00000001:00000040:2.0:1780997336.488579:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 33 00000020:00000040:2.0:1780997336.488580:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 37 00000001:00000040:2.0:1780997336.488595:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 32 00000020:00000040:2.0:1780997336.488597:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 36 00000001:00000040:2.0:1780997336.488600:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 31 00000020:00000040:2.0:1780997336.488602:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 35 00000001:00000040:2.0:1780997336.488605:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 30 00000020:00000040:2.0:1780997336.488606:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 34 00000001:00000040:2.0:1780997336.488613:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 29 00000020:00000040:2.0:1780997336.488731:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 33 00000001:00000040:2.0:1780997336.488739:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 28 00000020:00000040:2.0:1780997336.488741:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 32 00000001:00000040:2.0:1780997336.488746:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 27 00000020:00000040:2.0:1780997336.488747:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 31 00000001:00000040:2.0:1780997336.488751:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 26 00000020:00000040:2.0:1780997336.488753:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 30 00000001:00000040:2.0:1780997336.488757:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 25 00000020:00000040:2.0:1780997336.488758:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 29 00000001:00000040:2.0:1780997336.488762:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 24 00000020:00000040:2.0:1780997336.488764:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 28 00000001:00000040:2.0:1780997336.488768:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 23 00000020:00000040:2.0:1780997336.488769:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 27 00000001:00000040:2.0:1780997336.488773:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 22 00000020:00000040:2.0:1780997336.488775:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 26 00000001:00000040:2.0:1780997336.488778:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 21 00000020:00000040:2.0:1780997336.488780:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 25 00000001:00000040:2.0:1780997336.488784:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 20 00000020:00000040:2.0:1780997336.488786:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 24 00000001:00000040:2.0:1780997336.488790:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 19 00000020:00000040:2.0:1780997336.488791:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 23 00000001:00000040:2.0:1780997336.488794:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 18 00000020:00000040:2.0:1780997336.488796:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 22 00000001:00000040:2.0:1780997336.488798:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 17 00000020:00000040:2.0:1780997336.488800:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 21 00000001:00000040:2.0:1780997336.488803:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 16 00000020:00000040:2.0:1780997336.488804:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 20 00000001:00000040:2.0:1780997336.488807:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 15 00000020:00000040:2.0:1780997336.488808:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 19 00000001:00000040:2.0:1780997336.488811:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 14 00000020:00000040:2.0:1780997336.488819:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 18 00000001:00000040:2.0:1780997336.488825:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 13 00000020:00000040:2.0:1780997336.488827:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 17 00000001:00000040:2.0:1780997336.488831:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 12 00000020:00000040:2.0:1780997336.488833:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 16 00000001:00000040:2.0:1780997336.488836:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 11 00000020:00000040:2.0:1780997336.488837:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 15 00000001:00000040:2.0:1780997336.488840:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 10 00000020:00000040:2.0:1780997336.488842:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 14 00000001:00000040:2.0:1780997336.488845:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 9 00000020:00000040:2.0:1780997336.488846:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 13 00000001:00000040:2.0:1780997336.488849:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 8 00000020:00000040:2.0:1780997336.488851:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 12 00000001:00000040:2.0:1780997336.488855:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 7 00000020:00000040:2.0:1780997336.488857:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 11 00000001:00000040:2.0:1780997336.488859:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 6 00000020:00000040:2.0:1780997336.488861:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 10 00000001:00000040:2.0:1780997336.488864:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 5 00000020:00000040:2.0:1780997336.488866:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 9 00000001:00000040:2.0:1780997336.488869:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 4 00000020:00000040:2.0:1780997336.488872:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 8 00000001:00000040:2.0:1780997336.488875:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 3 00000020:00000040:2.0:1780997336.488877:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 7 00000001:00000040:2.0:1780997336.488880:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 2 00000020:00000040:2.0:1780997336.488881:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 6 00000001:00000040:2.0:1780997336.488898:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 1 00000020:00000040:2.0:1780997336.488900:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 5 00000001:00000040:2.0:1780997336.488903:0:92687:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9689bc9e6000 : new cb_count 0 00000020:00000040:2.0:1780997336.488905:0:92687:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc9e6000 : new refcount 4 00010000:00010000:0.0:1780997336.807861:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1780997336.999162:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1780997336.999181:0:36:0:(genops.c:1231:class_import_get()) import ffff96898d0e6000 refcount=4 obd=MGC192.168.206.151@tcp 00000100:00000040:0.0:1780997336.999210:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging bdcd4e03-8d56-43b8-bfda-3b2f97e67d18->MGS req@ffff9689adb8b100 x1867507127058944/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997336.999231:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000050d9b6eb] to pc [ptlrpcd_00_00+0] req@ffff9689adb8b100 x1867507127058944/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999255:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1780997336.999262:0:36:0:(genops.c:1231:class_import_get()) import ffff9689bcdfb800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1780997336.999285:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9689adb8aa00 x1867507127059072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997336.999296:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006b911da3] to pc [ptlrpcd_00_01+1] req@ffff9689adb8aa00 x1867507127059072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999305:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1780997336.999310:0:36:0:(genops.c:1231:class_import_get()) import ffff968885ce2000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1780997336.999318:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9689adb89500 x1867507127059200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997336.999337:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000040797563] to pc [ptlrpcd_00_02+2] req@ffff9689adb89500 x1867507127059200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999360:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1780997336.999366:0:36:0:(genops.c:1231:class_import_get()) import ffff9689ae566000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1780997336.999376:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9689adb88e00 x1867507127059328/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997336.999385:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000047cdb0] to pc [ptlrpcd_00_03+3] req@ffff9689adb88e00 x1867507127059328/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997336.999394:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997336.999398:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:0.0:1780997336.999401:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1780997336.999405:0:36:0:(genops.c:1231:class_import_get()) import ffff9689a69f7000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1780997336.999414:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9689adb89180 x1867507127059456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997336.999424:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000029cb97cc] to pc [ptlrpcd_00_00+0] req@ffff9689adb89180 x1867507127059456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999432:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1780997336.999437:0:36:0:(genops.c:1231:class_import_get()) import ffff96888b416000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1780997336.999443:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9689adb88000 x1867507127059584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997336.999452:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009e7949ed] to pc [ptlrpcd_00_01+1] req@ffff9689adb88000 x1867507127059584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999471:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1780997336.999477:0:36:0:(genops.c:1231:class_import_get()) import ffff9689869cf800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1780997336.999486:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff9689adb8ad80 x1867507127059712/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997336.999495:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cf4ca83e] to pc [ptlrpcd_00_02+2] req@ffff9689adb8ad80 x1867507127059712/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780997336.999503:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997336.999506:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:0.0:1780997336.999509:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1780997336.999514:0:36:0:(genops.c:1231:class_import_get()) import ffff968886bc8000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1780997336.999522:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9689adb8a680 x1867507127059840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997336.999531:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003b5d176f] to pc [ptlrpcd_00_03+3] req@ffff9689adb8a680 x1867507127059840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999539:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1780997336.999544:0:36:0:(genops.c:1231:class_import_get()) import ffff96898616b000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1780997336.999552:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9689ba2e1180 x1867507127059968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997336.999562:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ff3618cd] to pc [ptlrpcd_00_00+0] req@ffff9689ba2e1180 x1867507127059968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999579:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1780997336.999585:0:36:0:(genops.c:1231:class_import_get()) import ffff9689ad6ca000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1780997336.999601:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff9689ba2e1f80 x1867507127060096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997336.999611:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006994fc02] to pc [ptlrpcd_00_01+1] req@ffff9689ba2e1f80 x1867507127060096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999618:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1780997336.999623:0:36:0:(genops.c:1231:class_import_get()) import ffff9689bcc14800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1780997336.999630:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff9689ba2e0000 x1867507127060224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1780997336.999640:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007759ce06] to pc [ptlrpcd_00_02+2] req@ffff9689ba2e0000 x1867507127060224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999650:0:36:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (3869) 00000100:00000040:0.0:1780997336.999712:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689adb8b100 x1867507127058944/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997336.999726:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127058944:0@lo:400:kworker.0 00000100:00000040:0.0:1780997336.999756:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689adb8b100 x1867507127058944/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997352 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999767:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997336.999814:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689bcbb9c50 x1867507127058944 msgsize 224 00000100:00100000:0.0:1780997336.999820:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997336.999822:0:3496:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1780997336.999843:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689adb8b100 x1867507127058944/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997352 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999870:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689adb89180 x1867507127059456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997336.999879:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127059456:0@lo:400:kworker.0 00000100:00000040:0.0:1780997336.999893:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689adb89180 x1867507127059456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997352 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999907:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997336.999924:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689ba2e3b80 x1867507127059456 msgsize 224 00000100:00100000:0.0:1780997336.999928:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997336.999946:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689adb89180 x1867507127059456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997352 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999956:0:3496:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5842 usecs (6 jiffies) 00000100:00000040:0.0:1780997336.999962:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689ba2e1180 x1867507127059968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997336.999970:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507127059968:0@lo:400:kworker.0 00000100:00000040:0.0:1780997336.999985:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689ba2e1180 x1867507127059968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997352 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997336.999990:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997337.000006:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689ba2e1c00 x1867507127059968 msgsize 224 00000100:00100000:0.0:1780997337.000011:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997337.000216:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127058944 00000100:00100000:2.0:1780997337.000231:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127058944 00000020:00000040:2.0:1780997337.000235:0:90246:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b481 00000020:00000040:2.0:1780997337.000239:0:90246:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968982cc7800 refcount=23 00000100:00000040:2.0:1780997337.000267:0:90246:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780997337.000319:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00000040:2.0:1780997337.000324:0:90246:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968982cc7800 : new rpc_count 1 00000100:00000040:2.0:1780997337.000330:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bcbb9c50 x1867507127058944/t0(0) o400->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:667/0 lens 224/0 e 0 to 0 dl 1780997347 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.000343:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507127058944:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1780997337.000365:0:90246:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127058944 00000100:00000040:2.0:1780997337.000378:0:90246:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:2.0:1780997337.000383:0:90246:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997337.000405:0:90246:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689adb8b100 x1867507127058944/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997352 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997337.000422:0:90246:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:2.0:1780997337.000427:0:90246:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bcbb9c50 x1867507127058944/t0(0) o400->bdcd4e03-8d56-43b8-bfda-3b2f97e67d18@0@lo:667/0 lens 224/224 e 0 to 0 dl 1780997347 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.000436:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3496:x1867507127058944:12345-0@lo:400:kworker.0 Request processed in 96us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997337.000443:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00000040:2.0:1780997337.000446:0:90246:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968982cc7800 : new rpc_count 0 00000020:00000040:2.0:1780997337.000458:0:90246:0:(genops.c:900:class_export_put()) PUTting export ffff968982cc7800 : new refcount 22 00000100:00000040:0.0:1780997337.000549:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689ba2e1180 x1867507127059968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997352 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.000565:0:3496:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 7701 usecs (8 jiffies) 00000100:00000040:0.0:1780997337.000689:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689adb8b100 x1867507127058944/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.000700:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adb8b100 x1867507127058944/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997352 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997337.000708:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3496:1867507127058944:0@lo:400:kworker.0 00000100:00000040:0.0:1780997337.000714:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689adb8b100 x1867507127058944/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780997352 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780997337.000725:0:3496:0:(genops.c:1244:class_import_put()) import ffff96898d0e6000 refcount=3 obd=MGC192.168.206.151@tcp 00000100:00100000:0.0:1780997337.000737:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00000040:0.0:1780997337.000751:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689adb8aa00 x1867507127059072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997337.000761:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507127059072:0@lo:400:kworker.0 00000100:00000040:0.0:1780997337.000779:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689adb8aa00 x1867507127059072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.000786:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997337.000802:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689ba2e2300 x1867507127059072 msgsize 224 00000100:00100000:0.0:1780997337.000806:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997337.000822:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689adb8aa00 x1867507127059072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.000831:0:3496:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8552 usecs (9 jiffies) 00000100:00000040:0.0:1780997337.000838:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689adb88000 x1867507127059584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997337.000846:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507127059584:0@lo:400:kworker.0 00000100:00000040:0.0:1780997337.000859:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689adb88000 x1867507127059584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.000865:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997337.000878:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689adb8b100 x1867507127059584 msgsize 224 00000100:00100000:0.0:1780997337.000882:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997337.000897:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689adb88000 x1867507127059584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.000906:0:3496:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 136441 usecs (137 jiffies) 00000100:00000040:0.0:1780997337.000912:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689ba2e1f80 x1867507127060096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997337.000920:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507127060096:0@lo:400:kworker.0 00000100:00000040:0.0:1780997337.000934:0:3496:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689ba2e1f80 x1867507127060096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.000952:0:3496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997337.000967:0:3496:0:(events.c:343:request_in_callback()) incoming req@ffff9689adeddc00 x1867507127060096 msgsize 224 00000100:00100000:0.0:1780997337.000971:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997337.000984:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689ba2e1f80 x1867507127060096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.000994:0:3496:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 10857 usecs (11 jiffies) 00000100:00000040:0.0:1780997337.001016:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689adb89500 x1867507127059200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997337.001026:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127059200:0@lo:400:kworker.0 00000100:00100000:2.0:1780997337.001129:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127059968 00000100:00100000:2.0:1780997337.001134:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127059968 00000020:00000040:2.0:1780997337.001137:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b695 00000020:00000040:2.0:1780997337.001139:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968983331000 refcount=5 00000100:00000040:2.0:1780997337.001154:0:63417:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1780997337.001175:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127059072 00000100:00100000:2.0:1780997337.001178:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127059072 00000020:00000040:2.0:1780997337.001187:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b687 00000020:00000040:2.0:1780997337.001189:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bfa9f000 refcount=5 00000020:00000040:2.0:1780997337.001198:0:63417:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff96888ac53380) now 16 - evictor 00000100:00100000:2.0:1780997337.001230:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127059584 00000100:00100000:2.0:1780997337.001234:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127059584 00000020:00000040:2.0:1780997337.001236:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b68e 00000020:00000040:2.0:1780997337.001238:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968986145800 refcount=5 00000100:00100000:2.0:1780997337.001254:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127060096 00000100:00100000:2.0:1780997337.001256:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127060096 00000020:00000040:2.0:1780997337.001258:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c4b8 00000020:00000040:2.0:1780997337.001260:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc96a800 refcount=5 00000100:00100000:2.0:1780997337.001311:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00000040:2.0:1780997337.001315:0:63417:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968983331000 : new rpc_count 1 00000100:00000040:2.0:1780997337.001320:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689ba2e1c00 x1867507127059968/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:668/0 lens 224/0 e 0 to 0 dl 1780997348 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.001331:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507127059968:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1780997337.001344:0:63417:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127059968 00000100:00000040:2.0:1780997337.001351:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:2.0:1780997337.001355:0:63417:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997337.001376:0:63417:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689ba2e1180 x1867507127059968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997352 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997337.001397:0:63417:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:2.0:1780997337.001402:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e1c00 x1867507127059968/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:668/0 lens 224/224 e 0 to 0 dl 1780997348 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.001410:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3496:x1867507127059968:12345-0@lo:400:kworker.0 Request processed in 80us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997337.001417:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00000040:2.0:1780997337.001419:0:63417:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968983331000 : new rpc_count 0 00000020:00000040:2.0:1780997337.001427:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff968983331000 : new refcount 4 00000100:00100000:2.0:1780997337.001446:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00000040:2.0:1780997337.001448:0:63417:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bfa9f000 : new rpc_count 1 00000100:00000040:2.0:1780997337.001453:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689ba2e2300 x1867507127059072/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:668/0 lens 224/0 e 0 to 0 dl 1780997348 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.001464:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507127059072:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1780997337.001475:0:63417:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127059072 00000100:00080000:3.0:1780997337.001477:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00000040:2.0:1780997337.001481:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000020:00000040:3.0:1780997337.001485:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff96888ac53380) now 16 - evictor 00000100:00000040:2.0:1780997337.001488:0:63417:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997337.001506:0:63417:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689adb8aa00 x1867507127059072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997337.001521:0:63417:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:2.0:1780997337.001526:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e2300 x1867507127059072/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:668/0 lens 224/224 e 0 to 0 dl 1780997348 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.001535:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507127059072:12345-0@lo:400:kworker.0 Request processed in 73us (732us total) trans 0 rc 0/0 00000100:00000040:3.0:1780997337.001542:0:3496:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00100000:2.0:1780997337.001542:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00000040:2.0:1780997337.001548:0:63417:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bfa9f000 : new rpc_count 0 00000100:00000040:3.0:1780997337.001553:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689adb8aa00 x1867507127059072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780997337.001556:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff9689bfa9f000 : new refcount 4 00000100:00000040:3.0:1780997337.001568:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adb8aa00 x1867507127059072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.001569:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:3.0:1780997337.001577:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507127059072:0@lo:400:kworker.0 00000100:00000040:2.0:1780997337.001585:0:63417:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968986145800 : new rpc_count 1 00000100:00000040:2.0:1780997337.001590:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689adb8b100 x1867507127059584/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:668/0 lens 224/0 e 0 to 0 dl 1780997348 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997337.001593:0:3496:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1780997337.001602:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689ba2e1180 x1867507127059968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.001608:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adb8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507127059584:12345-0@lo:400:kworker.0 00000100:00000040:3.0:1780997337.001619:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e1180 x1867507127059968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997352 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1780997337.001622:0:63417:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127059584 00000100:00000040:2.0:1780997337.001629:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:2.0:1780997337.001636:0:63417:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1780997337.001642:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3496:1867507127059968:0@lo:400:kworker.0 00000100:00000040:3.0:1780997337.001651:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689adb8aa00 x1867507127059072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997337.001670:0:63417:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689adb88000 x1867507127059584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997337.001684:0:63417:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:2.0:1780997337.001689:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adb8b100 x1867507127059584/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:668/0 lens 224/224 e 0 to 0 dl 1780997348 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.001697:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adb8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507127059584:12345-0@lo:400:kworker.0 Request processed in 95us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997337.001703:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00000040:2.0:1780997337.001706:0:63417:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968986145800 : new rpc_count 0 00000020:00000040:2.0:1780997337.001711:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff968986145800 : new refcount 4 00000100:00100000:2.0:1780997337.001720:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00000040:2.0:1780997337.001722:0:63417:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc96a800 : new rpc_count 1 00000100:00000040:2.0:1780997337.001726:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689adeddc00 x1867507127060096/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:668/0 lens 224/0 e 0 to 0 dl 1780997348 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.001737:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adeddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507127060096:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1780997337.001746:0:63417:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127060096 00000100:00000040:2.0:1780997337.001751:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:2.0:1780997337.001754:0:63417:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997337.001768:0:63417:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689ba2e1f80 x1867507127060096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997337.001780:0:63417:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:2.0:1780997337.001783:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adeddc00 x1867507127060096/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:668/0 lens 224/224 e 0 to 0 dl 1780997348 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.001792:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adeddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507127060096:12345-0@lo:400:kworker.0 Request processed in 58us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997337.001798:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00000040:2.0:1780997337.001800:0:63417:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc96a800 : new rpc_count 0 00000020:00000040:2.0:1780997337.001814:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc96a800 : new refcount 4 00000100:00000040:0.0:1780997337.002023:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689adb89500 x1867507127059200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.002100:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997337.002120:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfb0e300 x1867507127059200 msgsize 224 00000100:00100000:0.0:1780997337.002124:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997337.002136:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689adb89500 x1867507127059200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.002146:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7835 usecs (8 jiffies) 00000100:00000040:0.0:1780997337.002154:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689adb8ad80 x1867507127059712/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997337.002165:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127059712:0@lo:400:kworker.0 00000100:00000040:0.0:1780997337.002182:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689adb8ad80 x1867507127059712/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.002188:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997337.002203:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfb0ed80 x1867507127059712 msgsize 224 00000100:00100000:0.0:1780997337.002207:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997337.002222:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689adb8ad80 x1867507127059712/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.002244:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 7723 usecs (8 jiffies) 00000100:00000040:0.0:1780997337.002251:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689ba2e0000 x1867507127060224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997337.002262:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689ba2e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507127060224:0@lo:400:kworker.0 00000100:00000040:0.0:1780997337.002290:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689ba2e0000 x1867507127060224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.002297:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997337.002315:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689bc274c50 x1867507127060224 msgsize 224 00000100:00100000:0.0:1780997337.002319:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997337.002321:0:3498:0:(events.c:355:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1780997337.002327:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689ba2e0000 x1867507127060224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.002337:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 5901 usecs (6 jiffies) 00000100:00100000:0.0:1780997337.002348:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:0.0:1780997337.002354:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689adb88e00 x1867507127059328/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997337.002364:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127059328:0@lo:400:kworker.0 00000100:00000040:0.0:1780997337.002379:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689adb88e00 x1867507127059328/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.002386:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997337.002398:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfb0f800 x1867507127059328 msgsize 224 00000100:00100000:0.0:1780997337.002401:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997337.002414:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689adb88e00 x1867507127059328/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.002423:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 942512 usecs (943 jiffies) 00000100:00000040:0.0:1780997337.002430:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9689adb8a680 x1867507127059840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997337.002444:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689adb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127059840:0@lo:400:kworker.0 00000100:00000040:0.0:1780997337.002459:0:3498:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9689adb8a680 x1867507127059840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.002466:0:3498:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997337.002481:0:3498:0:(events.c:343:request_in_callback()) incoming req@ffff9689bfb0c700 x1867507127059840 msgsize 224 00000100:00100000:0.0:1780997337.002485:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780997337.002500:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9689adb8a680 x1867507127059840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997353 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.002509:0:3498:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7357 usecs (8 jiffies) 00000100:00100000:0.0:1780997337.002539:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127059456 00000100:00100000:0.0:1780997337.002546:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127059456 00000020:00000040:0.0:1780997337.002548:0:23044:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c030553a7 00000020:00000040:0.0:1780997337.002550:0:23044:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689ae564000 refcount=5 00000020:00000040:0.0:1780997337.004888:0:23044:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00100000:0.0:1780997337.005016:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127059840 00000100:00100000:0.0:1780997337.005026:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127059840 00000100:00100000:2.0:1780997337.005166:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127059200 00000100:00100000:2.0:1780997337.005171:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127059200 00000020:00000040:2.0:1780997337.005173:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305541e 00000020:00000040:2.0:1780997337.005179:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968983335800 refcount=5 00000020:00000040:2.0:1780997337.005187:0:63417:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9689ba680000) now 12 - evictor 00000100:00000040:2.0:1780997337.005200:0:63417:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1780997337.005215:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127060224 00000100:00100000:2.0:1780997337.005217:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127060224 00000020:00000040:2.0:1780997337.005218:0:63417:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305c4cd 00000020:00000040:2.0:1780997337.005221:0:63417:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689bc96b000 refcount=5 00000100:00100000:2.0:1780997337.005238:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00000040:2.0:1780997337.005243:0:63417:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968983335800 : new rpc_count 1 00000100:00000040:2.0:1780997337.005249:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfb0e300 x1867507127059200/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:668/0 lens 224/0 e 0 to 0 dl 1780997348 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.005260:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127059200:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1780997337.005308:0:63417:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127059200 00000100:00000040:2.0:1780997337.005323:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:2.0:1780997337.005330:0:63417:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997337.005401:0:63417:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689adb89500 x1867507127059200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997337.005435:0:63417:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:2.0:1780997337.005440:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb0e300 x1867507127059200/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:668/0 lens 224/224 e 0 to 0 dl 1780997348 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.005448:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3498:x1867507127059200:12345-0@lo:400:kworker.0 Request processed in 190us (3327us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997337.005456:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00000040:2.0:1780997337.005460:0:63417:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968983335800 : new rpc_count 0 00000020:00000040:2.0:1780997337.005473:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff968983335800 : new refcount 4 00000100:00100000:2.0:1780997337.005504:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00000040:2.0:1780997337.005508:0:63417:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689bc96b000 : new rpc_count 1 00000100:00000040:2.0:1780997337.005512:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bc274c50 x1867507127060224/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:668/0 lens 224/0 e 0 to 0 dl 1780997348 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.005523:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bc274c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507127060224:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1780997337.005536:0:63417:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127060224 00000100:00000040:2.0:1780997337.005541:0:63417:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:2.0:1780997337.005545:0:63417:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780997337.005564:0:63417:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689ba2e0000 x1867507127060224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997337.005586:0:63417:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:2.0:1780997337.005591:0:63417:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bc274c50 x1867507127060224/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:668/0 lens 224/224 e 0 to 0 dl 1780997348 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.005599:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bc274c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3498:x1867507127060224:12345-0@lo:400:kworker.0 Request processed in 78us (3283us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997337.005606:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00000040:2.0:1780997337.005608:0:63417:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689bc96b000 : new rpc_count 0 00000020:00000040:2.0:1780997337.005616:0:63417:0:(genops.c:900:class_export_put()) PUTting export ffff9689bc96b000 : new refcount 4 00000020:00000040:0.0:1780997337.006359:0:23044:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b55a 00000020:00000040:0.0:1780997337.006367:0:23044:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968886bcb000 refcount=5 00000100:00100000:0.0:1780997337.006432:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732 00000100:00000040:0.0:1780997337.006435:0:23044:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689ae564000 : new rpc_count 1 00000100:00000040:0.0:1780997337.006443:0:23044:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689ba2e3b80 x1867507127059456/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:667/0 lens 224/0 e 0 to 0 dl 1780997347 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997337.006458:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ba2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127059456:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780997337.006472:0:23044:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1867507127059456 00000100:00000040:0.0:1780997337.006479:0:23044:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:0.0:1780997337.006483:0:23044:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997337.006522:0:23044:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689adb89180 x1867507127059456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997352 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.006563:0:23044:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:0.0:1780997337.006568:0:23044:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e3b80 x1867507127059456/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:667/0 lens 224/224 e 0 to 0 dl 1780997347 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997337.007052:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ba2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3496:x1867507127059456:12345-0@lo:400:kworker.0 Request processed in 597us (7125us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997337.007059:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732 00000100:00000040:0.0:1780997337.007062:0:23044:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689ae564000 : new rpc_count 0 00000020:00000040:0.0:1780997337.007073:0:23044:0:(genops.c:900:class_export_put()) PUTting export ffff9689ae564000 : new refcount 4 00000100:00100000:0.0:1780997337.007085:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733 00000100:00000040:0.0:1780997337.007088:0:23044:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968886bcb000 : new rpc_count 1 00000100:00000040:0.0:1780997337.007093:0:23044:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfb0c700 x1867507127059840/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:668/0 lens 224/0 e 0 to 0 dl 1780997348 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997337.007106:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127059840:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780997337.007117:0:23044:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1867507127059840 00000100:00000040:0.0:1780997337.007124:0:23044:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:0.0:1780997337.007128:0:23044:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780997337.007150:0:23044:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689adb8a680 x1867507127059840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780997337.007166:0:23044:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:0.0:1780997337.007170:0:23044:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb0c700 x1867507127059840/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:668/0 lens 224/224 e 0 to 0 dl 1780997348 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997337.007179:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127059840:12345-0@lo:400:kworker.0 Request processed in 77us (4695us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997337.007186:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733 00000100:00000040:0.0:1780997337.007188:0:23044:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968886bcb000 : new rpc_count 0 00000020:00000040:0.0:1780997337.007203:0:23044:0:(genops.c:900:class_export_put()) PUTting export ffff968886bcb000 : new refcount 4 00000020:00000040:3.0:1780997337.007386:0:3496:0:(genops.c:1244:class_import_put()) import ffff9689bcdfb800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1780997337.007406:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689ba2e1180 x1867507127059968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997352 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997337.007416:0:3496:0:(genops.c:1244:class_import_put()) import ffff96898616b000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00080000:3.0:1780997337.007434:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1780997337.007440:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9689ba680000) now 12 - evictor 00000100:00080000:3.0:1780997337.007444:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1780997337.007447:0:6347:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9689ba684d40) now 10 - evictor 00000100:00100000:3.0:1780997337.007465:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127059712 00000100:00100000:3.0:1780997337.007475:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127059712 00000020:00000040:3.0:1780997337.007478:0:8242:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b530 00000020:00000040:3.0:1780997337.007482:0:8242:0:(lustre_handles.c:131:class_handle2object()) GET export ffff968889698800 refcount=5 00000100:00000040:3.0:1780997337.007503:0:8242:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1780997337.007603:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127059328 00000100:00100000:3.0:1780997337.007607:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127059328 00000020:00000040:3.0:1780997337.007609:0:8242:0:(genops.c:825:class_conn2export()) looking for export cookie 0x30fd811c0305b4ea 00000020:00000040:3.0:1780997337.007613:0:8242:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9689b79c9000 refcount=7 00000100:00100000:3.0:1780997337.007640:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4160 00000100:00000040:3.0:1780997337.007644:0:8242:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff968889698800 : new rpc_count 1 00000100:00000040:3.0:1780997337.007650:0:8242:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfb0ed80 x1867507127059712/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:668/0 lens 224/0 e 0 to 0 dl 1780997348 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997337.007678:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127059712:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997337.007693:0:8242:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 0, transno 0, xid 1867507127059712 00000100:00000040:3.0:1780997337.007699:0:8242:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:3.0:1780997337.007712:0:8242:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997337.007735:0:8242:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689adb8ad80 x1867507127059712/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997337.007752:0:8242:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:3.0:1780997337.007758:0:8242:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb0ed80 x1867507127059712/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:668/0 lens 224/224 e 0 to 0 dl 1780997348 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997337.007766:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127059712:12345-0@lo:400:kworker.0 Request processed in 92us (5561us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997337.007774:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4160 00000100:00000040:3.0:1780997337.007777:0:8242:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff968889698800 : new rpc_count 0 00000020:00000040:3.0:1780997337.007786:0:8242:0:(genops.c:900:class_export_put()) PUTting export ffff968889698800 : new refcount 4 00000100:00100000:3.0:1780997337.007798:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4161 00000100:00000040:3.0:1780997337.007802:0:8242:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9689b79c9000 : new rpc_count 1 00000100:00000040:3.0:1780997337.007806:0:8242:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9689bfb0f800 x1867507127059328/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:668/0 lens 224/0 e 0 to 0 dl 1780997348 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997337.008093:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bfb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127059328:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780997337.008110:0:8242:0:(ldlm_lib.c:3289:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1867507127059328 00000100:00000040:3.0:1780997337.008116:0:8242:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff96898a59b400 refcount 66 to 0@lo 00000100:00000040:3.0:1780997337.008124:0:8242:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780997337.008148:0:8242:0:(events.c:155:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9689adb88e00 x1867507127059328/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997337.008165:0:8242:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff96898a59b400 refcount 65 to 0@lo 00000100:00000040:3.0:1780997337.008170:0:8242:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689bfb0f800 x1867507127059328/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:668/0 lens 224/224 e 0 to 0 dl 1780997348 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997337.008178:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bfb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127059328:12345-0@lo:400:kworker.0 Request processed in 362us (5779us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997337.008186:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4161 00000100:00000040:3.0:1780997337.008293:0:8242:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9689b79c9000 : new rpc_count 0 00000020:00000040:3.0:1780997337.008304:0:8242:0:(genops.c:900:class_export_put()) PUTting export ffff9689b79c9000 : new refcount 6 00000100:00000040:3.0:1780997337.009476:0:3496:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:3.0:1780997337.009487:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689adb88000 x1867507127059584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997337.009498:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adb88000 x1867507127059584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997337.009506:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507127059584:0@lo:400:kworker.0 00000100:00000040:3.0:1780997337.009520:0:3496:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:3.0:1780997337.009524:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689ba2e1f80 x1867507127060096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997337.009532:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e1f80 x1867507127060096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997337.009539:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507127060096:0@lo:400:kworker.0 00000100:00000040:3.0:1780997337.009555:0:3496:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:3.0:1780997337.009560:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689adb89180 x1867507127059456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997337.009568:0:3496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adb89180 x1867507127059456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997352 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997337.009575:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127059456:0@lo:400:kworker.0 00000100:00000040:3.0:1780997337.009581:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689adb88000 x1867507127059584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997337.009593:0:3496:0:(genops.c:1244:class_import_put()) import ffff96888b416000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1780997337.009602:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689ba2e1f80 x1867507127060096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997337.009621:0:3496:0:(genops.c:1244:class_import_put()) import ffff9689ad6ca000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1780997337.009627:0:3496:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689adb89180 x1867507127059456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997352 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997337.009635:0:3496:0:(genops.c:1244:class_import_put()) import ffff9689a69f7000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1780997337.010831:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:2.0:1780997337.010848:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689adb88e00 x1867507127059328/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780997337.010864:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adb88e00 x1867507127059328/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780997337.010874:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127059328:0@lo:400:kworker.0 00000100:00000040:3.0:1780997337.011396:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:3.0:1780997337.011408:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689adb8a680 x1867507127059840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997337.011420:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adb8a680 x1867507127059840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997337.011429:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127059840:0@lo:400:kworker.0 00000100:00000040:3.0:1780997337.011453:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1780997337.011458:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689adb89500 x1867507127059200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997337.011470:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adb89500 x1867507127059200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997337.011479:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3498:1867507127059200:0@lo:400:kworker.0 00000100:00000040:3.0:1780997337.011493:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1780997337.011497:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689adb8ad80 x1867507127059712/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997337.011505:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689adb8ad80 x1867507127059712/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997337.011511:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689adb8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127059712:0@lo:400:kworker.0 00000100:00000040:3.0:1780997337.011524:0:3498:0:(client.c:3127:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:3.0:1780997337.011537:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9689ba2e0000 x1867507127060224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780997337.011546:0:3498:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9689ba2e0000 x1867507127060224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997337.011554:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689ba2e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3498:1867507127060224:0@lo:400:kworker.0 00000100:00000040:3.0:1780997337.011564:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689adb88e00 x1867507127059328/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997337.011577:0:3498:0:(genops.c:1244:class_import_put()) import ffff9689ae566000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1780997337.011589:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689adb8a680 x1867507127059840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997337.011598:0:3498:0:(genops.c:1244:class_import_put()) import ffff968886bc8000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1780997337.011604:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689adb89500 x1867507127059200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997337.011612:0:3498:0:(genops.c:1244:class_import_put()) import ffff968885ce2000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1780997337.011618:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689adb8ad80 x1867507127059712/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997337.011626:0:3498:0:(genops.c:1244:class_import_put()) import ffff9689869cf800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1780997337.011631:0:3498:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9689ba2e0000 x1867507127060224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780997353 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780997337.011647:0:3498:0:(genops.c:1244:class_import_put()) import ffff9689bcc14800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000001:02000400:1.0:1780997337.317036:0:93027:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1780997337.804155:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997337.804195:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997337.804253:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997337.804310:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997337.804341:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110489216 00000100:00100000:2.0:1780997337.804352:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110489216 00000100:00100000:2.0:1780997337.804406:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110489344 00000100:00100000:2.0:1780997337.804408:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110489344 00000100:00100000:2.0:1780997337.804428:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1481 00000100:00100000:2.0:1780997337.804437:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2395:x1867507110489216:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997337.804505:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2395:x1867507110489216:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997337.804513:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1481 00000100:00100000:2.0:1780997337.804529:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1482 00000100:00100000:2.0:1780997337.804534:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2394:x1867507110489344:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1780997337.804555:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2394:x1867507110489344:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 21us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997337.804561:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1482 00000100:00100000:3.0:1780997337.804933:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110489088 00000100:00100000:3.0:1780997337.804938:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110489088 00000100:00100000:3.0:1780997337.804972:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00100000:3.0:1780997337.804978:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110489088:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997337.805012:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110489088:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997337.805029:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00080000:3.0:1780997337.805057:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780997337.805061:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997337.805213:0:25174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110489472 00000100:00100000:1.0:1780997337.805218:0:25174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110489472 00000100:00100000:1.0:1780997337.805287:0:25174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2734 00000100:00100000:1.0:1780997337.805296:0:25174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110489472:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997337.805326:0:25174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110489472:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997337.805332:0:25174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2734 00000100:00080000:3.0:1780997337.805486:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1780997337.832008:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1780997338.646763:0:93079:0:(tgt_mount.c:2299:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780997338.647090:0:93079:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1780997338.854601:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997339.045885:0:3498:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780997339.045915:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127060352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997339.046004:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997339.046060:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127060352 00000100:00100000:3.0:1780997339.046069:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127060352 00000100:00100000:3.0:1780997339.046127:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4162 00000100:00100000:3.0:1780997339.046138:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127060352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780997339.046183:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:3.0:1780997339.046237:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127060352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997339.046244:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4162 00000100:00100000:3.0:1780997339.048787:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127060352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997339.049746:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127060480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780997339.049836:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997339.049898:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127060480 00000100:00100000:3.0:1780997339.049907:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127060480 00000100:00100000:3.0:1780997339.049965:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4163 00000100:00100000:3.0:1780997339.049976:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127060480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780997339.050020:0:8241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:3.0:1780997339.050075:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127060480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997339.050083:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4163 00000100:00100000:3.0:1780997339.050153:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127060480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780997339.559802:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127060608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780997339.559917:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997339.560013:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127060608 00000100:00100000:0.0:1780997339.560023:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127060608 00000100:00100000:0.0:1780997339.560111:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00100000:0.0:1780997339.560125:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127060608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780997339.560169:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780997339.560234:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127060608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997339.560242:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000100:00080000:3.0:1780997339.560627:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997339.563123:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127060608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1780997339.880048:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1780997339.897230:0:93129:0:(tgt_mount.c:2299:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780997339.899892:0:93129:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1780997340.584022:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780997340.584136:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127060736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780997340.584240:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997340.587146:0:8234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127060736 00000100:00100000:2.0:1780997340.587171:0:8234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127060736 00000100:00100000:2.0:1780997340.587307:0:8234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195 00000100:00100000:2.0:1780997340.587324:0:8234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127060736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780997340.587364:0:8234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1780997340.589311:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997340.589558:0:8234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127060736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2230us (5308us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997340.589595:0:8234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195 00000100:00100000:0.0:1780997340.595935:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127060736:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1780997340.911786:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780997341.931241:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780997342.117594:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997342.117603:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:0.0:1780997342.117648:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997342.117651:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1780997342.117711:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507127061120:0@lo:400:kworker.0 00000100:00100000:1.0:1780997342.117766:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127060864:0@lo:400:kworker.0 00000100:00100000:0.0:1780997342.117787:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997342.117802:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127061248:0@lo:400:kworker.0 00000100:00100000:0.0:1780997342.117827:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127061632:0@lo:400:kworker.0 00000100:00100000:2.0:1780997342.117863:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507127060992:0@lo:400:kworker.0 00000100:00100000:3.0:1780997342.122260:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997342.122261:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997342.122322:0:3498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127061760:0@lo:400:kworker.0 00000100:00100000:1.0:1780997342.122354:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127061376:0@lo:400:kworker.0 00000100:00100000:2.0:1780997342.122691:0:90246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127060864 00000100:00100000:2.0:1780997342.122706:0:90246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127060864 00000100:00100000:2.0:1780997342.122755:0:90246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1780997342.122765:0:90246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507127060864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997342.128347:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997342.128419:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507127062144:0@lo:400:kworker.0 00000100:00100000:0.0:1780997342.128467:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997342.128545:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127061120 00000100:00100000:1.0:1780997342.128546:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997342.128567:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127061120 00000100:00100000:1.0:1780997342.128576:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507127061888:0@lo:400:kworker.0 00000100:00100000:1.0:1780997342.128605:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997342.128646:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127062144 00000100:00100000:1.0:1780997342.128650:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127062144 00000100:00100000:1.0:1780997342.128679:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127061888 00000100:00100000:1.0:1780997342.128682:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127061888 00000100:00100000:1.0:1780997342.128702:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1780997342.128710:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507127062144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997342.128777:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3497:x1867507127062144:12345-0@lo:400:kworker.0 Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997342.128785:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1780997342.128801:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:1.0:1780997342.128807:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507127061888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997342.128840:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507127061888:12345-0@lo:400:kworker.0 Request processed in 33us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997342.128845:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:1.0:1780997342.128880:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507127061888:0@lo:400:kworker.0 00000100:00100000:0.0:1780997342.128906:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:0.0:1780997342.128916:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507127061120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997342.128930:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3497:1867507127062144:0@lo:400:kworker.0 00000100:00100000:0.0:1780997342.128966:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3497:x1867507127061120:12345-0@lo:400:kworker.0 Request processed in 51us (11180us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997342.128974:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:1.0:1780997342.128977:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3497:1867507127061120:0@lo:400:kworker.0 00000100:00080000:0.0:1780997342.129011:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780997342.129026:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127061248 00000100:00100000:0.0:1780997342.129029:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127061632 00000100:00100000:1.0:1780997342.129031:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127061248 00000100:00100000:0.0:1780997342.129034:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127061632 00000100:00100000:1.0:1780997342.129068:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4164 00000100:00100000:1.0:1780997342.129083:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127061248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997342.129120:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3498:x1867507127061248:12345-0@lo:400:kworker.0 Request processed in 39us (6865us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997342.129126:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4164 00000100:00100000:1.0:1780997342.129138:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4165 00000100:00100000:1.0:1780997342.129144:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bf8c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127061632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997342.129188:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bf8c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127061632:12345-0@lo:400:kworker.0 Request processed in 44us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997342.129194:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4165 00000100:00100000:0.0:1780997342.131206:0:25175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127061376 00000100:00100000:0.0:1780997342.131218:0:25175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127061376 00000100:00100000:1.0:1780997342.131426:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127061632:0@lo:400:kworker.0 00000100:00080000:1.0:1780997342.131462:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780997342.132303:0:90246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507127060864:12345-0@lo:400:kworker.0 Request processed in 9534us (10045us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997342.132315:0:90246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1780997342.132671:0:3498:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997342.132728:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127061760 00000100:00100000:2.0:1780997342.132785:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997342.132813:0:80049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127060992 00000100:00100000:2.0:1780997342.132817:0:80049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127060992 00000100:00100000:2.0:1780997342.132862:0:80049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:2.0:1780997342.132871:0:80049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507127060992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997342.132996:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127061760 00000100:00100000:3.0:1780997342.133034:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735 00000100:00100000:3.0:1780997342.133042:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127061760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997342.133083:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3498:x1867507127061760:12345-0@lo:400:kworker.0 Request processed in 42us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997342.133088:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735 00000100:00100000:3.0:1780997342.133131:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3498:1867507127061760:0@lo:400:kworker.0 00000100:00100000:3.0:1780997342.133159:0:3498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3498:1867507127061248:0@lo:400:kworker.0 00000100:00100000:3.0:1780997342.133193:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3496:1867507127060992:0@lo:400:kworker.0 00000100:00100000:3.0:1780997342.133205:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507127061504:0@lo:400:kworker.0 00000100:00100000:3.0:1780997342.133231:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997342.133255:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9689bfb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507127062016:0@lo:400:kworker.0 00000100:00100000:3.0:1780997342.133302:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997342.133348:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127060864:0@lo:400:kworker.0 00000100:00100000:0.0:1780997342.134088:0:25182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736 00000100:00100000:0.0:1780997342.134100:0:25182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127061376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780997342.134145:0:25182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127061376:12345-0@lo:400:kworker.0 Request processed in 50us (5600us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997342.134151:0:25182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736 00000100:00100000:1.0:1780997342.135017:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127061504 00000100:00100000:1.0:1780997342.135025:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127061504 00000100:00100000:1.0:1780997342.135059:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127062016 00000100:00100000:1.0:1780997342.135063:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127062016 00000100:00100000:1.0:1780997342.135086:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:1.0:1780997342.135094:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507127061504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997342.135155:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3496:x1867507127061504:12345-0@lo:400:kworker.0 Request processed in 62us (1922us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997342.135162:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:1.0:1780997342.135178:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:1.0:1780997342.135185:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507127062016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997342.135214:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3496:x1867507127062016:12345-0@lo:400:kworker.0 Request processed in 30us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997342.135220:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00080000:1.0:1780997342.135257:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780997342.135294:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780997342.135721:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127061376:0@lo:400:kworker.0 00000100:00100000:3.0:1780997342.135780:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3496:1867507127061504:0@lo:400:kworker.0 00000100:00100000:3.0:1780997342.135792:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9689bfb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3496:1867507127062016:0@lo:400:kworker.0 00000100:00100000:2.0:1780997342.135870:0:80049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3496:x1867507127060992:12345-0@lo:400:kworker.0 Request processed in 54us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997342.135879:0:80049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00010000:00010000:0.0:1780997342.951475:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997342.980361:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997342.980411:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997342.980489:0:90245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110489600 00000100:00100000:1.0:1780997342.980492:0:63584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110489856 00000100:00100000:3.0:1780997342.980500:0:90245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110489600 00000100:00100000:1.0:1780997342.980500:0:63584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110489856 00000100:00100000:3.0:1780997342.980549:0:90245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:3.0:1780997342.980559:0:90245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bcbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110489600:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997342.980559:0:63584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1489 00000100:00100000:1.0:1780997342.980565:0:63584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2394:x1867507110489856:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997342.980649:0:63584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2394:x1867507110489856:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 83us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997342.980657:0:63584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1489 00000100:00080000:2.0:1780997342.980992:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780997342.983586:0:90245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bcbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110489600:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3017us (3223us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997342.983601:0:90245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:2.0:1780997342.983764:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997342.983809:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997342.983885:0:63417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110489728 00000100:00100000:1.0:1780997342.983893:0:63417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110489728 00000100:00100000:1.0:1780997342.983959:0:63417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1490 00000100:00100000:1.0:1780997342.983967:0:63417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2394:x1867507110489728:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997342.984016:0:63417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2394:x1867507110489728:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 50us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997342.984023:0:63417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1490 00000100:00080000:2.0:1780997342.984085:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780997342.984815:0:25177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110489984 00000100:00100000:3.0:1780997342.984822:0:25177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110489984 00000100:00100000:3.0:1780997342.984878:0:25177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2737 00000100:00100000:3.0:1780997342.984998:0:25177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110489984:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997342.985038:0:25177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2394:x1867507110489984:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 153us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997342.985044:0:25177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2737 00000100:00080000:2.0:1780997342.985421:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1780997343.973626:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1780997344.118581:0:93226:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 00000100:00100000:3.0:1780997344.165435:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780997344.165462:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127062272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780997344.165588:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780997344.165628:0:8242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127062272 00000100:00100000:2.0:1780997344.165635:0:8242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127062272 00000100:00100000:2.0:1780997344.165706:0:8242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4166 00000100:00100000:2.0:1780997344.165716:0:8242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3499:x1867507127062272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780997344.165756:0:8242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:2.0:1780997344.165815:0:8242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3499:x1867507127062272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997344.165822:0:8242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4166 00000100:00100000:3.0:1780997344.165852:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127062272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780997344.166106:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127062400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780997344.166133:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997344.166292:0:23042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127062400 00000100:00100000:0.0:1780997344.166297:0:23042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127062400 00000100:00100000:0.0:1780997344.166327:0:23042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4167 00000100:00100000:0.0:1780997344.166335:0:23042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127062400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780997344.166353:0:23042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:0.0:1780997344.166404:0:23042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3499:x1867507127062400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997344.166410:0:23042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4167 00000100:00100000:2.0:1780997344.166458:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3499:1867507127062400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780997344.677970:0:3497:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780997344.678001:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127062528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780997344.678094:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780997344.678196:0:8235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127062528 00000100:00100000:0.0:1780997344.678209:0:8235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127062528 00000100:00100000:0.0:1780997344.678337:0:8235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196 00000100:00100000:0.0:1780997344.678357:0:8235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127062528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780997344.678408:0:8235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1780997344.678671:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780997344.683594:0:8235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3497:x1867507127062528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5235us (5488us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997344.683627:0:8235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196 00000100:00100000:1.0:1780997344.684536:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3497:1867507127062528:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1780997344.997536:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780997345.701396:0:3497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127062656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780997345.701482:0:3497:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997345.701540:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127062656 00000100:00100000:3.0:1780997345.701547:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127062656 00000100:00100000:3.0:1780997345.701620:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197 00000100:00100000:3.0:1780997345.701632:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127062656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780997345.701653:0:14235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780997345.701701:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3497:x1867507127062656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997345.701710:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197 00000100:00100000:3.0:1780997345.701765:0:3497:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3497:1867507127062656:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1780997345.701816:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780997346.031587:0:14480:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1780997346.046950:0:93274:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00010000:00010000:0.0:1780997347.046405:0:37626:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780997347.237657:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997347.237664:0:13646:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:0.0:1780997347.237682:0:13646:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780997347.237686:0:13646:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:1.0:1780997347.237811:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507127062912:0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.237881:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997347.237916:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507127063424:0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.237937:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997347.237954:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507127063936:0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.237978:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997347.238013:0:3499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1780997347.238019:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127062784:0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.238046:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997347.238070:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127063296:0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.238093:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997347.238110:0:3499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507127063808:0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.238129:0:3499:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780997347.238157:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127062912 00000100:00100000:1.0:1780997347.238165:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127062912 00000100:00100000:1.0:1780997347.238210:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127063424 00000100:00100000:1.0:1780997347.238214:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127063424 00000100:00100000:1.0:1780997347.238230:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127063936 00000100:00100000:1.0:1780997347.238233:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127063936 00000100:00100000:1.0:1780997347.238244:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127063808 00000100:00100000:1.0:1780997347.238246:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127063808 00000100:00100000:1.0:1780997347.238260:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:1.0:1780997347.238294:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507127062912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.238348:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3499:x1867507127062912:12345-0@lo:400:kworker.0 Request processed in 80us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997347.238355:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:1.0:1780997347.238375:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1780997347.238381:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507127063424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.238409:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3499:x1867507127063424:12345-0@lo:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997347.238415:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1780997347.238426:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1780997347.238432:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507127063936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.238470:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3499:x1867507127063936:12345-0@lo:400:kworker.0 Request processed in 39us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997347.238476:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1780997347.238488:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1780997347.238494:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507127063808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997347.238706:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507127063040:0@lo:400:kworker.0 00000100:00100000:3.0:1780997347.238737:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997347.238763:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127063552:0@lo:400:kworker.0 00000100:00100000:3.0:1780997347.238787:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997347.238804:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507127064064:0@lo:400:kworker.0 00000100:00100000:3.0:1780997347.238824:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997347.238835:0:3496:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1780997347.238841:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127063168:0@lo:400:kworker.0 00000100:00100000:3.0:1780997347.238860:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997347.238879:0:3496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff968888df8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127063680:0@lo:400:kworker.0 00000100:00100000:3.0:1780997347.238899:0:3496:0:(events.c:346:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780997347.238957:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127063552 00000100:00100000:3.0:1780997347.238962:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127063552 00000100:00100000:3.0:1780997347.238990:0:80061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127063168 00000100:00100000:3.0:1780997347.238993:0:80061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127063168 00000100:00100000:3.0:1780997347.239023:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4168 00000100:00100000:3.0:1780997347.239030:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127063552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997347.239068:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127063552:12345-0@lo:400:kworker.0 Request processed in 39us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997347.239075:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4168 00000100:00100000:3.0:1780997347.239088:0:80061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4169 00000100:00100000:3.0:1780997347.239094:0:80061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127063168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780997347.239121:0:80061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3496:x1867507127063168:12345-0@lo:400:kworker.0 Request processed in 28us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997347.239127:0:80061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4169 00000100:00100000:3.0:1780997347.239170:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3496:1867507127063168:0@lo:400:kworker.0 00000100:00100000:3.0:1780997347.239181:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127063552:0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.239329:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3499:x1867507127063808:12345-0@lo:400:kworker.0 Request processed in 25us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997347.239338:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1780997347.239353:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127063040 00000100:00100000:1.0:1780997347.239357:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127063040 00000100:00100000:1.0:1780997347.239374:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127064064 00000100:00100000:1.0:1780997347.239377:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127064064 00000100:00100000:1.0:1780997347.239388:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:1.0:1780997347.239394:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507127063040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.239434:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3496:x1867507127063040:12345-0@lo:400:kworker.0 Request processed in 39us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997347.239440:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:1.0:1780997347.239451:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:3.0:1780997347.239643:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3496:1867507127063040:0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.239726:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507127064064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.239774:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3496:x1867507127064064:12345-0@lo:400:kworker.0 Request processed in 317us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997347.239781:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:1.0:1780997347.239806:0:90250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127062784 00000100:00100000:1.0:1780997347.239810:0:90250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127062784 00000100:00100000:2.0:1780997347.239945:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127063296 00000100:00100000:2.0:1780997347.239950:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127063296 00000100:00100000:2.0:1780997347.239976:0:25178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507127063680 00000100:00100000:2.0:1780997347.239979:0:25178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507127063680 00000100:00100000:2.0:1780997347.239999:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738 00000100:00100000:2.0:1780997347.240006:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689b11e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127063296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997347.240043:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689b11e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3499:x1867507127063296:12345-0@lo:400:kworker.0 Request processed in 37us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997347.240050:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738 00000100:00100000:2.0:1780997347.240060:0:25178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739 00000100:00100000:2.0:1780997347.240066:0:25178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127063680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780997347.240091:0:25178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3496:x1867507127063680:12345-0@lo:400:kworker.0 Request processed in 25us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1780997347.240096:0:25178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739 00000100:00100000:1.0:1780997347.240141:0:90250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1780997347.240149:0:90250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507127062784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780997347.240192:0:90250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18+23:3499:x1867507127062784:12345-0@lo:400:kworker.0 Request processed in 45us (2145us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997347.240199:0:90250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1780997347.240260:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3496:1867507127063680:0@lo:400:kworker.0 00000100:00100000:3.0:1780997347.240299:0:3496:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3496:1867507127064064:0@lo:400:kworker.0 00000100:00080000:2.0:1780997347.240388:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780997347.240394:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780997347.240396:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780997347.244999:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bdcd4e03-8d56-43b8-bfda-3b2f97e67d18:3499:1867507127062784:0@lo:400:kworker.0 00000100:00100000:0.0:1780997347.245021:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3499:1867507127063296:0@lo:400:kworker.0 00000100:00100000:0.0:1780997347.245034:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3499:1867507127063808:0@lo:400:kworker.0 00000100:00100000:0.0:1780997347.245047:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3499:1867507127062912:0@lo:400:kworker.0 00000100:00100000:0.0:1780997347.245060:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3499:1867507127063424:0@lo:400:kworker.0 00000100:00100000:0.0:1780997347.245071:0:3499:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff968888dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3499:1867507127063936:0@lo:400:kworker.0 00000001:02000400:2.0:1780997347.527859:0:93322:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_135: @@@@@@ FAIL: Unexpected sync success 00010000:00010000:0.0:1780997348.069747:0:6340:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780997348.115136:0:3491:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997348.115251:0:90247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110490240 00000100:00100000:0.0:1780997348.115262:0:90247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110490240 00000100:00100000:0.0:1780997348.115348:0:90247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:0.0:1780997348.115358:0:90247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689adfd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110490240:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1780997348.115424:0:90247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689adfd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf5d474c-5b3a-4e23-b534-5ea64925b132+9:2394:x1867507110490240:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 68us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1780997348.115432:0:90247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:0.0:1780997348.123380:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997348.123430:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997348.123467:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997348.123567:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110490368 00000100:00100000:3.0:1780997348.123582:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110490368 00000100:00100000:3.0:1780997348.123670:0:63419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110490496 00000100:00100000:3.0:1780997348.123674:0:63419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110490496 00000100:00100000:3.0:1780997348.123700:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1497 00000100:00100000:3.0:1780997348.123712:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2395:x1867507110490368:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997348.123793:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+11:2395:x1867507110490368:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 84us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997348.123812:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1497 00000100:00100000:3.0:1780997348.123840:0:63419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1498 00000100:00100000:3.0:1780997348.123846:0:63419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2395:x1867507110490496:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1780997348.123870:0:63419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+51:2395:x1867507110490496:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1780997348.123877:0:63419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1498 00000100:00080000:0.0:1780997348.124403:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780997348.124409:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780997348.124718:0:25179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110490624 00000100:00100000:1.0:1780997348.124725:0:25179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110490624 00000100:00100000:1.0:1780997348.124790:0:25179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2740 00000100:00080000:0.0:1780997348.124881:0:6347:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780997348.125036:0:25179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110490624:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1780997348.125098:0:25179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2395:x1867507110490624:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997348.125105:0:25179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2740 00000100:00100000:0.0:1780997348.131860:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997348.132146:0:23044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110490112 00000100:00100000:1.0:1780997348.132160:0:23044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110490112 00000100:00100000:1.0:1780997348.132228:0:23044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2741 00000100:00100000:1.0:1780997348.132239:0:23044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2393:x1867507110490112:12345-192.168.206.51@tcp:8:ptlrpcd_rcv.0 00010000:02000400:1.0:1780997348.132307:0:23044:0:(ldlm_lib.c:963:target_handle_reconnect()) lustre-OST0000: Client e4805cfa-ac6d-4d67-bb97-a6c06740fcd0 (at 192.168.206.51@tcp) reconnected, waiting for 3 clients in recovery for 1:24 00010000:00080000:1.0:1780997348.150302:0:23044:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp recovering/t4294969478 exp ffff9689bc9e6000 cur 3875 last 1780997348 00002000:00100000:1.0:1780997348.150340:0:23044:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e4805cfa-ac6d-4d67-bb97-a6c06740fcd0/ffff9689bc9e6000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2113601 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1780997348.150373:0:23044:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli 192.168.206.51@tcp supports cksum type f7, return f7 00000100:00080000:1.0:1780997348.150408:0:23044:0:(import.c:65:import_set_state_nolock()) ffff9689bc96b800 : changing import state from FULL to RECOVER 00000100:00080000:1.0:1780997348.150421:0:23044:0:(import.c:65:import_set_state_nolock()) ffff9689bc96b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780997348.150557:0:23044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2393:x1867507110490112:12345-192.168.206.51@tcp:8:ptlrpcd_rcv.0 Request processed in 18319us (18706us total) trans 0 rc 0/0 00000100:00100000:1.0:1780997348.150568:0:23044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2741 00000100:00100000:2.0:1780997348.166003:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1780997348.166049:0:3489:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1780997348.166134:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110490752 00000100:00100000:3.0:1780997348.166144:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110490752 00000100:00100000:3.0:1780997348.166198:0:8233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110490880 00000100:00100000:3.0:1780997348.166201:0:8233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110490880 00000100:00100000:3.0:1780997348.166232:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6071 00000100:00100000:3.0:1780997348.166242:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110490752:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1780997348.166260:0:8233:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689ad8cbb80 x1867507110490752/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997348.166306:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110490752:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 66us (313us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997348.166313:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6071 00000100:00100000:3.0:1780997348.166324:0:8233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6072 00000100:00100000:3.0:1780997348.166332:0:8233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689ad8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110490880:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1780997348.166340:0:8233:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689ad8c8700 x1867507110490880/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780997348.166349:0:8233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689ad8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110490880:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 20us (301us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780997348.166355:0:8233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6072 00010000:00080000:3.0:1780997348.166369:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1780997348.166389:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff9689ad8cbb80 x1867507110490752/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1780997348.166398:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:3.0:1780997348.166408:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1780997348.166410:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1780997348.166414:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff9689ad8c8700 x1867507110490880/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1780997348.166420:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:3.0:1780997348.166423:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1780997348.167529:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997348.167556:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997348.167652:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997348.169027:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1780997348.169090:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110491008 00000100:00100000:1.0:1780997348.169100:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110491008 00000100:00100000:1.0:1780997348.169146:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110491136 00000100:00100000:1.0:1780997348.169150:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110491136 00000100:00100000:1.0:1780997348.169166:0:25170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110491264 00000100:00100000:1.0:1780997348.169168:0:25170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110491264 00000100:00100000:1.0:1780997348.169187:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6073 00000100:00100000:1.0:1780997348.169195:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2393:x1867507110491008:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1780997348.169212:0:25170:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff968888df9880 x1867507110491008/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997348.169227:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2393:x1867507110491008:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 33us (1712us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997348.169233:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6073 00000100:00100000:1.0:1780997348.169242:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6074 00000100:00100000:1.0:1780997348.169248:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2393:x1867507110491136:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1780997348.169255:0:25170:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff968888dfaa00 x1867507110491136/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997348.169262:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2393:x1867507110491136:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 16us (1706us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997348.169284:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6074 00000100:00100000:1.0:1780997348.169293:0:25170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6075 00000100:00100000:1.0:1780997348.169300:0:25170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2393:x1867507110491264:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1780997348.169307:0:25170:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff968888df9c00 x1867507110491264/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997348.169333:0:25170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+7:2393:x1867507110491264:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 34us (1681us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997348.169339:0:25170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6075 00010000:00080000:1.0:1780997348.169393:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1780997348.169400:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff968888df9880 x1867507110491008/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1780997348.169409:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1780997348.169420:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1780997348.169422:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1780997348.169426:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff968888dfaa00 x1867507110491136/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1780997348.169432:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1780997348.169436:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1780997348.169437:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1780997348.169440:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff968888df9c00 x1867507110491264/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1780997348.169446:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1780997348.169450:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1780997348.172658:0:9596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110491392 00000100:00100000:1.0:1780997348.172674:0:9596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110491392 00000100:00100000:1.0:1780997348.172740:0:9596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6076 00000100:00100000:1.0:1780997348.172750:0:9596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9689bd01b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2393:x1867507110491392:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1780997348.172769:0:9596:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9689bd01b850 x1867507110491392/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780997348.172787:0:9596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9689bd01b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+5:2393:x1867507110491392:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 40us (3767us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780997348.172879:0:9596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6076 00010000:00080000:1.0:1780997348.172897:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1780997348.172904:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff9689bd01b850 x1867507110491392/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1780997348.172914:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1780997348.172927:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1780997348.173025:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997348.173066:0:3490:0:(events.c:346:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1780997348.173108:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110491520 00000100:00100000:0.0:1780997348.173112:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110491520 00000100:00100000:0.0:1780997348.173135:0:25171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1867507110491648 00000100:00100000:0.0:1780997348.173138:0:25171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1867507110491648 00000100:00100000:0.0:1780997348.173156:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6077 00000100:00100000:0.0:1780997348.173162:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110491520:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1780997348.173179:0:25171:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff968888df9f80 x1867507110491520/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997348.173191:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110491520:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 30us (169us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997348.173198:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6077 00000100:00100000:0.0:1780997348.173207:0:25171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6078 00000100:00100000:0.0:1780997348.173213:0:25171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff968888df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110491648:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1780997348.173220:0:25171:0:(ldlm_lib.c:3171:target_queue_recovery_request()) @@@ queue lock replay req req@ffff968888df8700 x1867507110491648/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780997348.173228:0:25171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff968888df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4805cfa-ac6d-4d67-bb97-a6c06740fcd0+6:2393:x1867507110491648:12345-192.168.206.51@tcp:101:ldlm_lock_repla.0 Request processed in 17us (163us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780997348.173233:0:25171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6078 00010000:00080000:1.0:1780997348.173351:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1780997348.173357:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff968888df9f80 x1867507110491520/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1780997348.173365:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1780997348.173372:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1780997348.173374:0:92703:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1780997348.173378:0:92703:0:(ldlm_lib.c:2872:target_recovery_thread()) @@@ processing lock from 192.168.206.51@tcp: req@ffff968888df8700 x1867507110491648/t0(0) o101->e4805cfa-ac6d-4d67-bb97-a6c06740fcd0@192.168.206.51@tcp:679/0 lens 328/0 e 0 to 0 dl 1780997359 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1780997348.173383:0:92703:0:(ldlm_lib.c:2873:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1780997348.173386:0:92703:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00010000:0.0:1780997349.093574:0:6339:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 69620 lines, 69620 kept, 0 dropped, 0 bad.